InferenceProcessor client not up to date with fields present in server

[RichardClouston]

Java API client version

8.12.2

Java version

17.0.8

Elasticsearch Version

8.17.4

Problem description

I'm trying to add ELSER support to our existing Elasticsearch solution, but I'm unable create an ingest pipeline because the ES client doesn't support the fields we're using. When I try to deserialize our pipeline json into an IngestPipeline, it throws an exception for invalid fields. The specific fields which are failing are the input_output and ignore_missing fields.

Our client is a little behind, but I checked the most recent version and it also doesn't seem to have the missing fields. It looks like these fields were added in the 8.11 version of Elasticsearch, so if the client is a 1 to 1 match our version of the client should support these fields. Here is the code for the ingest pipeline we are trying to create:

[
  ...
  {
    "inference": {
      "model_id": ".elser_model_2",
      "input_output": [
        {
          "input_field": "inputField1",
          "output_field": "inputField1Embedding"
        },
        {
          "input_field": "inputField2",
          "output_field": "inputField2Embedding"
        }
      ],
      "ignore_missing": true
    }
  }
  ...
]

[l-trotta]

Hello, thanks for reporting this! We're definitely missing some fields from the API specification used to produce the clients code, we'll fix it so that they're available in the next version of the Java client (8.17.x and greater).