[ML] Expose the Input Type option for the text_embedding task in the Inference API #117856
Labels
>enhancement
Feature:GenAI
Features around GenAI
:ml
Machine learning
Team:ML
Meta label for the ML team
Description
Many of the integrated inference services have an input type option for text embeddings which modifies the resulting embedding for a specific use. The inference API has an InputType class for internal use and depending on where the text embedding call is made the Inference API will pick either the
search
oringest
input type.When ingesting documents with an ingest pipeline or into a semantic text field the
ingest
type is used, when used in a query thesearch
type is used automatically, this way users don't have to worry about selecting the right type and will get consistent results.Exposing the input_type option in the
POST _inference
API is a natural extension that gives users more control over their embeddings. This change should not alter the search or ingest behaviours.The text was updated successfully, but these errors were encountered: