FLOAT_VECTOR: support for custom BASE_URL in embedding

General Discussions - English
1

Hi,

The new built-in embedding generation in Manticore Search is useful, but the current CREATE TABLE syntax only supports MODEL_NAME, FROM, and API_KEY.

To work with custom or proxy endpoints (e.g., self-hosted or OpenAI-compatible APIs), it would be helpful to also specify a BASE_URL, like:

CREATE TABLE products (
    title TEXT,
    content TEXT,
    embedding_vector FLOAT_VECTOR KNN_TYPE='hnsw' HNSW_SIMILARITY='cosine'
        MODEL_NAME='emb-openai/text-embedding-3-large'
        FROM='title,content'
        API_KEY='sk-...'
        BASE_URL='https://my.llm.provider/v1'
);

Is this possible now, or could it be added in a future release?

2

The related issue is Add support for configurable base_url in autoembedding · Issue #3771 · manticoresoftware/manticoresearch · GitHub

1 Like