I’m having issues with setting custom `num_dim` fo...
# community-help
m
I’m having issues with setting custom
num_dim
for OpenAI-compatible APIs. I’m using
typesense/typesense:30.0.rca34
field settings
Copy code
{
      name: "embeddings_q",
      type: "float[]",
      embed: {
        from: ["q"],
        model_config: {
          model_name: "openai/mymodel",
          api_key: "",
          url: "http://debug-proxy:8080/v1",
        },
      },
      num_dim: 2,
    },
API is served with
ghcr.io/huggingface/text-embeddings-inference:hopper-1.8.3
and then I use
mitmproxy/mitmproxy
for debugging purposes. `Creating the collection works fine, and Typesense is passing Creating works fine, and Typesense is passing
dimensions
properly:
Copy code
debug-proxy  | 172.18.0.2:54786: POST http://embeddings/v1/embeddings
debug-proxy  |     Host: embeddings
debug-proxy  |     User-Agent: Typesense/1.0
debug-proxy  |     Accept: */*
debug-proxy  |     Content-Type: application/json
debug-proxy  |     Authorization: Bearer
debug-proxy  |     Content-Length: 55
debug-proxy  | 
debug-proxy  |     {
debug-proxy  |         "dimensions": 2,
debug-proxy  |         "input": "typesense",
debug-proxy  |         "model": "my-model"
debug-proxy  |     }
debug-proxy  | 
debug-proxy  |  << 200 OK 190b
debug-proxy  |     content-type: application/json
debug-proxy  |     x-compute-type: gpu+optimized
debug-proxy  |     x-compute-time: 2
debug-proxy  |     x-compute-characters: 9
debug-proxy  |     x-compute-tokens: 4
debug-proxy  |     x-total-time: 2
debug-proxy  |     x-tokenization-time: 0
debug-proxy  |     x-queue-time: 0
debug-proxy  |     x-inference-time: 1
debug-proxy  |     vary: origin, access-control-request-method, access-control-request-headers
debug-proxy  |     access-control-allow-origin: *
debug-proxy  |     content-length: 190
debug-proxy  |     date: Wed, 03 Dec 2025 18:14:27 GMT
debug-proxy  | 
debug-proxy  |     {
debug-proxy  |         "object": "list",
debug-proxy  |         "data": [
debug-proxy  |             {
debug-proxy  |                 "object": "embedding",
debug-proxy  |                 "embedding": [
debug-proxy  |                     -0.8041298,
debug-proxy  |                     0.59445375
debug-proxy  |                 ],
debug-proxy  |                 "index": 0
debug-proxy  |             }
debug-proxy  |         ],
debug-proxy  |         "model": "Snowflake/snowflake-arctic-embed-l-v2.0",
debug-proxy  |         "usage": {
debug-proxy  |             "prompt_tokens": 4,
debug-proxy  |             "total_tokens": 4
debug-proxy  |         }
debug-proxy  |     }
debug-proxy  |
But then, when I actually try to index something, it throws:
Copy code
curl -X POST "http://localhost:8108/collections/blocks/documents"   -H "X-TYPESENSE-API-KEY: key"   -H "Content-Type: application/json"   -d '{
    "q": "example query text",
    "organics_text": "example organics text content"
  }'
{"message":"Vector size mismatch."}
And mitmproxy shows that incorrect num_dim is passed:
Copy code
debug-proxy  | 172.18.0.2:46254: POST http://embeddings/v1/embeddings
debug-proxy  |     Host: embeddings
debug-proxy  |     User-Agent: Typesense/1.0
debug-proxy  |     Accept: */*
debug-proxy  |     Content-Type: application/json
debug-proxy  |     Authorization: Bearer
debug-proxy  |     Content-Length: 70
debug-proxy  | 
debug-proxy  |     {
debug-proxy  |         "dimensions": 1024,
debug-proxy  |         "input": [
debug-proxy  |             "example query text "
debug-proxy  |         ],
debug-proxy  |         "model": "my-model"
debug-proxy  |     }
debug-proxy  | 
debug-proxy  |  << 200 OK 12.6k
debug-proxy  |     content-type: application/json
debug-proxy  |     x-compute-type: gpu+optimized
debug-proxy  |     x-compute-time: 2
debug-proxy  |     x-compute-characters: 19
debug-proxy  |     x-compute-tokens: 7
debug-proxy  |     x-total-time: 2
debug-proxy  |     x-tokenization-time: 0
debug-proxy  |     x-queue-time: 0
debug-proxy  |     x-inference-time: 1
debug-proxy  |     vary: origin, access-control-request-method, access-control-request-headers
debug-proxy  |     access-control-allow-origin: *
debug-proxy  |     content-length: 12885
debug-proxy  |     date: Wed, 03 Dec 2025 18:15:04 GMT
debug-proxy  | 
debug-proxy  |     {
debug-proxy  |         "object": "list",
debug-proxy  |         "data": [
debug-proxy  |             {
debug-proxy  |                 "object": "embedding",
debug-proxy  |                 "embedding": [
debug-proxy  |                     -0.0013086506,
debug-proxy  |                     0.114735976,
debug-proxy  |                     0.028122982,
// rest omitted for brevity
j
Investigating now, might be a bug with
num_dim
. If it is we'll make a issue on the github and I'll link it here.