Mateusz Buśkiewicz
12/03/2025, 6:15 PMnum_dim for OpenAI-compatible APIs. I’m using typesense/typesense:30.0.rca34
field settings
{
name: "embeddings_q",
type: "float[]",
embed: {
from: ["q"],
model_config: {
model_name: "openai/mymodel",
api_key: "",
url: "http://debug-proxy:8080/v1",
},
},
num_dim: 2,
},
API is served with ghcr.io/huggingface/text-embeddings-inference:hopper-1.8.3
and then I use mitmproxy/mitmproxy for debugging purposes.
`Creating the collection works fine, and Typesense is passing
Creating works fine, and Typesense is passing dimensions properly:
debug-proxy | 172.18.0.2:54786: POST http://embeddings/v1/embeddings
debug-proxy | Host: embeddings
debug-proxy | User-Agent: Typesense/1.0
debug-proxy | Accept: */*
debug-proxy | Content-Type: application/json
debug-proxy | Authorization: Bearer
debug-proxy | Content-Length: 55
debug-proxy |
debug-proxy | {
debug-proxy | "dimensions": 2,
debug-proxy | "input": "typesense",
debug-proxy | "model": "my-model"
debug-proxy | }
debug-proxy |
debug-proxy | << 200 OK 190b
debug-proxy | content-type: application/json
debug-proxy | x-compute-type: gpu+optimized
debug-proxy | x-compute-time: 2
debug-proxy | x-compute-characters: 9
debug-proxy | x-compute-tokens: 4
debug-proxy | x-total-time: 2
debug-proxy | x-tokenization-time: 0
debug-proxy | x-queue-time: 0
debug-proxy | x-inference-time: 1
debug-proxy | vary: origin, access-control-request-method, access-control-request-headers
debug-proxy | access-control-allow-origin: *
debug-proxy | content-length: 190
debug-proxy | date: Wed, 03 Dec 2025 18:14:27 GMT
debug-proxy |
debug-proxy | {
debug-proxy | "object": "list",
debug-proxy | "data": [
debug-proxy | {
debug-proxy | "object": "embedding",
debug-proxy | "embedding": [
debug-proxy | -0.8041298,
debug-proxy | 0.59445375
debug-proxy | ],
debug-proxy | "index": 0
debug-proxy | }
debug-proxy | ],
debug-proxy | "model": "Snowflake/snowflake-arctic-embed-l-v2.0",
debug-proxy | "usage": {
debug-proxy | "prompt_tokens": 4,
debug-proxy | "total_tokens": 4
debug-proxy | }
debug-proxy | }
debug-proxy |
But then, when I actually try to index something, it throws:
curl -X POST "http://localhost:8108/collections/blocks/documents" -H "X-TYPESENSE-API-KEY: key" -H "Content-Type: application/json" -d '{
"q": "example query text",
"organics_text": "example organics text content"
}'
{"message":"Vector size mismatch."}
And mitmproxy shows that incorrect num_dim is passed:
debug-proxy | 172.18.0.2:46254: POST http://embeddings/v1/embeddings
debug-proxy | Host: embeddings
debug-proxy | User-Agent: Typesense/1.0
debug-proxy | Accept: */*
debug-proxy | Content-Type: application/json
debug-proxy | Authorization: Bearer
debug-proxy | Content-Length: 70
debug-proxy |
debug-proxy | {
debug-proxy | "dimensions": 1024,
debug-proxy | "input": [
debug-proxy | "example query text "
debug-proxy | ],
debug-proxy | "model": "my-model"
debug-proxy | }
debug-proxy |
debug-proxy | << 200 OK 12.6k
debug-proxy | content-type: application/json
debug-proxy | x-compute-type: gpu+optimized
debug-proxy | x-compute-time: 2
debug-proxy | x-compute-characters: 19
debug-proxy | x-compute-tokens: 7
debug-proxy | x-total-time: 2
debug-proxy | x-tokenization-time: 0
debug-proxy | x-queue-time: 0
debug-proxy | x-inference-time: 1
debug-proxy | vary: origin, access-control-request-method, access-control-request-headers
debug-proxy | access-control-allow-origin: *
debug-proxy | content-length: 12885
debug-proxy | date: Wed, 03 Dec 2025 18:15:04 GMT
debug-proxy |
debug-proxy | {
debug-proxy | "object": "list",
debug-proxy | "data": [
debug-proxy | {
debug-proxy | "object": "embedding",
debug-proxy | "embedding": [
debug-proxy | -0.0013086506,
debug-proxy | 0.114735976,
debug-proxy | 0.028122982,
// rest omitted for brevityJonathan King
12/04/2025, 10:22 PMnum_dim. If it is we'll make a issue on the github and I'll link it here.