new_in_town
03/13/2026, 3:59 PM"name": "embedding",
"type": "float[]",
"num_dim" : 4096,
"embed": {
"from": [
"title",
"content",
"tags1",
"tags2",
"organization",
],
"model_config": {
"query_prefix": "query:Given a search query, retrieve relevant passages that answer the query",
"model_name": "openai/Qwen/Qwen3-Embedding-8B",
"api_key": ...
"url": "https://api.studio.nebius.ai/v1/embeddings"
}
}
The search results are... well, "it could be better". Not "Google like" (i mean google like 10 years ago).
Before I use heavy artillery like Conversational Search (RAG) or something else... what are my options?
• To pre-process my documents, spilt them into chunks (1 chunk = 1 paragraph) and compute embeddings for these chunks instead of full documents... is it good idea?
• To use better embedding model ? (I think Qwen3-Embedding-8B is good enough, correct me if i wrong)
Something else?Kishore Nallan
03/14/2026, 4:26 AMnew_in_town
03/14/2026, 1:17 PM{
"name": "doc",
"fields": [
{"name": "title" ... },
{"name": "content" ... },
{"name": "tags1" ... },
{"name": "tags2" ... },
{"name": "organization" ... },
...
]
}
And my child collection named "chunk"
{
"name": "chunk",
"fields": [
{"name": "chunk_str", "type": "string" ... },
{"name": "chunk_embed", "type": "float[]", "embed": { "from": [chunk_str] ...} ... },
{"name": "doc_id", "type": "string", "reference": "doc.id"}
]
}
And I search this way (semantic search):
{
"q": "device to type things on",
"collection": "doc",
"query_by": "$chunk(chunk_embed)",
"vector_query": $chunk( chunk_embed:([], k: 200) ),
"prefix": "false",
"exclude_fields": "$chunk(chunk_embed)"
"per_page": 20,
"page": 1
}
Is it the right syntax? ( I am trying to combine multiple Typesense features, which is a bit difficult... pls take a look if possible)
thanks in advance @Kishore Nallan!Kishore Nallan
03/14/2026, 1:23 PMnew_in_town
03/14/2026, 1:45 PMAlan Martini
03/17/2026, 3:31 PMnew_in_town
03/17/2026, 4:50 PMdistance_threshold a bit (it was 0.51 before) - I understand, with increasing distance_threshold user will see more garbage results after good results... that's life...
My client code looks like this:
const threshold = 0.56;
const fetchK = 40;
const vectorQuery = `embedding:([], ef:10, distance_threshold:${threshold}, k:${fetchK})`;
const searchParameters = {
q: QUERY,
query_by: 'embedding',
exclude_fields: 'embedding,content,content_indexed',
per_page: fetchK,
prefix: 'false',
vector_query: vectorQuery,
drop_tokens_threshold: 0,
num_typos: 0,
prioritize_num_matching_fields: false,
page: 1
};
client.collections('docs').documents().search(searchParameters).then( ... );
How bad it is?
and about document size vs embedding model capabilities: I am using this https://huggingface.co/Qwen/Qwen3-Embedding-8B embedder,
and they advertise it with "Context Length: 32k"... if my "screen-long" documents fit into 32k tokens - am I fine and need no chunking?