#community-help

Speeding up Document Indexing with Auto-Embedding

TLDR Somesh queries the long document indexing time using auto-embedding. Kishore Nallan confirms it's normal and suggests using an external service or running Typesense on GPU.

Powered by Struct AI
Nov 14, 2023 (2 weeks ago)
Somesh
Photo of md5-a9a351e11d64f05b41fec183816a0cda
Somesh
11:32 AM
Hi,it's taking me 40-50 min to index documents using auto-embedding,is this normal?
Kishore Nallan
Photo of md5-4e872368b2b2668460205b409e95c2ea
Kishore Nallan
11:34 AM
Yes, unfortunately embedding generation is a slow process given the models used. To speed things up, you have to either use an external embedding service (which probably uses a GPU under the hood) or run Typesense itself on GPU.
Somesh
Photo of md5-a9a351e11d64f05b41fec183816a0cda
Somesh
11:34 AM
My batch size is 320k and my import batch size is 20k