Speeding up Document Indexing with Auto-Embedding
TLDR Somesh queries the long document indexing time using auto-embedding. Kishore Nallan confirms it's normal and suggests using an external service or running Typesense on GPU.
Nov 14, 2023 (2 weeks ago)
Somesh
11:32 AMKishore Nallan
11:34 AMSomesh
11:34 AMTypesense
Indexed 3015 threads (79% resolved)
Similar Threads
Switching from External to Auto Embedding: Pros and Cons
Somesh inquires about switching to auto embedding from external ones. Kishore Nallan explains that auto embedding quickens query time but slows down documents’ encoding during indexing.
Optimum Cluster for 1M Documents with OpenAI Embedding
Denny inquired about the ideal cluster configuration for handling 1M documents with openAI embedding. Jason recommended a specific configuration, explained record size calculation, and clarified embedding generation speed factors and the conditions that trigger openAI.
Discussing Indexing and Embedding Performance in Typesense
Dima had queries about indexing with embedding in Typesense. Kishore Nallan and Jason provided solutions, including reducing documents sent in an API call and running embeddings on a GPU. They facilitated Dima with the latest RC.