Switching from External to Auto Embedding: Pros and Cons
TLDR Somesh inquires about switching to auto embedding from external ones. Kishore Nallan explains that auto embedding quickens query time but slows down documents’ encoding during indexing.
Oct 21, 2023 (1 month ago)
Kishore Nallan03:46 PM
Kishore Nallan03:47 PM
Indexed 3011 threads (79% resolved)
Speeding up Document Indexing with Auto-Embedding
Somesh queries the long document indexing time using auto-embedding. Kishore Nallan confirms it's normal and suggests using an external service or running Typesense on GPU.
Discussing Indexing and Embedding Performance in Typesense
Dima had queries about indexing with embedding in Typesense. Kishore Nallan and Jason provided solutions, including reducing documents sent in an API call and running embeddings on a GPU. They facilitated Dima with the latest RC.
Optimum Cluster for 1M Documents with OpenAI Embedding
Denny inquired about the ideal cluster configuration for handling 1M documents with openAI embedding. Jason recommended a specific configuration, explained record size calculation, and clarified embedding generation speed factors and the conditions that trigger openAI.