Recommendations for Batch Size in /import Endpoint
TLDR Dima asked for recommendations on batch size for the /import endpoint. Kishore Nallan suggested a few thousand documents per batch, unless documents are very large.
1
1
Mar 02, 2023 (7 months ago)
Dima
09:40 AM
Kishore Nallan
09:47 AM1
1
Typesense
Indexed 2779 threads (79% resolved)
Similar Threads
Optimal batch_size for Importing Million Document Dataset
Ahmad asked the best `batch_size` for inserting million data. Jason advised staying at default and using 5000 document batches through API calls.
Implementing Typesense Updates with JSONL Import and Aliases
Ken is building a search solution for a website using Typesense. They consulted Kishore Nallan about the implementation of updates using JSONL import and aliases and how to know when the new collection is indexed and ready. Measures, such as dividing large imports into small batches, were suggested to address the issue.
Resolving Timeout Errors in Large Document Imports
Ken had issues with importing over 360k documents due to operation timeout. Jason advised increasing the timeout in the client library.