Processing Bulk 'Contacts' in Typesense
TLDR Alan asks for advice on bulk uploading 'contacts'. Kishore Nallan recommends batching, warns against high batch sizes, and agrees to a meeting.
Oct 03, 2022 (15 months ago)
Alan
01:43 PMKishore Nallan
01:45 PMAlan
01:46 PMKishore Nallan
01:48 PMAlan
01:50 PMKishore Nallan
02:03 PMAlan
02:06 PMKishore Nallan
02:06 PMTypesense
Indexed 3015 threads (79% resolved)
Similar Threads
Troubleshooting Typesense Document Import Error
Christopher had trouble importing 2.1M documents into Typesense due to memory errors. Jason clarified the system requirements, explaining the correlation between RAM and dataset size, and ways to tackle the issue. They both also discussed database-like query options.
Typesense Server Import Batching Issues
Alex had issues with import batching in production Typesense server, with failed syncs for batch sizes over 100. Kishore Nallan suggested an upgrade to version 0.22.1 and offered to check logs.
Improving Record Retrieval Speed from Typesense
Yoshi sought ways to accelerate Typesense record retrieval. Jason advised upgrading to high availability and using the documents/export endpoint. They also noted a high volume of writes consuming significant CPU capacity as a possible performance factor.
Troubleshooting Indexing Duration in Typesense Import
Alan asked about lengthy indexing times for importing documents to Typesense. Jason suggested various potential causes, including network connectivity and system resources. They later identified the problem to be an error in Alan's code.
Optimizing Typesense Implementation for Large Collections
Oskar faced performance issues with his document collection in Typesense due to filter additions. Jason suggested trying a newer Typesense build and potentially partitioning the data into country-wise collections. They also discussed reducing network latency with CDN solutions.