Efficiently Indexing Large Number of Documents in Typesense
TLDR Henrique asked for an efficient way to index 30 million documents using typesense. Kishore Nallan suggested checking the import end-point response for success or error messages.
Mar 19, 2023 (6 months ago)
Henrique
11:45 AMKishore Nallan
12:51 PMYou can check the response of the import end-point. Each line should have
{"success": true}
or false + error message in case of any failures.Typesense
Indexed 2764 threads (79% resolved)
Similar Threads
Using Typesense to Index Large Amounts of Data
Rafael wants to use Typesense to index 100M documents currently in MongoDBAtlas. Jason affirmed Typesense can handle it and asked for more details.
Issues with Typesense Import API Document Indexing
Morgan experienced inconsistent document indexing using the Typesense Import API. Jason clarified that Typesense returns a success: true or false for each record in the batch import call.
Troubleshooting Typesense Document Import Error
Christopher had trouble importing 2.1M documents into Typesense due to memory errors. Jason clarified the system requirements, explaining the correlation between RAM and dataset size, and ways to tackle the issue. They both also discussed database-like query options.

