Hello! I'm testing typesense and I wanted to know if you guys know of an efficient way to index a large amount of documents (30 million) quickly. I'm currently using sidekiq to index documents, I'm having a throughput of 10k documents per second, but I don't know if typesense is indexing correctly or ignoring a large part of the data

but I don't know if typesense is indexing correctly or ignoring a large part of the data

You can check the response of the import end-point. Each line should have

{"success": true}

or false + error message in case of any failures.