Troubleshooting Document Import Issue with Typesense on Docker
TLDR Harrison experienced an issue with Typesense getting stuck when importing JSONL documents. Harrison offered to provide a copy of the docker volume to aid troubleshooting, but failed to retrieve it. Kishore Nallan recommended observing the local sequence number in the logs.
May 29, 2022 (19 months ago)
Harrison
04:01 PMBut essentially uploading a set of JSONL documents, where on is invalid using:
/collections/stackoverflow/documents/import?dirty_values=coerce_or_drop and then doing an abrupt stop in docker, causes typesense to just get stuck trying to recover and it cant?
Kishore Nallan
04:04 PMKishore Nallan
04:05 PMHarrison
04:05 PMHarrison
04:05 PMKishore Nallan
04:06 PMHarrison
04:06 PMHarrison
04:06 PMHarrison
04:07 PMHarrison
04:07 PMKishore Nallan
04:07 PMKishore Nallan
04:08 PMHarrison
04:15 PMKishore Nallan
04:16 PMHarrison
04:17 PMJun 15, 2022 (19 months ago)
Harrison
07:04 PM
Typesense
Indexed 3015 threads (79% resolved)
Similar Threads
Using Typesense in Docker Container – Importing JSONL File
Hakim faced 'Empty reply from server' error when importing a JSONL file into a Typesense-Docker container. Kishore Nallan and Jason suggested checking the docker logs and increasing default RAM and CPU allocation. Finally, Hakim successfully indexed the documents using a PHP script.
Fixing Errors on Typesense Cluster
Tugay is having issues with their Typesense cluster, and Jason is trying to diagnose the problem. They have ruled out issues with the data dir and are currently considering whether the errors could be due to high concurrent writes or running bulk migrations. They plan to test with 0.24.0.rcn56 Typesense version.
Troubleshooting Typesense Document Import Error
Christopher had trouble importing 2.1M documents into Typesense due to memory errors. Jason clarified the system requirements, explaining the correlation between RAM and dataset size, and ways to tackle the issue. They both also discussed database-like query options.
Improving Query Results and Docker Issue with Typesense
Draisy struggled with retrieving query results and a docker command not working with a newer version of typesense. Jason suggested getting Typesense logs and upgrading cluster, but problems persist.
Troubleshooting Write Timeouts in Typesense with Large CSVs
Agustin had issues with Typesense getting write timeouts while loading large CSV files. Kishore Nallan suggested chunking data or converting to JSONL before loading. Through troubleshooting, they identified a possible network problem at AWS and found a workaround.