Issues with Adding 7mb json File on Typesense .23
TLDR Jesse experienced timeouts when trying to add a jumbo JSON file, despite sufficient nginx upload size. Jason advised extending the client-side timeout on Typesense. Later, Jesse found their developer has set connection timeout to 2 seconds.
3
1
1
Jun 06, 2022 (19 months ago)
Jesse
07:10 PMJason
07:11 PMJesse
07:12 PMJason
07:13 PM1
Jesse
07:24 PM2
1
Jesse
07:56 PM1
Typesense
Indexed 3015 threads (79% resolved)
Similar Threads
Troubleshooting Write Timeouts in Typesense with Large CSVs
Agustin had issues with Typesense getting write timeouts while loading large CSV files. Kishore Nallan suggested chunking data or converting to JSONL before loading. Through troubleshooting, they identified a possible network problem at AWS and found a workaround.
Bulk Import 50MB JSON Files Error - Timeout and Solutions
madhweep encounters an error while bulk importing JSON files. Kishore Nallan provided help, but the issue persists. Jason intervenes and after troubleshooting, they concluded the cluster had run out of memory causing the issue. The problem was resolved by using a cluster with sufficient memory. Daniel also experienced a similar issue, resolved by increasing the timeout.
Discussion on Document Inserting Speed and Process
David inquired about document insertion speed, and Jason provided reference values and recommended sending more documents per API call. Both David and Chetan acknowledged the suggestions, with David stating to report back on their experience.