#community-help

Issues with Adding 7mb json File on Typesense .23

TLDR Jesse experienced timeouts when trying to add a jumbo JSON file, despite sufficient nginx upload size. Jason advised extending the client-side timeout on Typesense. Later, Jesse found their developer has set connection timeout to 2 seconds.

19mo

Join the chat

Jun 06, 2022 (19 months ago)

Photo of md5-8ac455f6d302407f03def4c775778b28

Jesse

07:10 PM

On the newly released .23, I’m trying to add a 7mb json file, but it’s timing out on me. Our max upload size in nginx is set to something absurd (32 or 64mb). Any other ideas of where to begin poking around?

Photo of md5-8813087cccc512313602b6d9f9ece19f

Jason

07:11 PM

Are you using one of our client libraries?

Jesse

07:12 PM

Yes, the python library.

Jason

07:13 PM

Then it's most likely the client-side timeout kicking in. Imports are synchronous in Typesense, so you want to increase the timeout to say 5 minutes or more on the client instance you're using to do the import.

Jesse

07:24 PM

Will play around, many thanks. PS: Me and my team’s loving TS so far.

07:56

Jesse

07:56 PM

After careful code review I realized my developer had ‘connection_timeout_seconds’: 2.

Typesense

Lightning-fast, open source search engine for everyone | Knowledge Base powered by Struct.AI

Indexed 3015 threads (79% resolved)

Join Our Community

Similar Threads

Troubleshooting Write Timeouts in Typesense with Large CSVs

Agustin had issues with Typesense getting write timeouts while loading large CSV files. Kishore Nallan suggested chunking data or converting to JSONL before loading. Through troubleshooting, they identified a possible network problem at AWS and found a workaround.

32mo

Bulk Import 50MB JSON Files Error - Timeout and Solutions

madhweep encounters an error while bulk importing JSON files. Kishore Nallan provided help, but the issue persists. Jason intervenes and after troubleshooting, they concluded the cluster had run out of memory causing the issue. The problem was resolved by using a cluster with sufficient memory. Daniel also experienced a similar issue, resolved by increasing the timeout.

26mo

Discussion on Document Inserting Speed and Process

David inquired about document insertion speed, and Jason provided reference values and recommended sending more documents per API call. Both David and Chetan acknowledged the suggestions, with David stating to report back on their experience.

5mo