#community-help

Updating Connection Timeout for Bulk Insertion

TLDR Vishal experienced timeouts during a bulk insert of 1800 docs. Jason suggested increasing the connection timeout to 15 minutes for imports.

4mo

Join the chat

Jun 09, 2023 (4 months ago)

Photo of md5-178450ab9171fe1c7eba3a5eb7e1a312

Vishal

06:17 PM

when trying to bulk insert docs, should the connection timeout be updated? (trying to insert 1800 docs from a pandas df and it keeps timing out)

Photo of md5-8813087cccc512313602b6d9f9ece19f

Jason

06:32 PM

Yeah, the default timeout is set low to account for searches. You want to increase it to as high as say 15 minutes for imports: https://github.com/typesense/typesense-python/blob/765c99668bd9832a9dd523405bc54444b980c475/examples/collection_operations.py#L18

Typesense

Lightning-fast, open source search engine for everyone | Knowledge Base powered by Struct.AI

Indexed 2779 threads (79% resolved)

Join Our Community Manage subscription

Similar Threads

Resolving Timeout Issues in Bulk Document Imports

Aljosa encountered timeouts when importing 32k documents. Kishore Nallan advised increasing client side timeout. Bruno suggested import in chunks and a retry for individual chunks. Kishore Nallan mentioned the next release of Typesense will make imports more reliable.

26mo

Bulk Import 50MB JSON Files Error - Timeout and Solutions

madhweep encounters an error while bulk importing JSON files. Kishore Nallan provided help, but the issue persists. Jason intervenes and after troubleshooting, they concluded the cluster had run out of memory causing the issue. The problem was resolved by using a cluster with sufficient memory. Daniel also experienced a similar issue, resolved by increasing the timeout.

24mo

Resolving Timeout Errors in Large Document Imports

Ken had issues with importing over 360k documents due to operation timeout. Jason advised increasing the timeout in the client library.