Join Slack
Powered by
hey! when trying to import a 26gb jsonl file using...
# community-help
a
Anthony Bachour
04/23/2025, 5:17 PM
hey! when trying to import a 26gb jsonl file using golang package I'm getting the follow error: Post "
http://localhost:8108/collections/xxx/documents/import?action=create&batch_size=500000
": write tcp 127.0.0.1
51816 >127.0.0.1
8108: write: broken pipe <nil> Any ideas?
j
Jason Bosco
04/24/2025, 12:00 AM
Could you remove the batch_size=500000 parameter and see if it still happens?
a
Anthony Bachour
04/24/2025, 3:14 AM
I did more digging and it seems like typesense limits the post size to 10gb is it true?
@Jason Bosco
k
Kishore Nallan
04/24/2025, 3:34 AM
Yes we limit to 10 GB.
a
Anthony Bachour
04/24/2025, 1:02 PM
ok I think that should be mentioned in the docs!
f
Fanis Tharropoulos
04/24/2025, 1:30 PM
https://github.com/typesense/typesense-website/pull/333
✅ 1
🙌 1
Open in Slack
Previous
Next