Discussion on Typesense API's Batch Document Upload

TLDR J questioned Typesense API not accepting JSON batch uploads. Kishore Nallan explained it supports large imports, with client-side conversions. Ross confirmed this.

Powered by Struct AI
Join the chat
Jan 01, 2023 (9 months ago)
Photo of md5-e1f6ac708fe5bcd39dd88ab5988b3367
12:26 PM
Why does Typesense API for the batch document upload not take in a valid JSON Documents ie, a list of documents? This just made what should be a trivial call, not.
Kishore Nallan
Photo of md5-4e872368b2b2668460205b409e95c2ea
Kishore Nallan
12:33 PM
The API is designed to support importing large number of documents. Accepting a JSON list will make this difficult to do as a lazy/streaming indexing operation.
Kishore Nallan
12:34 PM
Some of the API clients support this conversion on the client side.
Photo of md5-32a53885bf64e05ae6dd2df37684eedf
02:14 PM
Was going to say, we use the TS wrapper and bulk import millions of documents. The wrapper converts an array of objects to JSONL automatically