Resolving Document Export & Batch Deletion Issues
TLDR Dui had trouble exporting a document and wanted batch deletion assistance. Kishore Nallan fixed the export issue, upgraded their cluster manually and suggested using delete by query
.


Jan 20, 2022 (20 months ago)
Kishore Nallan
09:10 AMDui
09:10 AMDui
09:11 AMKishore Nallan
09:11 AMDui
09:12 AMKishore Nallan
09:18 AMKishore Nallan
09:18 AMemplace
action. That's on a RC build.Dui
09:20 AMKishore Nallan
09:20 AMKishore Nallan
09:28 AMKishore Nallan
09:29 AMKishore Nallan
09:30 AM/debug
end-point to confirm that version: it will be 0.23.rc20Dui
09:32 AM
Dui
09:40 AMDui
09:40 AMKishore Nallan
09:41 AMdelete by query
: https://typesense.org/docs/0.22.1/api/documents.html#delete-by-querySend a filter_by that contains a condition that can match all records.
Kishore Nallan
09:41 AM*
(delete all) operation.Kishore Nallan
09:43 AMDui
10:13 AMIn our case, we might have a thousand events coming in from our kinesis stream, where 500 might be emplace, and 500 delete. I will then group them by their different actions and perform them by batch.
What would be the best way of doing something like that for delete, you think?
Kishore Nallan
10:14 AMfilter_by=id: [id1, id2, id3]
Dui
10:15 AMKishore Nallan
10:15 AM
Typesense
Indexed 2764 threads (79% resolved)
Similar Threads
Handling Kinesis Stream Event Batching with Typesense
Dui had questions about how to handle Kinesis stream events with Typesense. Kishore Nallan suggested using upsert mode for creation/update and differentiating with logical deletion. After various discussions including identifying and resolving a bug, they finalized to introduce an `emplace` action in Typesense v0.23.


Typesense Cloud Issue: Unable to Delete Documents by ID
Ellen had trouble using Typesense Cloud's `filter_by` option to delete documents by id. Jason solved this by suggesting to remove double-quotes around IDs in `filter_by` clause.


Fixing Multiple Document Retrieval in Typesense
Phil needed an efficient way to retrieve multiple documents by id. Kishore Nallan proposed a solution available in a pre-release build. After some bug fixing regarding id matching by Jason and Kishore Nallan, Phil successfully tested the solution.



User-Specific Tagging and Filtering in UI
bnfd asked for the best way to create user-specific tags available on the UI. Jason suggested using personalized filters and creating a separate collection for each user's movies. The duo clarified the use of 'tags' in schemas and the refinementList widget in instantsearch. They also discussed various approaches to import and search large document collections.

Understanding Document ID Fields and Rectifying Duplicate Document Error
John queried about understanding document ID fields and fixed a duplication issue with guidance from Jason. They discovered a bug preventing document deletion due to a URL encodable character, with John opening a GitHub issue for it.

