Discussion on Bulk Deletion Methods on Typesense
TLDR Gabe asked about bulk deleting on Typesense. Kishore Nallan advised using OR notation, mentioning a 4K char limit on GET parameters. They urged Gabe to open a Github issue to track ID field support.
1
1Sep 07, 2021 (24 months ago)
Gabe
04:07 PMIt looks like I can delete by query, but if I remember correctly, typesense doesn't support OR queries, so there is no way to issue a request like this ("pseudocode"):
DELETE id:1 OR id:2 OR id:3is that correct? is there some other way to achieve a bulk delete?
Kishore Nallan
04:08 PMfield:>= 0 which will cover all records and delete them.Gabe
04:08 PMGabe
04:09 PMKishore Nallan
04:09 PM[0, 1, 2] is the OR notationKishore Nallan
04:10 PMid to be targeted that way but it will certainly work if you have another ID-like field.Gabe
04:10 PMfilter_by=id:[1,2,3]?Kishore Nallan
04:10 PMGabe
04:11 PMidGabe
04:11 PMKishore Nallan
04:14 PMKishore Nallan
04:14 PMKishore Nallan
04:14 PMGabe
04:17 PM11Gabe
04:17 PMGabe
04:17 PMGabe
04:18 PMKishore Nallan
04:19 PMKishore Nallan
04:20 PMGabe
04:21 PM
Typesense
Indexed 2764 threads (79% resolved)
Similar Threads
Issue with Typesense Schema and Ruby Client
Mateo faces issues while creating a schema and using Ruby client for Typesense. Jason suggests using a new field instead of 'id' and provides assistance for Ruby client errors.
Slow Document Deletion in Typesense Database
Robert inquired about speeding up deletes in Typesense. Robert agreed to file a detailed bug report following the discussion with Kishore Nallan who is investigating a possible bug causing the delay in document deletion.
2Troubleshooting Typesense Document Import Error
Christopher had trouble importing 2.1M documents into Typesense due to memory errors. Jason clarified the system requirements, explaining the correlation between RAM and dataset size, and ways to tackle the issue. They both also discussed database-like query options.
3Handling Kinesis Stream Event Batching with Typesense
Dui had questions about how to handle Kinesis stream events with Typesense. Kishore Nallan suggested using upsert mode for creation/update and differentiating with logical deletion. After various discussions including identifying and resolving a bug, they finalized to introduce an `emplace` action in Typesense v0.23.
8Issue with Search Duration on Typesense Database
Robert reported an issue about query time delay when adding a `filter_by` constraint in a large Typesense database. Kishore Nallan explained that this happens due to the order of operation and also promised to look into this issue further. Robert withdrew his interest in sponsoring the improvement due to moving from the project.