Deletion Anomaly in Bulk Import Operations.
TLDR Mubashirullah found documents not returning post-deletion and re-run of a bulk import. Kishore Nallan suggested checking the operations and trying on a smaller dataset. The problem didn't recur for Mubashirullah.
1
1
Dec 22, 2021 (25 months ago)
Mubashirullah
09:06 AM
Kishore Nallan
09:10 AMHappy to investigate if you can reproduce it consistently on a small dataset which I can also run to see the problem.
1
Mubashirullah
09:18 AMKishore Nallan
09:19 AMMubashirullah
09:20 AMKishore Nallan
09:20 AMMubashirullah
09:28 AMKishore Nallan
09:28 AMMubashirullah
09:32 AMKishore Nallan
09:32 AMMubashirullah
09:45 AMMubashirullah
09:52 AM1
Typesense
Indexed 3011 threads (79% resolved)
Similar Threads
Trouble with Typesense Memory Usage when Restarting Docker Container
Blend reports increased memory usage when restarting Docker with Typesense, information shared with Jason and Kishore Nallan. Potential data edge case identified as potential cause, although resolution undetermined.
Slow Document Deletion in Typesense Database
Robert inquired about speeding up deletes in Typesense. Robert agreed to file a detailed bug report following the discussion with Kishore Nallan who is investigating a possible bug causing the delay in document deletion.
Discussion on Bulk Deletion Methods on Typesense
Gabe asked about bulk deleting on Typesense. Kishore Nallan advised using OR notation, mentioning a 4K char limit on GET parameters. They urged Gabe to open a Github issue to track ID field support.
2
Slow, High CPU Write Operations After Collection Drop in Typesense
Himank discussed an issue in Typesense where deleting and recreating a collection led to slow write operations and high CPU usage. Kishore Nallan suggested using an alias to avoid this issue. Numerous tests and debugging was conducted as pboros contributed with local testing. Kishore Nallan aimed to start implementing a range delete and full db compaction after deletion to potentially solve the issue.
Bulk Deletion of Documents by Document IDs
Ivy asked how to bulk delete documents by document ids. Jason suggested using 'delete by query' with a filter.