Improving Write Performance in Database Clusters
TLDR Todd sought suggestions to enhance write performance and reduce CPU throttling. Jason recommended facilitating multiple writes into fewer API calls and described the impacts of various fields on indexing time. Todd saw significant improvements following this advice.
Oct 19, 2023 (1 month ago)
Oct 25, 2023 (1 month ago)
Indexed 3011 threads (79% resolved)
Implementing Semantic Search with Typesense
Erik sought advice for semantic search implementation in Typesense and raised issues around slow document import and excessive latency. Upon implementing advice from Kishore Nallan to try different models, Erik reported faster times, ultimately deciding to rate-limit imports.
Clarification on Faceting and Grouping in Typesense
Carlo asked about faceting and grouping in Typesense. Kishore Nallan clarified their operation, suggesting they account for grouping while calculating on the whole set.
Issue with Query Expectations on Typesense Search
Sean was having an issue with their search query on Typesense. Kishore Nallan suggested adjusting the 'drop_tokens_threshold' parameter. After making the adjustment, Sean found an issue with the order of the results, which was resolved by updating Typesense version.
Updating Bulk Records and Resolving Typsense Issues.
Greg inquired about updating bulk records. Jason proposed using the documents/import endpoint for bulk updating, identified issues with Typesense, and provided solutions. Greg appreciated the assistance. Conversation related to the procedure was shared with Viktor.
Bulk Execution of 'Update by Query' in Typesense
Jacob inquired about executing `update by query` in bulk for specific conditions. Kishore Nallan provided information and Jason advised dealing with conditional updates in the primary datastore before syncing with Typesense.