Multi-threading and Parallel Processing in Typesense
TLDR Sidharth asked about multi-threading in Typesense. Kishore Nallan explained that queries are already run on multiple threads, but multi-search queries run sequentially. Some parts of query processing are multi-threaded, but not all.
2
Jun 19, 2023 (3 months ago)
Sidharth
08:46 AMIs there a feature for multi-threading in-order to improve the Typesense performance?
Also, how parallel processing will work in the case of multi-search query?
Kishore Nallan
08:48 AMKishore Nallan
08:49 AMSidharth
08:52 AMKishore Nallan
08:53 AMSidharth
08:54 AM1
谢渊
09:12 AMKishore Nallan
09:39 AM谢渊
09:58 AM1
Typesense
Indexed 2776 threads (79% resolved)
Similar Threads
Multiple Filters and JSON Requests in Typesense
Manish asked about multiple filter_by arguments, JSON input, and using multisearch. Jason offered typesense documentation links, examples, and how to use JSON formatted requests with multisearch. Ed shared a similar use case.
Understanding Indexing and Search-As-You-Type In Typesense
Steven had queries about indexing and search-as-you-type in Typesense. Jason clarified that bulk updates are faster and search-as-you-type is resource intensive but worth it. The discussion also included querying benchmarks and Typesense's drop_tokens_threshold parameter, with participation from bnfd.
Discussing Typesense Search Request Performance
Al experienced longer-than-reported times for Typesense search requests, sparking a detailed examination of json parsing, response times and data transfer. Jason and Kishore Nallan helped solve the issue.
Improving Record Retrieval Speed from Typesense
Yoshi sought ways to accelerate Typesense record retrieval. Jason advised upgrading to high availability and using the documents/export endpoint. They also noted a high volume of writes consuming significant CPU capacity as a possible performance factor.
Improving Typesense Query Performance
Jonathan queried about slower than expected typesense query performance. Jason and Kishore Nallan offered solutions and explanations. After a series of tests, Jonathan found other queries returned results quickly, indicating the issue was specific to the original query.