Issues and Improvements in Typesense with 14 Million Records
TLDR Miguel experienced performance issues when using Typesense for large datasets. Jason suggested performance improvements made to Typesense since then and directed them to specific server-side parameters for better handling. Miguel agreed to try again.
1
1
Jun 07, 2022 (17 months ago)
Miguel
10:00 PM
Jason
10:01 PMMiguel
10:02 PMMiguel
10:02 PMMiguel
10:03 PMMiguel
10:04 PMMiguel
10:04 PMJason
10:05 PMJason
10:06 PMJason
10:06 PMMiguel
10:07 PMJason
10:08 PMq=*) by any chance?Miguel
10:08 PMMiguel
10:08 PMMiguel
10:08 PM1
Miguel
10:09 PMJason
10:09 PMJason
10:10 PMMiguel
10:11 PMMiguel
10:12 PM1
Jason
10:12 PMsearch_cutoff_ms, use_cache and cache_ttl documented in the tables here: https://typesense.org/docs/0.23.0/api/documents.html#search-parameters
Typesense
Indexed 2779 threads (79% resolved)
Similar Threads
Discussing Typesense Search Request Performance
Al experienced longer-than-reported times for Typesense search requests, sparking a detailed examination of json parsing, response times and data transfer. Jason and Kishore Nallan helped solve the issue.
Fetching All Docs from a Collection in Typesense
Julian asked if all docs could be fetched from a Typesense collection, and Kishore Nallan explained there's a 250 result limit due to performance considerations. Andrew suggested using the export function, explaining their operations and performance.
Troubleshooting Typesense Document Import Error
Christopher had trouble importing 2.1M documents into Typesense due to memory errors. Jason clarified the system requirements, explaining the correlation between RAM and dataset size, and ways to tackle the issue. They both also discussed database-like query options.
Typesense Performance with Large Datasets & Custom Sort
krok inquires about Typesense's performance on large datasets and custom sorting. Kishore Nallan explains that Typesense is optimized for this scenario using pagination and text relevance.
Improving Typesense Query Performance
Jonathan queried about slower than expected typesense query performance. Jason and Kishore Nallan offered solutions and explanations. After a series of tests, Jonathan found other queries returned results quickly, indicating the issue was specific to the original query.