Typesense Pagination and Expensive Querying Concerns
TLDR Michal inquired about cursor pagination and caching in Typesense. Kishore Nallan provided reasons for their absence and discussed improvements for range filter performance in the next release.
Feb 08, 2023 (8 months ago)
Michal
11:17 AMKishore Nallan
11:20 AMMichal
01:08 PMKishore Nallan
01:13 PMMichal
01:26 PMKishore Nallan
01:28 PMMichal
01:31 PMKishore Nallan
01:33 PMMichal
01:35 PMMichal
01:39 PMKishore Nallan
01:57 PMKishore Nallan
01:59 PMMichal
02:06 PMMichal
02:10 PMKishore Nallan
02:11 PMMichal
02:30 PMKishore Nallan
02:31 PMMichal
02:36 PMTypesense
Indexed 2776 threads (79% resolved)
Similar Threads
Understanding Indexing and Search-As-You-Type In Typesense
Steven had queries about indexing and search-as-you-type in Typesense. Jason clarified that bulk updates are faster and search-as-you-type is resource intensive but worth it. The discussion also included querying benchmarks and Typesense's drop_tokens_threshold parameter, with participation from bnfd.
Issues and Improvements in Typesense with 14 Million Records
Miguel experienced performance issues when using Typesense for large datasets. Jason suggested performance improvements made to Typesense since then and directed them to specific server-side parameters for better handling. Miguel agreed to try again.
Typesense Pagination and Caching Concerns
Michal expressed concerns about Typesense costs and pagination for an infinite scroll app. Kishore Nallan suggested fetching 250 results upfront and mentioned Typesense doesn't cache per page result sets.
Discussing Document Indexing Speeds and Typesense Features
Thomas asks about the speed of indexing and associated factors. The conversation reveals that larger batch sizes and NVMe disk usage can improve speed, but the index size is limited by RAM. Jason shares plans on supporting nested fields, and they explore a solution for products in multiple categories and catalogs.
Optimizing Bulk Indexing and Reducing RAM Usage in Typesense
Timon experienced issues with Typesense becoming unresponsive during bulk indexing and sought advice. Jason recommended larger import requests and adjusting the client-side timeout allowance, revealing a need to increase RAM allocation for Docker. Kishore Nallan undertook to find ways to optimize memory usage, particularly for geopoint indexing.