Offloading Idle Keys to Disk for Efficient Memory Usage in Typesense
TLDR Thomas proposed offloading idle keys to disk in data-rich typesense systems. Although Kishore Nallan explains that this conflicts with their in-memory design philosophy, Thomas suggests deleting idle collections from RAM and re-indexing when requested, and shares that they have implemented a similar serverless solution at their company.
2
Mar 09, 2022 (20 months ago)
Thomas
08:35 AMKishore Nallan
09:30 AMThomas
09:33 AMKishore Nallan
09:35 AM1
Thomas
09:41 AMKishore Nallan
09:44 AMThomas
10:45 AMThomas
10:45 AMThomas
10:46 AMThomas
10:46 AMKishore Nallan
11:04 AMThomas
11:20 AMThomas
11:21 AMThomas
11:25 AMKishore Nallan
11:26 AMRobert
11:59 AMThomas
01:42 PMThomas
01:42 PMThomas
01:43 PMThomas
01:43 PMThomas
01:44 PMAljosa
11:45 PMFor us it's as simple as deleting the collection and recreating it from the database if it gets requested again, with a small delay until it's ready. The source of truth is already external so it makes sense for us to handle it
1
Mar 10, 2022 (20 months ago)
Thomas
07:17 AMThomas
07:21 AMbnfd
08:25 AMMar 11, 2022 (20 months ago)
bnfd
12:26 AMThomas
07:01 AMTypesense
Indexed 2786 threads (79% resolved)
Similar Threads
Troubleshooting Typesense Document Import Error
Christopher had trouble importing 2.1M documents into Typesense due to memory errors. Jason clarified the system requirements, explaining the correlation between RAM and dataset size, and ways to tackle the issue. They both also discussed database-like query options.
Discussing Typesense Cloud's SSDs, NVMe, and Resources Needed
A asked about Typesense's storage type and configuration possibilities. Jason shared that they use SSDs and suggested NVMe SSDs for high-availability instances. They discussed server resources needed for specific user cases and briefly touched on DDoS protection via Cloudflare.
Understanding Indexing and Search-As-You-Type In Typesense
Steven had queries about indexing and search-as-you-type in Typesense. Jason clarified that bulk updates are faster and search-as-you-type is resource intensive but worth it. The discussion also included querying benchmarks and Typesense's drop_tokens_threshold parameter, with participation from bnfd.
Optimizing Bulk Indexing and Reducing RAM Usage in Typesense
Timon experienced issues with Typesense becoming unresponsive during bulk indexing and sought advice. Jason recommended larger import requests and adjusting the client-side timeout allowance, revealing a need to increase RAM allocation for Docker. Kishore Nallan undertook to find ways to optimize memory usage, particularly for geopoint indexing.
Optimizing Typesense Implementation for Large Collections
Oskar faced performance issues with his document collection in Typesense due to filter additions. Jason suggested trying a newer Typesense build and potentially partitioning the data into country-wise collections. They also discussed reducing network latency with CDN solutions.