Managing Memory and Storage in Typesense
TLDR Joe inquired about storing recent data logs in RAM and the rest in storage. Jason confirmed it's possible but would need to be manually managed.
Apr 23, 2021 (34 months ago)
Indexed 3015 threads (79% resolved)
Using Typesense for In-house Log Search
Gokay asked if using Typesense for a log search project is feasible. Jason replied it may become expensive due to being in-memory and missing some features but it's possible in some contexts.
Typesense RAM Limitation and Memory-Mapped Files
TJ asked if Typesense would move to a model using memory-mapped files for datasets. Kishore Nallan said they have no concrete plans but appreciated the idea and would consider community feedback.
Troubleshooting Typesense Document Import Error
Christopher had trouble importing 2.1M documents into Typesense due to memory errors. Jason clarified the system requirements, explaining the correlation between RAM and dataset size, and ways to tackle the issue. They both also discussed database-like query options.