#community-help

Managing Memory and Storage in Typesense

TLDR Joe inquired about storing recent data logs in RAM and the rest in storage. Jason confirmed it's possible but would need to be manually managed.

34mo

Join the chat

Apr 23, 2021 (34 months ago)

Photo of md5-d9ca032e3941589aafa8433269974f96

Joe

05:33 AM

Can it be both? recent logs in mem, then shelved off to storage

Photo of md5-8813087cccc512313602b6d9f9ece19f

Jason

05:35 AM

Yeah, you could do that! You’d have to manage that data shuffling yourself though, Typesense is optimized only for RAM-based search

Typesense

Lightning-fast, open source search engine for everyone | Knowledge Base powered by Struct.AI

Indexed 3015 threads (79% resolved)

Join Our Community

Similar Threads

Using Typesense for In-house Log Search

Gokay asked if using Typesense for a log search project is feasible. Jason replied it may become expensive due to being in-memory and missing some features but it's possible in some contexts.

14mo

Typesense RAM Limitation and Memory-Mapped Files

TJ asked if Typesense would move to a model using memory-mapped files for datasets. Kishore Nallan said they have no concrete plans but appreciated the idea and would consider community feedback.

9mo

Troubleshooting Typesense Document Import Error

Christopher had trouble importing 2.1M documents into Typesense due to memory errors. Jason clarified the system requirements, explaining the correlation between RAM and dataset size, and ways to tackle the issue. They both also discussed database-like query options.

11mo