Hopefully a quick support Q:
Is there a way to ma...
# community-helpy
Yegor Ius
05/12/2025, 4:04 PMHopefully a quick support Q:
Is there a way to make sure a server running Typesense has “enough” memory? Considering typesense has this thing where it wants X% amount of memory on the server. If it doesn’t then it crashes. What is the X? We’ve running a server on EC2 for a couple of months and still can’t figure what is the indicating factor that lets us know “hey if you load any more collections, I’ll crash”
f
Fanis Tharropoulos
05/12/2025, 4:05 PMIt's basically 2x-3x your dataset in RAM: https://typesense.org/docs/guide/system-requirements.html#choosing-ram
👀 1
ó
Óscar Vicente
05/12/2025, 4:57 PMAdd swap to avoid the crash but add monitoring to upgrade as soon as the swap starts being used
➕ 1
🧠 2
y
Yegor Ius
05/12/2025, 5:02 PMThanks Fanis, sounds like we have some calculating to do on what we want to store in memory and a great suggestion Óscar
ó
Óscar Vicente
05/12/2025, 5:03 PMWe are doing it that way but in Azure
y
Yegor Ius
05/12/2025, 5:07 PMI guess the other part of my Q — is there anything in TS itself that would make it fall over? Not talking about the OS. Anything weird like TS is preemptively doing some check for free memory and if it sees some lower % number, it shuts itself down
ó
Óscar Vicente
05/12/2025, 5:08 PMWhen it compacts the database, it will use a lot of disk. Usually in TS cloud if I remember correctly, the disks are 4-5 times the amount of ram to handle compacting and snapshots.
Óscar Vicente
05/12/2025, 5:08 PMWe use 64gb machines and 256gb disks
Óscar Vicente
05/12/2025, 5:09 PMWe had some problems because this
Óscar Vicente
05/12/2025, 5:09 PMAll in all, if it starts TS it's pretty stable. Unless without enough memory ofc
j
Jason Bosco
05/12/2025, 8:36 PMThere are checks in Typesense the verify that there is enough RAM before let writes come in, but Typesense does not shutdown itself when these checks are triggered. We just return an API response saying out of memory.
What is most likely shutting down Typesense is the Operating System's OOM reaper because it wants to preserve the entire OS running out of RAM
y
Yegor Ius
05/13/2025, 2:06 PMOk awesome thanks for that temperature check Óscar and verifying TS behavior Jason!
Yegor Ius
05/13/2025, 2:06 PMWrt to disk, our disks are big enough so that would’t the issue. We have a 384GB RAM and 500GB of disk and I’ve never seen disk go above 200GB of usage.
We use that server for testing multiple collections. Each collection is huge, ~20GB. The issue happens when we keep loading collections and forget to delete old ones. I’ll keep monitoring but what I’m seeing is that TS crashes even when memory usage is well below 100%
Yegor Ius
05/13/2025, 2:06 PMBut having you confirm that TS isn’t shutting itself down in any way makes me doubt myself, Jason. I’ll keep an eye out and will report by findings here.
ó
Óscar Vicente
05/13/2025, 2:07 PMIt's recomended to have disks 5 times the size of the ram usage, it's rare to have issues, but we did in the past and this is what TS suggested
🙏 1
j
Jason Bosco
05/13/2025, 3:44 PMYou want to look at your syslog for a string called “oom” - that’s the definitive way to tell that it’s the OS OOM reaper stepping in to kill the typesense process because there isn’t enough RAM to hold all the data
🧠 1
🙌 1