<@U01PL2YSG8L> i am using 2GB RAM , 2 CPU typesens...
# community-help
m
@Kishore Nallan i am using 2GB RAM , 2 CPU typesense cluster in my 10 collection i have around 800 MB of data. But i got 'OUT_OF_MEMORY' error and also get get slow many times specially on load. can you please explain then root cause and guide to speed the process ? hint- evenn 4GB cluster not handle , works on 8GB cluster ? (manually upgrade before pre defined load time). Does have any api to upgrade cluster ?
f
Hey @Md.Riad Hasan Sarker , I took a look at your cluster's metrics, and you were hovering around the 2GB RAM mark a couple of hours ago. Typesense typically needs 2x-3x your dataset size in order to function properly. 2GB and especially 4GB should have been enough to serve your 800MB dataset. However, there's extra RAM usage when adding Vector Search into the mix. Are you using any embedding models for semantic search? Another thing that I came across is that you're exclusively using the single writes endpoint for indexing documents, more than 50 times per second in some cases, which is going to lead to CPU usage spiking. In cases like these, using a buffer table and using the batch import API to flush that table in a 1-5 second interval will massively help with CPU usage. More info on indexing here: https://typesense.org/docs/30.1/api/documents.html#index-documents