#community-help

Configuring Cluster for Auto Scaling and Traffic Handling

TLDR Juliusz asked how to configure their cluster for auto scaling. Kishore Nallan suggested emailing Typesense and provided information on scheduling upgrades and downgrades based on expected traffic.

Powered by Struct AI
19
5mo
Solved
Join the chat
May 11, 2023 (5 months ago)
Juliusz
Photo of md5-790ea4d701cf25986a03ff79d757e7cb
Juliusz
07:51 AM
Hi guys, could you please help me to configure my cluster to scale automatically?
Kishore Nallan
Photo of md5-4e872368b2b2668460205b409e95c2ea
Kishore Nallan
07:54 AM
How are you hosting Typesense?
Juliusz
Photo of md5-790ea4d701cf25986a03ff79d757e7cb
Juliusz
08:02 AM
On the cloud
Kishore Nallan
Photo of md5-4e872368b2b2668460205b409e95c2ea
Kishore Nallan
08:37 AM
Please email [email protected] with the cluster ID. We will take care of it.
Juliusz
Photo of md5-790ea4d701cf25986a03ff79d757e7cb
Juliusz
08:42 AM
Sure, do you think that you will manage to do it in let’s say 24 hours?
08:43
Juliusz
08:43 AM
It can be crucial to my business
Kishore Nallan
Photo of md5-4e872368b2b2668460205b409e95c2ea
Kishore Nallan
08:44 AM
The auto scaling in Typesense Cloud is not real-time elastic. We will be able to handle capacity upgrades when your cluster starts bumping into limits and we notice degradation. It's not instant so you can't rely on that for handling massive spikes like 0 to 10x baseline traffic, for example.
Juliusz
Photo of md5-790ea4d701cf25986a03ff79d757e7cb
Juliusz
08:44 AM
Okay I get it
08:45
Juliusz
08:45 AM
The thing is, that right now my app doesnt have many users and traffic
08:46
Juliusz
08:46 AM
But I am preparing a big marketing campaign for the festival, which takes place tomorrow evening
08:47
Juliusz
08:47 AM
And traffic can jump to several thousand users
Kishore Nallan
Photo of md5-4e872368b2b2668460205b409e95c2ea
Kishore Nallan
08:47 AM
Then you can schedule an upgrade of your cluster for expected traffic. And then take a call on downscaling it later on based on metrics after a few days.
08:47
Kishore Nallan
08:47 AM
There is an option to schedule an upgrade from the Cloud UI
08:47
Kishore Nallan
08:47 AM
We only handle automatic scaling up.
Juliusz
Photo of md5-790ea4d701cf25986a03ff79d757e7cb
Juliusz
08:48 AM
And could you advise which cluster could certainly cope with a traffic level of a few thousand people, who could make quite a few requests?
Kishore Nallan
Photo of md5-4e872368b2b2668460205b409e95c2ea
Kishore Nallan
08:48 AM
But you can always schedule upgrades/downgrades from the UI.

Happy to discuss specifics about your cluster if you can email us your cluster ID, and expected concurrency.
Juliusz
Photo of md5-790ea4d701cf25986a03ff79d757e7cb
Juliusz
08:49 AM
It is hard to predict to be honest
08:59
Juliusz
08:59 AM
Could you provide an example, which could estimate which cluster would handle specific traffic?
Kishore Nallan
Photo of md5-4e872368b2b2668460205b409e95c2ea
Kishore Nallan
09:04 AM
Can't say without looking at the size and schema of your data. If you wish, you can benchmark your cluster to get an idea.