Configuring Cluster for Auto Scaling and Traffic Handling

TLDR Juliusz asked how to configure their cluster for auto scaling. Kishore Nallan suggested emailing Typesense and provided information on scheduling upgrades and downgrades based on expected traffic.

Photo of Juliusz
Juliusz
Thu, 11 May 2023 07:51:00 UTC

Hi guys, could you please help me to configure my cluster to scale automatically?

Photo of Kishore Nallan
Kishore Nallan
Thu, 11 May 2023 07:54:21 UTC

How are you hosting Typesense?

Photo of Juliusz
Juliusz
Thu, 11 May 2023 08:02:32 UTC

On the cloud

Photo of Kishore Nallan
Kishore Nallan
Thu, 11 May 2023 08:37:03 UTC

Please email with the cluster ID. We will take care of it.

Photo of Juliusz
Juliusz
Thu, 11 May 2023 08:42:42 UTC

Sure, do you think that you will manage to do it in let’s say 24 hours?

Photo of Juliusz
Juliusz
Thu, 11 May 2023 08:43:01 UTC

It can be crucial to my business

Photo of Kishore Nallan
Kishore Nallan
Thu, 11 May 2023 08:44:06 UTC

The auto scaling in Typesense Cloud is not real-time elastic. We will be able to handle capacity upgrades when your cluster starts bumping into limits and we notice degradation. It's not instant so you can't rely on that for handling massive spikes like 0 to 10x baseline traffic, for example.

Photo of Juliusz
Juliusz
Thu, 11 May 2023 08:44:47 UTC

Okay I get it

Photo of Juliusz
Juliusz
Thu, 11 May 2023 08:45:01 UTC

The thing is, that right now my app doesnt have many users and traffic

Photo of Juliusz
Juliusz
Thu, 11 May 2023 08:46:16 UTC

But I am preparing a big marketing campaign for the festival, which takes place tomorrow evening

Photo of Juliusz
Juliusz
Thu, 11 May 2023 08:47:07 UTC

And traffic can jump to several thousand users

Photo of Kishore Nallan
Kishore Nallan
Thu, 11 May 2023 08:47:21 UTC

Then you can schedule an upgrade of your cluster for expected traffic. And then take a call on downscaling it later on based on metrics after a few days.

Photo of Kishore Nallan
Kishore Nallan
Thu, 11 May 2023 08:47:33 UTC

There is an option to schedule an upgrade from the Cloud UI

Photo of Kishore Nallan
Kishore Nallan
Thu, 11 May 2023 08:47:57 UTC

We only handle automatic scaling up.

Photo of Juliusz
Juliusz
Thu, 11 May 2023 08:48:14 UTC

And could you advise which cluster could certainly cope with a traffic level of a few thousand people, who could make quite a few requests?

Photo of Kishore Nallan
Kishore Nallan
Thu, 11 May 2023 08:48:51 UTC

But you can always schedule upgrades/downgrades from the UI. Happy to discuss specifics about your cluster if you can email us your cluster ID, and expected concurrency.

Photo of Juliusz
Juliusz
Thu, 11 May 2023 08:49:12 UTC

It is hard to predict to be honest

Photo of Juliusz
Juliusz
Thu, 11 May 2023 08:59:40 UTC

Could you provide an example, which could estimate which cluster would handle specific traffic?

Photo of Kishore Nallan
Kishore Nallan
Thu, 11 May 2023 09:04:53 UTC

Can't say without looking at the size and schema of your data. If you wish, you can benchmark your cluster to get an idea.