#community-help

Configuring Cluster for Auto Scaling and Traffic Handling

TLDR Juliusz asked how to configure their cluster for auto scaling. Kishore Nallan suggested emailing Typesense and provided information on scheduling upgrades and downgrades based on expected traffic.

5mo

Join the chat

May 11, 2023 (5 months ago)

Photo of md5-790ea4d701cf25986a03ff79d757e7cb

Juliusz

07:51 AM

Hi guys, could you please help me to configure my cluster to scale automatically?

Photo of md5-4e872368b2b2668460205b409e95c2ea

Kishore Nallan

07:54 AM

How are you hosting Typesense?

Juliusz

08:02 AM

On the cloud

Kishore Nallan

08:37 AM

Please email [email protected] with the cluster ID. We will take care of it.

Juliusz

08:42 AM

Sure, do you think that you will manage to do it in let’s say 24 hours?

08:43

Juliusz

08:43 AM

It can be crucial to my business

Kishore Nallan

08:44 AM

The auto scaling in Typesense Cloud is not real-time elastic. We will be able to handle capacity upgrades when your cluster starts bumping into limits and we notice degradation. It's not instant so you can't rely on that for handling massive spikes like 0 to 10x baseline traffic, for example.

Juliusz

08:44 AM

Okay I get it

08:45

Juliusz

08:45 AM

The thing is, that right now my app doesnt have many users and traffic

08:46

Juliusz

08:46 AM

But I am preparing a big marketing campaign for the festival, which takes place tomorrow evening

08:47

Juliusz

08:47 AM

And traffic can jump to several thousand users

Kishore Nallan

08:47 AM

Then you can schedule an upgrade of your cluster for expected traffic. And then take a call on downscaling it later on based on metrics after a few days.

08:47

Kishore Nallan

08:47 AM

There is an option to schedule an upgrade from the Cloud UI

08:47

Kishore Nallan

08:47 AM

We only handle automatic scaling up.

Juliusz

08:48 AM

And could you advise which cluster could certainly cope with a traffic level of a few thousand people, who could make quite a few requests?

Kishore Nallan

08:48 AM

But you can always schedule upgrades/downgrades from the UI.

Happy to discuss specifics about your cluster if you can email us your cluster ID, and expected concurrency.

Juliusz

08:49 AM

It is hard to predict to be honest

08:59

Juliusz

08:59 AM

Could you provide an example, which could estimate which cluster would handle specific traffic?

Kishore Nallan

09:04 AM

Can't say without looking at the size and schema of your data. If you wish, you can benchmark your cluster to get an idea.

Typesense

Lightning-fast, open source search engine for everyone | Knowledge Base powered by Struct.AI

Indexed 2776 threads (79% resolved)

Join Our Community Manage subscription

Similar Threads

Typesense Cloud Cluster Issue and Upgrade Recommendations

Viji reported a cluster issue on Typesense Cloud. Jason identified the cause and recommended upgrading to Typesense 0.24.1 for safeguards against RAM usage spikes.

3mo

Management and Scaling of Locally Hosted Typesense Cluster

Atif inquires about managing and scaling a locally hosted Typesense cluster. Jason guides by sharing relevant links and explaining how to add and sync new nodes.

9mo

Typesense Cluster Upgrade Issues and Solutions

Ken reported a system outage due to Typesense cluster upgrade issues. Jason recommended upgrading to the next RAM tier and explained when the auto upgrade feature takes effect. After a repeat issue, Jason added handling upgrades when disk space ran out to their backlog.

Upgrading Problems with Typesense Cloud Node

Alan encountered issues with their typesense cloud node during an import, resulting in the need for a manual upgrade. Kishore Nallan assisted with the upgrade process and Jason reported that an upgrade was queued due to a second outage.

12mo

Optimizing Typesense Implementation for Large Collections

Oskar faced performance issues with his document collection in Typesense due to filter additions. Jason suggested trying a newer Typesense build and potentially partitioning the data into country-wise collections. They also discussed reducing network latency with CDN solutions.

8mo