Configuring Cluster for Auto Scaling and Traffic Handling
TLDR Juliusz asked how to configure their cluster for auto scaling. Kishore Nallan suggested emailing Typesense and provided information on scheduling upgrades and downgrades based on expected traffic.
Kishore Nallan
Thu, 11 May 2023 07:54:21 UTCHow are you hosting Typesense?
Juliusz
Thu, 11 May 2023 08:02:32 UTCOn the cloud
Kishore Nallan
Thu, 11 May 2023 08:37:03 UTCPlease email
Juliusz
Thu, 11 May 2023 08:42:42 UTCSure, do you think that you will manage to do it in let’s say 24 hours?
Juliusz
Thu, 11 May 2023 08:43:01 UTCIt can be crucial to my business
Kishore Nallan
Thu, 11 May 2023 08:44:06 UTCThe auto scaling in Typesense Cloud is not real-time elastic. We will be able to handle capacity upgrades when your cluster starts bumping into limits and we notice degradation. It's not instant so you can't rely on that for handling massive spikes like 0 to 10x baseline traffic, for example.
Juliusz
Thu, 11 May 2023 08:44:47 UTCOkay I get it
Juliusz
Thu, 11 May 2023 08:45:01 UTCThe thing is, that right now my app doesnt have many users and traffic
Juliusz
Thu, 11 May 2023 08:46:16 UTCBut I am preparing a big marketing campaign for the festival, which takes place tomorrow evening
Juliusz
Thu, 11 May 2023 08:47:07 UTCAnd traffic can jump to several thousand users
Kishore Nallan
Thu, 11 May 2023 08:47:21 UTCThen you can schedule an upgrade of your cluster for expected traffic. And then take a call on downscaling it later on based on metrics after a few days.
Kishore Nallan
Thu, 11 May 2023 08:47:33 UTCThere is an option to schedule an upgrade from the Cloud UI
Kishore Nallan
Thu, 11 May 2023 08:47:57 UTCWe only handle automatic scaling up.
Juliusz
Thu, 11 May 2023 08:48:14 UTCAnd could you advise which cluster could certainly cope with a traffic level of a few thousand people, who could make quite a few requests?
Kishore Nallan
Thu, 11 May 2023 08:48:51 UTCBut you can always schedule upgrades/downgrades from the UI. Happy to discuss specifics about your cluster if you can email us your cluster ID, and expected concurrency.
Juliusz
Thu, 11 May 2023 08:49:12 UTCIt is hard to predict to be honest
Juliusz
Thu, 11 May 2023 08:59:40 UTCCould you provide an example, which could estimate which cluster would handle specific traffic?
Kishore Nallan
Thu, 11 May 2023 09:04:53 UTCCan't say without looking at the size and schema of your data. If you wish, you can benchmark your cluster to get an idea.
Typesense
Indexed 3051 threads
Lightning-fast, open source search engine for everyone | Knowledge Base powered by Struct.AI
View in App
Juliusz
Thu, 11 May 2023 07:51:00 UTCHi guys, could you please help me to configure my cluster to scale automatically?