#community-help

Brief Outage During High Availability Cluster Upgrade

TLDR Ed reported an outage during cluster upgrade. Jason suggested it might be due to a 30s delay when a node is unhealthy. Ed confirmed this.

Powered by Struct AI

1

9
2w
Solved
Join the chat
Sep 16, 2023 (2 weeks ago)
Ed
Photo of md5-120c789e9edae8b90bf59cf0e2612b66
Ed
09:27 PM
uh oh, upgrading my high availability cluster also causes an outage
Image 1 for uh oh, upgrading my high availability cluster also causes an outage
Jason
Photo of md5-8813087cccc512313602b6d9f9ece19f
Jason
10:29 PM
I still see search requests coming in to your cluster
10:30
Jason
10:30 PM
Could you confirm that you've configured your client library as described here: https://typesense.org/docs/guide/high-availability.html#when-using-typesense-cloud-or-a-load-balancer
Ed
Photo of md5-120c789e9edae8b90bf59cf0e2612b66
Ed
10:58 PM
yes, it’s pointing here:
<https://v09fm4cjghdr23p7p.a1.typesense.net/multi_search?x-typesense-api-key>
10:58
Ed
10:58 PM
Image 1 for
10:58
Ed
10:58 PM
it is back but it had a brief outage
Jason
Photo of md5-8813087cccc512313602b6d9f9ece19f
Jason
11:00 PM
There is a 30s period between when a node is unhealthy and when traffic is routed away from it. Wonder if you saw this right within that window
Ed
Photo of md5-120c789e9edae8b90bf59cf0e2612b66
Ed
11:02 PM
gotcha, probably. Ok so there is a 30sec brief outage
11:02
Ed
11:02 PM
thanks for your input on a weekend

1