Rebooting Overloaded Cloud Cluster
TLDR Oz asked for a way to reboot an overloaded cloud cluster. Kishore Nallan mentioned an upgrade as a solution, but Oz terminated and created a new cluster instead.
May 30, 2023 (6 months ago)
Due to a technical issue, we ran the scraper multiple times concurrently, and now the cluster is overloaded in memory usage and doesn’t go down for almost 10 hours.
Kishore Nallan01:54 PM
Kishore Nallan01:55 PM
Indexed 3015 threads (79% resolved)
Troubleshooting Unhealthy Cluster Issue
Sruli was unable to utilize their cluster. Jason suggested an update, which didn't solve the issue, then diagnosed the problem as a large string causing crashes. The resolution required resetting the cluster state.
Production Cluster Failure and Solution
Andrew experienced an unexpected production cluster failure. Kishore Nallan and Jason helped diagnose the problem, remediated it, and upgraded the cluster to prevent future issues.
Typesense Cluster Upgrade Issues and Solutions
Ken reported a system outage due to Typesense cluster upgrade issues. Jason recommended upgrading to the next RAM tier and explained when the auto upgrade feature takes effect. After a repeat issue, Jason added handling upgrades when disk space ran out to their backlog.