<#C01P749MET0|community-help> I'm experiencing an...
# community-help
g
#community-help I'm experiencing an issue with the 3-node Kubernetes setup. On initial setup, everything is working fine, however, if I attempt to delete a pod the node configuration always points to the old ips. However, the ips from the statefulset are parsed correctly based on the logs. ----- E20241001 101124.621331 119 raft_server.cpp:55] Failed to parse nodes configuration:
typesense-0.typesense.default.svc.cluster.local:8107:8108,typesense-1.typesense.default.svc.cluster.local:8107:8108,typesense-2.typesense.default.svc.cluster.local:8107:8108
-- will retry shortly... I20241001 101154.627483 119 raft_server.cpp:69] Nodes configuration: 10.0.6.3181078108,10.0.5.3181078108,10.0.4.2981078108 I20241001 101154.660590 119 raft_server.cpp:112] Snapshot does not exist. We will remove db dir and init db fresh. I20241001 101154.661535 119 store.cpp:246] rm /typesense-data/db success I20241001 101154.661633 119 store.cpp:40] Initializing DB by opening state dir: /typesense-data/db I20241001 101154.688372 119 store.cpp:270] DB open success! I20241001 101154.688431 119 raft_server.cpp:619] Loading collections from disk... I20241001 101154.688472 119 collection_manager.cpp:273] CollectionManager::load() I20241001 101154.688515 119 auth_manager.cpp:34] Indexing 0 API key(s) found on disk. I20241001 101154.688545 119 collection_manager.cpp:309] Loading upto 8 collections in parallel, 1000 documents at a time. I20241001 101154.688565 119 collection_manager.cpp:318] Found 0 collection(s) on disk. I20241001 101154.689031 119 collection_manager.cpp:441] Loaded 0 collection(s). I20241001 101154.689486 119 raft_server.cpp:626] Finished loading collections from disk. I20241001 101154.689532 119 raft_server.cpp:637] Loaded 0conversation model(s). I20241001 101154.689548 119 raft_server.cpp:641] Initializing batched indexer from snapshot state... I20241001 101154.690625 119 log.cpp:690] Use murmurhash32 as the checksum type of appending entries I20241001 101154.715950 119 log.cpp:1172] log load_meta /typesense-data/state/log/log_meta first_log_index: 1 time: 25136 I20241001 101154.716063 119 log.cpp:1112] load open segment, path: /typesense-data/state/log first_index: 1 I20241001 101154.748255 119 raft_meta.cpp:521] Loaded single stable meta, path /typesense-data/state/meta term 3 votedfor 10.0.5.2581078108 time: 1612 I20241001 101154.748338 119 node.cpp:608] node default_group10.0.4.298107:8108 init, term: 3 last_log_id: (index=4,term=3) conf: 10.0.4.2581078108,10.0.5.2581078108,10.0.6.2781078108 old_conf: I20241001 101154.748489 119 raft_server.cpp:135] Node last_index: 4 I20241001 101154.748610 119 typesense_server_utils.cpp:296] Typesense peering service is running on 10.0.4.29:8107 I20241001 101154.748744 119 typesense_server_utils.cpp:297] Snapshot interval configured as: 3600s I20241001 101154.748848 119 typesense_server_utils.cpp:298] Snapshot max byte count configured as: 4194304 W20241001 101154.748870 119 controller.cpp:1550] SIGINT was installed with 1 I20241001 101154.750211 119 raft_server.cpp:706] Term: 3, pending_queue: 0, last_index: 4, committed: 0, known_applied: 0, applying: 0, pending_writes: 0, queued_writes: 0, local_sequence: 0 W20241001 101154.750243 119 raft_server.cpp:734] Multi-node with no leader: refusing to reset peers. ---