Hello, I have an issue with cold start. The node ...
# community-help
p
Hello, I have an issue with cold start. The node always restart, without any explicit message. it seems to be same issue as @Jens Nylander
Copy code
I20250203 09:51:29.607792   226 store.cpp:270] DB open success!
I20250203 09:51:29.607822   226 raft_server.cpp:589] Loading collections from disk...
I20250203 09:51:29.607839   226 collection_manager.cpp:310] CollectionManager::load()
I20250203 09:51:29.608741   226 auth_manager.cpp:35] Indexing 0 API key(s) found on disk.
I20250203 09:51:29.608820   226 collection_manager.cpp:340] Loading symlink catalog to catalog_1738482211627
I20250203 09:51:29.608836   226 collection_manager.cpp:340] Loading symlink product to product_1738346080948
I20250203 09:51:29.608847   226 collection_manager.cpp:346] Loading upto 1 collections in parallel, 500 documents at a time.
I20250203 09:51:29.609007   226 collection_manager.cpp:355] Found 2 collection(s) on disk.
I20250203 09:51:29.610957   261 collection_manager.cpp:183] Found collection catalog_1738482211627 with 4 memory shards.
I20250203 09:51:29.611260   261 collection_manager.cpp:1689] Loading collection catalog_1738482211627
I20250203 09:51:30.360911   261 collection_manager.cpp:1808] Indexed 27332/27332 documents into collection catalog_1738482211627
I20250203 09:51:30.361110   261 collection_manager.cpp:425] Loaded 1 collection(s) so far
I20250203 09:51:30.362805   261 collection_manager.cpp:183] Found collection product_1738346080948 with 4 memory shards.
I20250203 09:51:30.364199   261 collection_manager.cpp:1689] Loading collection product_1738346080948
I20250203 09:51:54.801764     1 typesense_server_utils.cpp:58] Stopping Typesense server...
I20250203 09:51:55.253749   261 collection_manager.cpp:1808] Indexed 20500/20500 documents into collection product_1738346080948
I20250203 09:51:55.253816   261 collection_manager.cpp:425] Loaded 2 collection(s) so far
I20250203 09:51:55.254901   226 collection_manager.cpp:509] Loaded 2 collection(s).
I20250203 09:51:55.255000   226 raft_server.cpp:596] Finished loading collections from disk.
I20250203 09:51:55.255029   226 raft_server.cpp:607] Loaded 0conversation model(s).
I20250203 09:51:55.255045   226 raft_server.cpp:611] Initializing batched indexer from snapshot state...
I20250203 09:51:55.255080   226 batched_indexer.cpp:624] Restored 0 in-flight requests from snapshot.
I20250203 09:51:55.255100   226 raft_server.cpp:624] Loaded 0 personalization model(s).
I20250203 09:51:55.255129   226 raft_server.h:294] Configuration of this group is 10.42.204.118:8107:8108,10.42.65.223:8107:8108,10.42.65.242:8107:8108
I20250203 09:51:55.255237   226 snapshot_executor.cpp:264] node default_group:10.42.65.204:8107:8108 snapshot_load_done, last_included_index: 1235 last_included_term: 2 peers: "10.42.204.118:8107:8108" peers: "10.42.65.223:8107:8108" peers: "10.42.65.242:8107:8108"
I20250203 09:51:55.255439   183 raft_meta.cpp:521] Loaded single stable meta, path /usr/share/typesense/data/state/meta term 2 votedfor 0.0.0.0:0:0 time: 31
I20250203 09:51:55.255483   183 node.cpp:608] node default_group:10.42.65.204:8107:8108 init, term: 2 last_log_id: (index=1237,term=2) conf: 10.42.204.118:8107:8108,10.42.65.223:8107:8108,10.42.65.242:8107:8108 old_conf:
I20250203 09:51:55.255729   183 raft_server.cpp:136] Node last_index: 1237
I20250203 09:51:55.255757   183 typesense_server_utils.cpp:298] Typesense peering service is running on 10.42.65.204:8107
I20250203 09:51:55.255767   183 typesense_server_utils.cpp:299] Snapshot interval configured as: 3600s
I20250203 09:51:55.255772   183 typesense_server_utils.cpp:300] Snapshot max byte count configured as: 4194304
W20250203 09:51:55.255899   183 controller.cpp:1550] SIGINT was installed with 1
I20250203 09:51:55.255914   183 typesense_server_utils.cpp:331] Typesense peering service is going to quit.
I20250203 09:51:55.255919   183 raft_server.cpp:965] Set shutting_down = true
I20250203 09:51:55.255926   183 raft_server.cpp:969] Waiting for in-flight writes to finish...
I20250203 09:51:55.255930   183 raft_server.cpp:975] Replication state shutdown, store sequence: 402339
I20250203 09:51:55.255936   183 raft_server.cpp:979] node->shutdown
I20250203 09:51:55.255944   183 node.cpp:961] node default_group:10.42.65.204:8107:8108 shutdown, current_term 2 state FOLLOWER
I20250203 09:51:55.256054   183 raft_server.cpp:983] node->join
I20250203 09:51:55.256071   217 raft_server.h:286] This node is down
I20250203 09:51:55.256109   183 node.cpp:961] node default_group:10.42.65.204:8107:8108 shutdown, current_term 2 state SHUTDOWN
I20250203 09:51:55.256232   183 typesense_server_utils.cpp:336] raft_server.stop()
I20250203 09:51:55.256242   183 server.cpp:1241] Server[braft::RaftStatImpl+braft::FileServiceImpl+braft::RaftServiceImpl+braft::CliServiceImpl] is going to quit
I20250203 09:51:55.256537   183 typesense_server_utils.cpp:339] raft_server.join()
I20250203 09:51:55.256608   183 typesense_server_utils.cpp:342] Typesense peering service has quit.
I20250203 09:51:55.257086   183 typesense_server_utils.cpp:542] Shutting down batch indexer...
I20250203 09:51:55.257099   183 typesense_server_utils.cpp:545] Waiting for batch indexing thread to be done...
I20250203 09:51:55.599536   184 batched_indexer.cpp:475] Notifying batch indexer threads about shutdown...
I20250203 09:51:55.599629   184 batched_indexer.cpp:481] Notifying reference sequence thread about shutdown...
I20250203 09:51:55.599820   184 batched_indexer.cpp:485] Batched indexer threadpool shutdown...
I20250203 09:51:55.600287   183 typesense_server_utils.cpp:548] Shutting down event sink thread...
I20250203 09:51:55.600327   183 typesense_server_utils.cpp:551] Waiting for event sink thread to be done...
I20250203 09:51:55.600373   183 typesense_server_utils.cpp:554] Shutting down conversation garbage collector thread...
I20250203 09:51:55.600389   183 typesense_server_utils.cpp:557] Waiting for conversation garbage collector thread to be done...
I20250203 09:51:55.600492   183 typesense_server_utils.cpp:560] Waiting for housekeeping thread to be done...
I20250203 09:51:55.600545   183 typesense_server_utils.cpp:564] Shutting down server_thread_pool
I20250203 09:51:55.601136   183 typesense_server_utils.cpp:568] Shutting down app_thread_pool.
I20250203 09:51:55.601830   183 typesense_server_utils.cpp:572] Shutting down replication_thread_pool.
I20250203 09:51:55.602380     1 typesense_server_utils.cpp:585] Typesense API service has quit.
I20250203 09:51:55.602516     1 typesense_server_utils.cpp:589] Deleting batch indexer
I20250203 09:51:55.602535     1 typesense_server_utils.cpp:593] CURL clean up
I20250203 09:51:55.602542     1 typesense_server_utils.cpp:597] Deleting server
I20250203 09:51:55.602700     1 typesense_server_utils.cpp:601] CollectionManager dispose, this might take some time...
I20250203 09:51:55.665716     1 typesense_server_utils.cpp:610] Bye.