https://typesense.org logo
Join Slack
Powered by
Hi typesense team - we ran into this issue with ou...
# community-help
d
Hi typesense team - we ran into this issue with our typesense server crashing and restarting. See the log from the server in thread. I think we’re on 0.26.0.rc1. Any idea what could cause this?
Copy code
I20230817 17:00:51.051535 500549 raft_server.cpp:553] Term: 28, last_index index: 977955, committed_index: 977955, known_applied_index: 977955, applying_index: 
0, queued_writes: 0, pending_queue_size: 0, local_sequence: 209268797
I20230817 17:00:51.051736 500620 raft_server.h:60] Peer refresh succeeded!
I20230817 17:01:01.053194 500549 raft_server.cpp:553] Term: 28, last_index index: 977955, committed_index: 977955, known_applied_index: 977955, applying_index: 
0, queued_writes: 0, pending_queue_size: 0, local_sequence: 209268797
I20230817 17:01:01.053496 500616 raft_server.h:60] Peer refresh succeeded!
E20230817 17:01:07.575099 500294 backward.hpp:4200] Stack trace (most recent call last) in thread 500294:
E20230817 17:01:07.575278 500294 backward.hpp:4200] #13   Object "", at 0xffffffffffffffff, in 
E20230817 17:01:07.575299 500294 backward.hpp:4200] #12   Object "/usr/lib/x86_64-linux-gnu/libc.so.6", at 0x7fc096b9e9ff, in 
E20230817 17:01:07.575310 500294 backward.hpp:4200] #11   Object "/usr/lib/x86_64-linux-gnu/libc.so.6", at 0x7fc096b0cb42, in 
E20230817 17:01:07.575343 500294 backward.hpp:4200] #10   Object "/usr/bin/typesense-server", at 0x167752d, in bvar::detail::SamplerCollector::sampling_thread(v
oid*)
E20230817 17:01:07.575361 500294 backward.hpp:4200] #9    Object "/usr/bin/typesense-server", at 0x1676e53, in bvar::detail::SamplerCollector::run()
E20230817 17:01:07.575379 500294 backward.hpp:4200] #8    Object "/usr/bin/typesense-server", at 0x1326e94, in bvar::detail::ReducerSampler<bvar::detail::Percen
tile, bvar::detail::PercentileSamples<254ul>, bvar::detail::Percentile::AddPercentileSamples, bvar::detail::VoidOp>::take_sample()
Log file created at: 2023/08/17 17:01:08
Running on machine: cst-prod-typesense-11
Running duration (h:mm:ss): 0:00:00
Log line format: [IWEF]yyyymmdd hh:mm:ss.uuuuuu threadid file:line] msg
I20230817 17:01:08.666965 662443 typesense_server_utils.cpp:329] Starting Typesense 0.26.0.rc1
I20230817 17:01:08.667083 662443 typesense_server_utils.cpp:332] Typesense is using jemalloc.
I20230817 17:01:08.667971 662443 typesense_server_utils.cpp:382] Thread pool size: 64
I20230817 17:01:08.677939 662443 store.h:64] Initializing DB by opening state dir: /var/lib/typesense/db
I20230817 17:01:09.159246 662443 store.h:64] Initializing DB by opening state dir: /var/lib/typesense/meta
I20230817 17:01:09.183063 662443 ratelimit_manager.cpp:546] Loaded 0 rate limit rules.
I20230817 17:01:09.183125 662443 ratelimit_manager.cpp:547] Loaded 0 rate limit bans.
I20230817 17:01:09.183205 662443 typesense_server_utils.cpp:484] Starting API service...
I20230817 17:01:09.183355 662443 http_server.cpp:117] SSL cert refresh interval: 28800s
I20230817 17:01:09.183389 662699 typesense_server_utils.cpp:230] Since no --nodes argument is provided, starting a single node Typesense cluster.
I20230817 17:01:09.183454 662700 batched_indexer.cpp:124] Starting batch indexer with 64 threads.
I20230817 17:01:09.186192 662700 batched_indexer.cpp:129] BatchedIndexer skip_index: -9999
I20230817 17:01:09.193367 662443 http_server.cpp:178] Typesense has started listening on port 443
j
Could you try upgrading to 
0.26.0.rc13
?
d
yeah we can try it. is there a place with release notes where we can see what’s included or changed. we were waiting on some facet search optimizations too (my collegue Ankit has been in touch with your team). i’m curious if those changes are in rc13
j
There are a few improvements, but we’re continuing to iterate on it
We don’t publish release notes for each RC build…
d
@Jason Bosco just tried the 0.26rc13, the most notable change is that the facet counts are incorrectly and much higher than what they should be. we currently have ~700k records in the collection but some facets are show counts in millions
k
Hi Dan, it must be a regression. Once again, I request you to share a sample dataset that we can reproduce and investigate.
I'll also try with our datasets to see if we missed something in this latest build.
d
@Kishore Nallan i’ll DM you the sample dataset, thanks for your help!
k
Thank you, will check and get back to you early next week.
Open in Slack
PreviousNext
Powered by