Hello everybody,
I try use typesense (POC) with a ...
# community-helpr
Rafael Vieira
07/19/2022, 1:04 PMHello everybody,
I try use typesense (POC) with a 15M of records, but when I load 8M of records, the server Stop worker and stay In loop on Typesense startup.
Log Typesense
k
Kishore Nallan
07/19/2022, 1:06 PMAny error messages in the logs?
r
Rafael Vieira
07/19/2022, 1:10 PMHi, Kishore.
I added the server log.
k
Kishore Nallan
07/19/2022, 1:30 PMI see a lot of errors about bad JSON lines in the import file. But it's strange that there is no stack trace. Can you check
/var/log/syslogKishore Nallan
07/19/2022, 1:33 PMYou can search for
Copy code
Typesense crashed... Copy code
Stack tracer
Rafael Vieira
07/19/2022, 1:56 PMI found other log dir in /var/log/typesense Log
Rafael Vieira
07/19/2022, 1:57 PMBut nothing about crash
Rafael Vieira
07/19/2022, 1:57 PMor stack trace
k
Kishore Nallan
07/19/2022, 1:57 PMNo syslog file?
r
Rafael Vieira
07/19/2022, 2:05 PMJul 19 063327 MongoGlobal kernel: [13764495.950886] oom-kill:constraint=CONSTRAINT_NONE,nodemask=(null),cpuset=/,mems_allowed=0,global_oom,task_memcg=/system.slice/typesense-server.service,task=typesense-serve,pid=18311,uid=0
Jul 19 063327 MongoGlobal kernel: [13764495.951229] Out of memory: Killed process 18311 (typesense-serve) total-vm:42535712kB, anon-rss:36513632kB, file-rss:0kB, shmem-rss:0kB, UID:0 pgtables:73576kB oom_score_adj:0
Jul 19 063327 MongoGlobal kernel: [13764496.755385] oom_reaper: reaped process 18311 (typesense-serve), now anon-rss:0kB, file-rss:0kB, shmem-rss:0kB
Rafael Vieira
07/19/2022, 2:05 PMJul 19 063327 MongoGlobal systemd[1]: typesense-server.service: Main process exited, code=killed, status=9/KILL
Jul 19 063327 MongoGlobal systemd[1]: typesense-server.service: Failed with result 'signal'.
Jul 19 063328 MongoGlobal systemd[1]: typesense-server.service: Service hold-off time over, scheduling restart.
Jul 19 063328 MongoGlobal systemd[1]: typesense-server.service: Scheduled restart job, restart counter is at 25.
Jul 19 063328 MongoGlobal systemd[1]: Stopped Typesense Server.
Jul 19 063328 MongoGlobal systemd[1]: Started Typesense Server.
Rafael Vieira
07/19/2022, 2:07 PMJul 19 063327 MongoGlobal kernel: [13764495.950838] [ pid ] uid tgid total_vm rss pgtables_bytes swapents oom_score_adj name
Jul 19 063327 MongoGlobal kernel: [13764495.950885] [ 18311] 0 18311 10633928 9128299 75341824 0 0 typesense-serve
k
Kishore Nallan
07/19/2022, 2:08 PMAre you sure you are not running out of memory? Looks like the process got killed.
Kishore Nallan
07/19/2022, 2:08 PMIt says "Out of memory"
r
Rafael Vieira
07/19/2022, 2:10 PMyes, I see....(This server have 64Gb mem) to 15M (How many memory need?)
k
Kishore Nallan
07/19/2022, 2:10 PMBut you have other things running?
r
Rafael Vieira
07/19/2022, 2:11 PMI will create a 2 servers to try load this records
Rafael Vieira
07/19/2022, 2:11 PMYou can be rigth about the server, is running other applications
Rafael Vieira
07/19/2022, 2:12 PMYou think if I create a Server with 32gb of memory can work well with this amount of data?
k
Kishore Nallan
07/20/2022, 6:27 AMWe've a calculator for estimating RAM usage here: https://cloud.typesense.org/pricing/calculator (scroll to the middle of the page)