#community-help

Troubleshooting Document Import Issue with Typesense on Docker

TLDR Harrison experienced an issue with Typesense getting stuck when importing JSONL documents. Harrison offered to provide a copy of the docker volume to aid troubleshooting, but failed to retrieve it. Kishore Nallan recommended observing the local sequence number in the logs.

Powered by Struct AI
May 29, 2022 (17 months ago)
Harrison
Photo of md5-43a35158b04c9c49110114370dbeae06
Harrison
04:01 PM
The logs arent hugely helpful and I realise i've accidentally cleared the ones showing what looks like the issue 😢
But essentially uploading a set of JSONL documents, where on is invalid using: /collections/stackoverflow/documents/import?dirty_values=coerce_or_drop and then doing an abrupt stop in docker, causes typesense to just get stuck trying to recover and it cant?
Kishore Nallan
Photo of md5-4e872368b2b2668460205b409e95c2ea
Kishore Nallan
04:04 PM
Have you been able to reproduce the issue?
04:05
Kishore Nallan
04:05 PM
Are you saying that Typesense server is just stuck and not able to finish loading docs on startup?
Harrison
Photo of md5-43a35158b04c9c49110114370dbeae06
Harrison
04:05 PM
Looks like it
04:05
Harrison
04:05 PM
well, Looked*
Kishore Nallan
Photo of md5-4e872368b2b2668460205b409e95c2ea
Kishore Nallan
04:06 PM
Then how did it resolve?
Harrison
Photo of md5-43a35158b04c9c49110114370dbeae06
Harrison
04:06 PM
it didnt. I just wiped the container
04:06
Harrison
04:06 PM
unless it did start up correctly, and something else blocked it from being 'ready'
04:07
Harrison
04:07 PM
Would It be helpful If I send the docker volume that was causing it to get stuck in the given state?
04:07
Harrison
04:07 PM
Thought I had removed it but turns out I haven't :thumbsup: So should be useful to debug
Kishore Nallan
Photo of md5-4e872368b2b2668460205b409e95c2ea
Kishore Nallan
04:07 PM
Yes any form of reproduceable artifact is good
04:08
Kishore Nallan
04:08 PM
The key thing to notice when you get that lag message is to see if the local sequence number in the logs -- to see whether it's increasing.
Harrison
Photo of md5-43a35158b04c9c49110114370dbeae06
Harrison
04:15 PM
Just bundling the volume up, it's reasonably chunky at about 6GB so might take a little bit
Kishore Nallan
Photo of md5-4e872368b2b2668460205b409e95c2ea
Kishore Nallan
04:16 PM
No worries, it's pretty late here so I'll probably be able to download and look only in the morning.
Harrison
Photo of md5-43a35158b04c9c49110114370dbeae06
Harrison
04:17 PM
Fair enough, shall send once it's done (or more likely might go into a blob store)
Jun 15, 2022 (16 months ago)
Harrison
Photo of md5-43a35158b04c9c49110114370dbeae06
Harrison
07:04 PM
Sorry, I realise I completely forgot about this 😅 Unfortunately I wasn't able to retrieve the volume data, something wasn't happy about me trying to copy it across and cleared everything 😕