Disk Space Issue with Typesense Machine
TLDR John reported increasing disk space usage on their Typesense machine due to old indexes. Kishore Nallan suggested triggering a manual compaction and offered a command for it in the recent 0.24 RC build. John will test this solution next week.
2
1
Dec 07, 2022 (10 months ago)
John
08:21 AM.sst
files), because the collection hasn’t changed much but the disk usage keeps increasing. Any idea what this could be?Kishore Nallan
08:22 AMJohn
08:22 AM0.24.0.rcn34
Kishore Nallan
08:23 AMKishore Nallan
08:24 AMJohn
08:27 AMNo, it doesn’t seem to get released
Kishore Nallan
08:31 AMJohn
08:39 AMKishore Nallan
08:45 AMKishore Nallan
08:47 AMJohn
09:42 AM• ~80 files at 65M each, from Nov 22-Nov 29
• No SST files for a few days, then ~40 at 65M each, from Dec 3-Dec 4.
• Finally about 120 at 20M each, from Dec 5 to now.
Dec 08, 2022 (10 months ago)
Kishore Nallan
08:57 AM1
Kishore Nallan
08:58 AMJohn
09:02 AMKishore Nallan
09:03 AM1
Kishore Nallan
09:04 AMJohn
09:15 AMKishore Nallan
03:52 PMdb/LOG
file?John
04:03 PMKishore Nallan
04:08 PMKishore Nallan
04:09 PM1
Dec 22, 2022 (10 months ago)
Kishore Nallan
06:52 AMIn recent 0.24 RC builds (e.g.
0.24.0.rcn43
) we have a way for you to trigger a compaction manually like this:curl -X POST '' --header 'X-TYPESENSE-API-KEY: abcd'
This will restore the disk space immediately. Can you please try that out?
John
08:22 PMTypesense
Indexed 2779 threads (79% resolved)
Similar Threads
Slow, High CPU Write Operations After Collection Drop in Typesense
Himank discussed an issue in Typesense where deleting and recreating a collection led to slow write operations and high CPU usage. Kishore Nallan suggested using an alias to avoid this issue. Numerous tests and debugging was conducted as pboros contributed with local testing. Kishore Nallan aimed to start implementing a range delete and full db compaction after deletion to potentially solve the issue.
Trouble with Typesense Memory Usage when Restarting Docker Container
Blend reports increased memory usage when restarting Docker with Typesense, information shared with Jason and Kishore Nallan. Potential data edge case identified as potential cause, although resolution undetermined.
Upsert Script Issues and Missing Spaces in Typesense
Alex is experiencing issues with missing spaces in Typesense, specifically appearing more frequently during upserts. The missing spaces persist despite changing versions and implementing a workaround. Despite detailed troubleshooting with Kishore Nallan, the issue remains unresolved. The problem appears to be random and unpredictable. Further testing and dataset sharing were suggested for resolution.
Querying Issues with Newly Created Collection
User Dima reported issues with missed search results in a new collection he created. User Kishore Nallan offered solutions but the problem persists. Dima cannot share the data, which makes it harder to resolve the issue.
Resolving Typesense Cloud Cluster Issue with Cron Job
Issei reported a problem with an unhealthy Typesense Cloud cluster. With the particular help of Jason and Kishore Nallan, they discovered that a problematic cron job was responsible. A solution, using a different endpoint for data export, was agreed on and implemented.