#community-help

Issue with Result Counts Across Pages with Many Pinned Hits

TLDR John reports invalid 'found' value with a high number of 'pinned_hits' applying filters. They provided data and suggested a workaround. Kishore Nallan acknowledged the unusual case and proposed an error message for such issue.

13mo

Join the chat

Nov 22, 2022 (13 months ago)

Photo of md5-21545f1facb7836c149bc4c70752bd2b

John

10:00 AM

Hmm I get inaccurate found when having many pinned_hits combined with some filters. On page 1 it says 512 (weird coincidence?) results and it increases up to the actual result count of 713 as I paginate past the first 512 results. Possible to fix somehow or is it unavoidable that this happens sometimes? I know many search engines only guarantee approximate result counts.

Photo of md5-4e872368b2b2668460205b409e95c2ea

Kishore Nallan

10:02 AM

We would need access to reproduceable dataset to confirm. Ideally count should not vary.

John

02:03 PM

Managed to reproduce it with a large number of pins https://pastebin.com/TQrLDavX

Let me know if you’d like me to create an issue

02:03

John

02:03 PM

> On page=1 got found=9299
> On page=2 got found=9549
> On page=3 got found=9799
> On page=4 got found=9993
> On page=5 got found=9993
> On page=6 got found=9993
> On page=7 got found=9993
> On page=8 got found=9993
> On page=9 got found=9993
> On page=10 got found=9993
> On page=11 got found=9993
> On page=12 got found=9993
> On page=13 got found=9993
> On page=14 got found=9993
> On page=15 got found=9993
> On page=16 got found=9993
> On page=17 got found=9993
> On page=18 got found=9993
> On page=19 got found=9993

02:09

John

02:09 PM

I think we could maybe work around this by only pinning positions that are within the requested page (it seems to happen when number of pins is >250, which coincidentally is the page limit). Most likely not worth fixing in that case since it is a bit of a weird usecase! (but maybe a limit on the # of pinned hits makes sense)

Kishore Nallan

02:16 PM

Yes i think it's an outlier given that many pinned hits. Nevertheless we should probably handle this with some error so it doesn't throw people off.

Typesense

Lightning-fast, open source search engine for everyone | Knowledge Base powered by Struct.AI

Indexed 3015 threads (79% resolved)

Join Our Community

Similar Threads

Resolving Typesense Result Issue in Document Collection Queries

Mike was encountering errors when searching for specific query in their Typesense document collection. Jason suggested it may be due to the `drop_tokens_threshold` setting. There was a misunderstanding but after further explanation from Jason, Mike understood and decided to continue the conversation via email.

22mo

Large JSONL Documents Import Issue & Resolution

Suraj was having trouble loading large JSONL documents into Typesense server. After several discussions and attempts, it was discovered that the issue was due to data quality. Once the team extracted the data again, the upload process worked smoothly.

9mo

Troubleshooting Stalled Writes in TypeSense Instance

Robert was experiencing typesense instances getting stuck after trying to import documents. Kishore Nallan provided suggestions and added specific logs to diagnose the issue. The two identified queries causing troubles but the issues had not been fully resolved yet.

13mo