#community-help

Discussion on Snippeting Multiple Matches

TLDR bnfd inquired about highlighting multiple matches with snippeting. Kishore Nallan stated it was possible by listing the fields in highlight_full_fields, but multiple snippets from various parts of a document couldn't be achieved due to Typesense's scoring parameters.

25mo

Join the chat

Oct 29, 2021 (25 months ago)

Photo of md5-ca6495d5be926db80e09aabf066f4b8b

bnfd

01:02 PM

Kishore Nallan I saw the issue regarding exhaustive highlighting and wanted to ask if there was any update regarding multiple matches snippeting: https://typesense-community.slack.com/archives/C01P749MET0/p1629833031204400?thread_ts=1629830554.200800&cid=C01P749MET0

Photo of md5-4e872368b2b2668460205b409e95c2ea

Kishore Nallan

01:07 PM

Have you tried 0.22.0.rcs21 build?

01:07

Kishore Nallan

01:07 PM

Oh wait this is about highlighting all instances of a match within a document.

01:09

Kishore Nallan

01:09 PM

We made a bunch of highlight improvements in 0.22.. I have to verify if multiple highlights are now possible for the full field.

bnfd

01:15 PM

I haven't tried the rcs21 build

Kishore Nallan

01:31 PM

bnfd I just checked. If you list the fields in highlight_full_fields then those fields are highlighted fully now on the latest builds.

01:32

Kishore Nallan

01:32 PM

Please try it out on 0.22.0.rcs21 and let me know!

bnfd

01:33 PM

Ah this is without snippeting, right?

Kishore Nallan

01:33 PM

Yes, snippet is meant for highlighting the best matched portion.

01:33

Kishore Nallan

01:33 PM

You want multiple snippets from various parts of the document?

bnfd

01:34 PM

Yes

Kishore Nallan

01:34 PM

That is not possible because Typesense scores documents on the best matched portion.

01:34

Kishore Nallan

01:34 PM

I mean, if we were to do it, it must be done in a post processing step before display.

01:35

Kishore Nallan

01:35 PM

Atleast now, it is possible to do this on the client side because words will be marked with <mark> tags.

bnfd

01:36 PM

Ah, I get the relevance aspect but sometimes I want to return all lines containing "foo" from each doc

Kishore Nallan

01:36 PM

You can do it on the client side easily now. Split paragraphs into sentences, and in each sentence check for number of <mark> tags and rank sentences on number of occurrences and show top N.

bnfd

01:48 PM

I was concerned that doing it on the frontend might result in a nontrivial overhead (in the case of a collection with many long documents) and having it offered by the engine would be beneficial. But maybe this is a rare use case.

01:48

bnfd

01:48 PM

Thanks for digging whether it's possible!

Kishore Nallan

01:50 PM

Certainly we can add an option for doing it, but just cautious about introducing too many new flags 🙂

bnfd

01:51 PM

Yeah, makes sense

Typesense

Lightning-fast, open source search engine for everyone | Knowledge Base powered by Struct.AI

Indexed 2779 threads (79% resolved)

Join Our Community Manage subscription

Similar Threads

Customizing Snippets and Highlighting in Document Searches

bnfd wants to customize snippeting, highlighting and show multiple snippets in a search. Jason suggests using `snippet_threshold`, `highlight_full_fields`, opening a GitHub issue and breaking long documents into smaller parts.

27mo

Issues with Typesense Search Results and Upcoming Enhancements

Stefan encountered problems with Typesense search results. Kishore Nallan recently refracted the text matching engine to improve this issue, highlighted upcoming features in their 0.23.0 release, and offered Dan a RC test run. Upgrades were also made on Typesense Cloud UI by Jason.

18mo

Issues with Highlight Version in Typesense

Stefan reported issues with the new highlight version in Typesense. Kishore Nallan provided a temporary workaround and further fixed the issue with an updated build.

11mo

Discussion on Typesense's Multi-matches per Document Feature

bnfd inquires about multi-matches per document feature in Typesense. Kishore Nallan explains that it hasn't been prioritized due to available workarounds. bnfd hopes for more requests for this feature.

19mo

Troubleshooting "drop_tokens_threshold" and Typo Tolerance in Typesense

Joe had issues with "drop_tokens_threshold" = 0 and typo tolerance in Typesense, after which Kishore Nallan provided solutions and clarifications on feature functionality. Their issues with the search result limit and tokens were resolved after discussion and testing.

24mo