#community-help

Searching English Singular/Plural Pairs with Typesense

TLDR Adrian sought a source for common English singular/plural pairs. Kishore Nallan recommended using synonyms for compatibility with highlighting in Typesense.

5mo

Join the chat

Apr 26, 2023 (5 months ago)

Photo of md5-27ff63286c7b3dcb91085f39e910c437

Adrian

07:47 PM

Related to this github issue. Does anybody know of a source with lists of common english singular/plurals pairs (e.g. mice - mouse)? My application searches general user uploaded data, so hard to create a custom dictionary since I don't know what users may upload ahead of time.

Apr 27, 2023 (5 months ago)

Photo of md5-4e872368b2b2668460205b409e95c2ea

Kishore Nallan

12:42 AM

For stemming, people use porter stemmer. However for just singular/plurals I'm not aware of any lists.

Adrian

03:04 PM

where in the flow do people apply porter stemmer? I assume it would have to be at query and index time. But if the indexed data is stemmed then the snippets would be effect I believe, which we don't want

Kishore Nallan

03:05 PM

Right so you have to index the stemmed version but also have the original version. Typesense can highlight any field even if it's not part of schema.

Adrian

03:19 PM

how does typesense highlight a field not in the schema? I don't fully follow how a stemmed query could map to highlighting the original version thats not in the schema

Kishore Nallan

03:21 PM

Yeah stemmed query will not be matched to words in text so that won't work...

Adrian

08:51 PM

do you have any other ideas on how to make this use case work with typesense? Would setting up synonyms for common plural/singular pairs be the best bet?

Apr 28, 2023 (5 months ago)

Kishore Nallan

12:53 AM

Synonyms is probably the only way I can think of doing it that's also compatible with highlighting.

Typesense

Lightning-fast, open source search engine for everyone | Knowledge Base powered by Struct.AI

Indexed 2764 threads (79% resolved)

Join Our Community Manage subscription

Similar Threads

Resolving Typesense Search Issues

Conversation started by Maximilian about Typesense search behavior led to Users Kishore Nallan and Mike discussing and suggesting workaround, with Kishore Nallan promising an official solution soon. No final confirmation of resolution provided.

17mo

Handling Singular vs Plural in Search Queries

Rajeev queried about handling singular and plural in search queries. Kishore Nallan explained that there's no definite way for handling plurals in Typesense. They agreed to troubleshoot Rajeev's query issues further.

12mo

Improving Search Result Sensitivity in Typesense

Laura experienced issues with Typesense implementation, requiring improved error sensitivity. Jason offered troubleshooting advice and an upgrade, finally revealing how search terms are matched. The issue was resolved by considering the use of synonyms.

2mo

Discussing Typo Tolerance in TypeSense Search

Greg conveys a client's query about TypeSense's typo-tolerance search. Jason explains it covers most plurals unless more than 2 characters are changed. They agree that significantly exceeding a levenshtein distance of 2 slows the query and/or provides inaccurate results.

12mo

Array Field Autocomplete Issue in Typesense Migration

Kanwei encountered issues with autocomplete when migrating from Elasticsearch to Typesense. Jason and Kishore Nallan identified it as a bug and instructed Kanwei to create a GitHub issue.

6mo