Hello <@U01PL2YSG8L>
Is there a way to consider pr...
# community-helps
Sidharth Aggarwal
08/08/2023, 10:47 AMHello @Kishore Nallan
Is there a way to consider prefix match for each token separately?
Copy code
eg. rel fut
searched output: document -> Reliance Futurek
Kishore Nallan
08/08/2023, 10:56 AMNo this is not possible. Primarily because implementing this will be very intensive computationally. Each prefix could produce tens of matching words. For two prefixes if each produces ten words, then total combinations are 10 x 10 = 100
s
Sidharth Aggarwal
08/08/2023, 11:01 AMIs there any way to solve, in case some one have faced similar issue?
k
Kishore Nallan
08/08/2023, 11:25 AMShould they always be adjacent words?
Kishore Nallan
08/08/2023, 11:25 AMInfix search will help but against that's exhaustive so won't support high concurrency.
Kishore Nallan
08/08/2023, 11:54 AMThe only workaround I can think of is storing n grams of the words in an array. So for reliance industries you will store:
[r, re, rel, reli, relia, relianc, reliance, i, in, ind, ...]
Kishore Nallan
08/08/2023, 11:55 AMThis way rel ind will produce results fast. This might work for you since you are perhaps indexing stock symbols? There are not many companies so this should not take too much memory.
s
Sidharth Aggarwal
08/08/2023, 3:07 PM@Kishore Nallan
With infix parameter, for
Copy code
eg. query -> rel fut
and: document -> Reliance-FutureSidharth Aggarwal
08/08/2023, 3:48 PM@Kishore Nallan
How many input tokens will be searched in the scenario of INFIX.
Copy code
eg. query -> rel fut
Will both rel & fut be searched in the fields?k
Kishore Nallan
08/08/2023, 3:52 PMwill it match both rel & fut in the document?Yes it will.
Kishore Nallan
08/08/2023, 3:53 PMYou can play around with it to get a feel. Some additional details here under the
infixs
Sidharth Aggarwal
08/08/2023, 3:54 PMTo how many tokens INFIX will be applied?
Sidharth Aggarwal
08/08/2023, 3:54 PMIs it possible to connect over a short huddle?
k
Kishore Nallan
08/08/2023, 3:55 PMAll tokens
s
Sidharth Aggarwal
08/08/2023, 3:57 PMIn our scenario, we are not getting the top matches based upon the both the keywords
Sidharth Aggarwal
08/08/2023, 3:58 PMIdealy for below example,
Copy code
eg. query -> rel fut
and: document -> Reliance-Futurek
Kishore Nallan
08/08/2023, 4:03 PMDifficult to say without looking at the overall dataset, your schema and query etc. We do community support in a public slack channel so other users who might be looking for similar information find this conversation helpful. Here's more info if you need private/prioritized support when self-hosting: https://typesense.org/support/
s
Sidharth Aggarwal
08/08/2023, 4:07 PMSure Thanks @Kishore Nallan
Sidharth Aggarwal
08/08/2023, 4:09 PMOne last query @Kishore Nallan
Is there any feature to apply
prefixSidharth Aggarwal
08/08/2023, 5:03 PM@Kishore Nallan
Can you please further guide me on the ngram solution
k
Kishore Nallan
08/09/2023, 5:33 AMThe ngram solution is pretty much what I've described above. You generate ngrams of words in a field and store them as a string array field in Typensese and then search on it.
s
Sidharth Aggarwal
08/10/2023, 5:53 AM@Kishore Nallan
Thanks a lot for suggesting a great solution. Most likely it will solve the problem in our use-case.
👍 1