#community-help

Controlling Direction of Dropped Tokens in Queries

TLDR Dima wants to control the direction of dropped tokens, while Kishore Nallan says it's not possible and advises creating a GitHub issue for a feature request.

Powered by Struct AI
Jun 23, 2023 (5 months ago)
Dima
Photo of md5-1b62114a658b760944aa7d2b4c274460
Dima
10:02 AM
Hi team! Can I control the direction of dropped tokens? We found that our users may add something like “source” at the start of the query, e.g. “site_name title of the document” because they think that it will improve search quality 😢

So dropping tokens from the end requires more steps
Kishore Nallan
Photo of md5-4e872368b2b2668460205b409e95c2ea
Kishore Nallan
10:09 AM
No that's not possible, can you please create an issue on GitHub. Happy to track it as a feature request.
Dima
Photo of md5-1b62114a658b760944aa7d2b4c274460
Dima
10:43 AM
Got it, Kishore 🙏 One more question: does exhaustive_search also drop tokens from end to start of the query?
Kishore Nallan
Photo of md5-4e872368b2b2668460205b409e95c2ea
Kishore Nallan
10:44 AM
Yes