@Jason Bosco thank you for the suggestion!
Just had another thought that would like to check with you - if we say we do an
exhaustive_search
for words say less than 5-6 length and then do a search with the threshold configured for words longer than that, would that be a good middle ground solution for collection with data size we have?