Discussing Typesense Features: Complex Querying and Bulk Search
TLDR Tom inquired about the availability of complex Boolean filters and bulk search in Typesense Cloud. Kishore Nallan assured they are in progress, with a preview targeted for Q1 2022. Jason shared a workaround for ORs across fields.
1
Nov 23, 2021 (24 months ago)
Tom
02:06 PM• filter_by: are complex AND/OR Boolean filters on the roadmap? (I see you can OR from an array, and AND from different attributes, but curious about arbitrary/nested filters)
• Is a bulk search on the roadmap? Our workload allows for queries to be executed in batch, and with typesense being so fast I assume we could see speed gains by batching search requests to typesense
Note: very excited to see “result pinning” and “federated” - those are very very cool
1
Kishore Nallan
02:22 PMWe are certainly going to work on complex querying very soon. For bulk search, you can use federated / multi_search endpoint for that as well. However search queries in a multi search batch are executed serially so the main gain is from reducing network latency.
Tom
02:41 PMMulti_search - didn't know about that, I'll take a deeper look.
Reducing network latency - yes, this was exactly my goal. :)
Jason
04:39 PMTom
07:15 PMWe know the “complex filters” in advance, so it's not a blocker, but it would allow us to remove quite a bit of preprocessing during indexing when the search supports complex filters.
Tom
07:15 PMNov 24, 2021 (24 months ago)
Kishore Nallan
08:13 AM
Typesense
Indexed 2786 threads (79% resolved)
Similar Threads
Issue with Search Duration on Typesense Database
Robert reported an issue about query time delay when adding a `filter_by` constraint in a large Typesense database. Kishore Nallan explained that this happens due to the order of operation and also promised to look into this issue further. Robert withdrew his interest in sponsoring the improvement due to moving from the project.
Understanding Indexing and Search-As-You-Type In Typesense
Steven had queries about indexing and search-as-you-type in Typesense. Jason clarified that bulk updates are faster and search-as-you-type is resource intensive but worth it. The discussion also included querying benchmarks and Typesense's drop_tokens_threshold parameter, with participation from bnfd.
Discussions on Typesense, Collections, and Dynamic Fields
Tugay shares plans to use Typesense for their SaaS platform and asks about collection sizes and sharding. Jason clarifies Typesense's capabilities and shares a beta feature. They discuss using unique collections per customer and new improvements. Kishore Nallan and Gabe comment on threading and data protection respectively.