#community-help

Performance Degradation in Version 0.26.0.rc20-arm64

TLDR John and Dima reported performance decrease in version 0.26.0.rc20-arm64 of software, mainly with group_by queries. Kishore Nallan promised to investigate the problem.

Powered by Struct AI

1

Sep 26, 2023 (2 months ago)
John
Photo of md5-21545f1facb7836c149bc4c70752bd2b
John
07:56 PM
Seing quite large performance degradation trying out 0.26.0.rc20-arm64 locally, compared to both 0.25.0.rc30-arm and 0.25.2.rc1-amd64. Queries without facet_by go from ~50ms to ~90ms and queries with many facets go from ~150ms to ~700ms. Let me know if you need any help reproducing this (hoping you might already know what could be causing this without having to reproduce 😅 )

On another note, we would love to improve on the 150 ms response time, is that just something to accept when you have ~17 facets and max_facet_values=100, or is there anything we can do here?
Kishore Nallan
Photo of md5-4e872368b2b2668460205b409e95c2ea
Kishore Nallan
11:48 PM
Hi John, we are actively working on 0.26. Can you please share your dataset (via DM) and query with us so we can investigate?
Sep 27, 2023 (2 months ago)
Dima
Photo of md5-1b62114a658b760944aa7d2b4c274460
Dima
08:34 AM
Similar for me
John
Photo of md5-21545f1facb7836c149bc4c70752bd2b
John
08:55 AM
Here's a gist that reproduces it for me. It turns out that it's not faceting in isolation but the combination with group_by that causes it. In general using group_by seems to slow things down a lot, but the difference is much greater on 0.26.0.rc20

Here are the numbers I get on my machine:

0.25.0.rc30-arm:
> Mean time to search with group_by=True: 56.09 ms
> Mean time to search with group_by=False: 20.17 ms
0.26.0.rc20-arm64:
> Mean time to search with group_by=True: 354.52 ms
> Mean time to search with group_by=False: 9.44 ms
Kishore Nallan
Photo of md5-4e872368b2b2668460205b409e95c2ea
Kishore Nallan
09:57 AM
Dima are you also seeing slower times on group by queries?
Dima
Photo of md5-1b62114a658b760944aa7d2b4c274460
Dima
09:58 AM
I didn’t find a time yet to isolate the problem, but my query is also with group_by
Kishore Nallan
Photo of md5-4e872368b2b2668460205b409e95c2ea
Kishore Nallan
10:00 AM
Ok, I will look into what changes we did with group_by.

1

Oct 05, 2023 (2 months ago)
John
Photo of md5-21545f1facb7836c149bc4c70752bd2b
John
08:45 PM
Any updates here? Would really love to upgrade since there are so many other nice improvements 🙂

Typesense

Lightning-fast, open source search engine for everyone | Knowledge Base powered by Struct.AI

Indexed 3015 threads (79% resolved)

Join Our Community