#community-help

Discussing Maximum Words Per Field and Performance Impacts

TLDR robert sought advice on the performance impacts of large text fields in search response, and Kishore Nallan advised reading from disk would be slow. They also highlighted a limitation in Typesense.

Powered by Struct AI

1

Aug 04, 2022 (17 months ago)
robert
Photo of md5-0ca37054c6c9042aa04fcfb92cc7d99c
robert
03:10 PM
When you say "no limitations" on maximum words per field, is there any research into performance impacts of say 10kb+ fields (not queried/faceted) on search response? Not worried about bandwidth concerns.
Kishore Nallan
Photo of md5-4e872368b2b2668460205b409e95c2ea
Kishore Nallan
03:22 PM
Reading those from disk and sending over wire is going to be slow.
robert
Photo of md5-0ca37054c6c9042aa04fcfb92cc7d99c
robert
03:23 PM
Makes sense. I'm gonna run some tests and report back here.

1

Kishore Nallan
Photo of md5-4e872368b2b2668460205b409e95c2ea
Kishore Nallan
03:24 PM
Another logical issue is that Typesense only provides one snippet per field (best matched highlighted text segment). Splitting docs will allow multiple snippets per document.