#community-help

Discussing Maximum Words Per Field and Performance Impacts

TLDR robert sought advice on the performance impacts of large text fields in search response, and Kishore Nallan advised reading from disk would be slow. They also highlighted a limitation in Typesense.

17mo

Join the chat

Aug 04, 2022 (17 months ago)

Photo of md5-0ca37054c6c9042aa04fcfb92cc7d99c

robert

03:10 PM

When you say "no limitations" on maximum words per field, is there any research into performance impacts of say 10kb+ fields (not queried/faceted) on search response? Not worried about bandwidth concerns.

Photo of md5-4e872368b2b2668460205b409e95c2ea

Kishore Nallan

03:22 PM

Reading those from disk and sending over wire is going to be slow.

robert

03:23 PM

Makes sense. I'm gonna run some tests and report back here.

Kishore Nallan

03:24 PM

Another logical issue is that Typesense only provides one snippet per field (best matched highlighted text segment). Splitting docs will allow multiple snippets per document.

Typesense

Lightning-fast, open source search engine for everyone | Knowledge Base powered by Struct.AI

Indexed 3015 threads (79% resolved)

Join Our Community

Similar Threads

Discussing Data Retrieval in Typesense Cloud Tool

Ricardo inquired about the impact of using non-searched fields in data records with Typesense. Jason explained that all fields are fetched from the disk, even if unindexed, pointing out it might not affect performance, with the benefit of reducing separate database API calls.

33mo

Issues and Improvements in Typesense with 14 Million Records

Miguel experienced performance issues when using Typesense for large datasets. Jason suggested performance improvements made to Typesense since then and directed them to specific server-side parameters for better handling. Miguel agreed to try again.

19mo

Discussing Typesense Search Request Performance

Al experienced longer-than-reported times for Typesense search requests, sparking a detailed examination of json parsing, response times and data transfer. Jason and Kishore Nallan helped solve the issue.

33mo