Full Text Search Across Long Books: Chunking vs. Single Document
TLDR Epi asked about providing FTS for long books. Kishore Nallan suggested breaking the books into chunks for better performance and query results.
Dec 03, 2022 (9 months ago)
Dec 04, 2022 (9 months ago)
Kishore Nallan12:48 AM
Indexed 2764 threads (79% resolved)
Discussing Large Document Indexing in Word Files
robert asked about indexing large word files. Kishore Nallan advised splitting into smaller documents for improved performance.
Optimal Indexing and Querying of Large Documents
Robert asks about the best practice for indexing large documents and the ideal size of subdocuments. Jason suggests experimenting with 10K words in a single document and performance testing.
Addressing TS Cloud Highlight Issues
Orion expressed concerns about TS Cloud's highlight handling in large documents. Kishore Nallan suggested a workaround by segmenting long texts into smaller documents.