Understanding Firestore Extension's Backfill Functionality
TLDR David asked about the backfill process of the firestore extension for different collections. Jason detailed the default backfill behavior and suggested running the backfill from a local computer for large collections to avoid function timeouts or memory issues.
1
Oct 21, 2023 (1 month ago)
David
09:20 AMJason
04:54 PMBut the 3rd point here describes how to backfill a single collection: https://github.com/typesense/firestore-typesense-search#step-3%EF%B8%8F⃣--optional-backfill-existing-data
David
06:10 PMOct 23, 2023 (1 month ago)
Jason
04:26 PMYeah
Jason
04:27 PMDavid
06:14 PMJason
06:15 PM1
David
06:17 PMJason
07:26 PMTypesense
Indexed 3011 threads (79% resolved)
Similar Threads
Issue with "Search Firestore with Typesense" Extension
Rajbek had an issue synchronizing data between Firestore and Typesense collection. Jason helped diagnose the issue and the problem was resolved by Rajbek increasing the memory allocation of the specific cloud function.
Discussing Firestore Extension and Collection Schema in Typesense
Loic asks about settings in Firestore Extension and experiences issues with the collection schema in Typesense. Discussion with Jason is ongoing.
Updating Bulk Records and Resolving Typsense Issues.
Greg inquired about updating bulk records. Jason proposed using the documents/import endpoint for bulk updating, identified issues with Typesense, and provided solutions. Greg appreciated the assistance. Conversation related to the procedure was shared with Viktor.
Syncing records issue from BigQuery to Typesense using Airbyte
Jamshid had a problem syncing records from BigQuery to Typesense via Airbyte, with only a partial number of records syncing. Jason suggested checking AirByte logs for Typesense API responses. They found an issue with BigQuery's connector on Airbyte handling repeated fields and concluded to consider building their own sync script to mitigate the situation.
Collection-Level Scoring in Typesense Multi-Search
Mile questioned the possibility of collection-level scoring in Typesense. Jason advised adjusting scores client-side, and requested Mile to create a GitHub issue to assess community interest.