Syncing Primary Data Store and Typesense
TLDR bnfd asked how to sync primary data store and typesense. robert suggested syncing via API level and considering ORM middleware. Kishore Nallan proposed an ORM hook or use of a queue and daemon, and mentioned the option of running a cron for less frequent updates.
4
Aug 18, 2022 (14 months ago)
bnfd
07:51 PM
robert
08:57 PM/api/model i then sync the index for model too.3
robert
08:58 PMAug 19, 2022 (14 months ago)
Kishore Nallan
01:42 AMOne way to overcome that is to write to a queue and then have a daemon that reads from queue and indexes into Typesense.
If the updates are not frequent, you could essentially run a cron every 10 seconds to query for updates from the database and index into Typesense as well.
1
Typesense
Indexed 2779 threads (79% resolved)
Similar Threads
Managing Typesense Across Large Datasets
Phillip inquired about best practices with Typesense for large datasets. Ross shared personal practices, and Jason confirmed Typesense isn't designed to be a primary datastore. Patrick shared a related discussion link. Viji mentioned using DynamoDB Streams as an option.
Efficient Dataset Creation and Maintenance in Typesense with React
sonu asked about Typesense dataset management in a React project. Nick shared their solution using a postgres database, cron, and the import endpoint. Kishore Nallan suggested updating Typesense whenever MySQL data changes and explained primary databases' role. The dataset file would reside with Typesense, not affecting the front-end load time.
Discussing Data Changes and Typesense Update Methods
sonu asked about the efficient way to manage database updates in Typesense. Kishore Nallan suggested a cron-based approach or to queue updates, along with idea of 'is_deleted' flag to handle deletion.