Realtime Synchronization of Postgres DB with Typesense
TLDR Ahmad asked how to sync Postgres DB with Typesense in real time. Kishore Nallan suggested handling it through the application layer, using queues and lambdas, or running daily dumps.
Dec 14, 2021 (25 months ago)
I want to add realtime syncronization of postgress db with typesense. how is it possible ?
Dec 15, 2021 (25 months ago)
Kishore Nallan02:30 AM
For e.g. you can write to a queue like SQS and then have a lambda that indexes the change into Typesense. Or you could even call Typesense directly right after the DB operation is made.
Another approach is just running daily dumps if the data does not change often.
Indexed 3015 threads (79% resolved)
Syncing Typesense and PostgreSQL
Akbar is a beginner at Typesense and asks for documentation on syncing it with PostgreSQL. Jason states they are not aware of such a thing, but offers information on uploading documents from Postgres to Typesense.
Managing Typesense Across Large Datasets
Phillip inquired about best practices with Typesense for large datasets. Ross shared personal practices, and Jason confirmed Typesense isn't designed to be a primary datastore. Patrick shared a related discussion link. Viji mentioned using DynamoDB Streams as an option.
Syncing PostgreSQL with Typesense using Debezium or Airbyte
Thomas asked for advice on syncing PostgreSQL with Typesense using Debezium or Airbyte. Jason suggested looking into Airbyte, but the issue remained unresolved as Thomas experienced issues with integer data types.