DOES TYPESENSE HAVE `POINT IN TIME RECOVERY` for T...
# community-helpb
Babin
10/06/2023, 9:27 PMDOES TYPESENSE HAVE
POINT IN TIME RECOVERYj
Jason Bosco
10/06/2023, 9:27 PMNo, Typesense does not have point in time recovery
b
Babin
10/06/2023, 9:28 PMDo you have any alternate solution ?
Babin
10/06/2023, 9:29 PMCan we configure in our own Cluster, if we configure it ourselves
j
Jason Bosco
10/06/2023, 10:47 PMWhen you self-host, you can periodically run snapshots and save that in some persistent storage. But you'd need write a cron job that triggers these snapshots.
In Typesense Cloud, we take snapshots internally when cluster configuration is changed. But we don't expose these snapshots to you
Jason Bosco
10/06/2023, 10:47 PMCould you elaborate on your use-case for needing these snapshots?
Jason Bosco
10/06/2023, 10:48 PMUsually, since Typesense is only meant to be used as a secondary datastore, you'd only need to run backups on your primary data store
Jason Bosco
10/06/2023, 10:48 PMand for the search index, you'd typically just resync the data from your primary datastore as a disaster recovery option in the worst case
b
Babin
10/06/2023, 10:50 PMWe have 2 million record in Ts. We load to Ts via AWS Stepfunction. As part of data correction we are correcting certain indexed fields. My concern is, if for some reason if we corrupt the half of it, 1 million records, what’s the quickest way to rollback to previous data in Ts.
Babin
10/06/2023, 10:52 PMYou guys can look at Point In Time Recovery for future release for some additional cost. I believe lot of customer would pay that instead building and incurring cost for their own custom recovery implementation. IMHO
j
Jason Bosco
10/06/2023, 10:53 PMAs part of data correction we are correcting certain indexed fieldsI'd recommend storing the corrected data in your primary datastore first (Postgres / MySQL, etc) and run backups on that as needed. And then separately, run a process to sync the corrected data from your DB into Typesense.
Jason Bosco
10/06/2023, 10:53 PMThis way, you're not storing the only copy of the data in Typesense
Jason Bosco
10/06/2023, 10:54 PMYou guys can look at Point In Time Recovery for future release for some additional cost. I believe lot of customer would pay that instead building and incurring cost for their own custom recovery implementation. IMHOIf we had a feature like this, how frequent would you want the snapshots to be? Would once a day suffice for eg?
b
Babin
10/06/2023, 10:55 PMWe are already doing it. However we are building a AWS SAM implementation to export and import to Ts, w/ S3.
Babin
10/06/2023, 10:55 PMThank you so much for your ideas. We will explore more on this and if come across some question, we will reach out to you.
👍 1
j
Jason Bosco
10/06/2023, 10:59 PM@Babin Question for you: If we had a point in time restore feature in Typesense Cloud, how frequent would you want the snapshots to be? Would once a day suffice for eg?
b
Babin
10/07/2023, 5:07 AMPerhaps once in a week.