Airbyte Timeout Issue with Typesense Sync
TLDR Jamshid experienced timeouts when syncing MySQL records with Airbyte. Jason suggested it's related to an Airbyte issue, leading Jamshid to create a custom Typesense connector to resolve the problem.
1
Jun 16, 2023 (6 months ago)
Jamshid
06:53 PMOur typesense cluster is 0.5 GB RAM, 2 vCPUs, Regular SSD, Single Node, Single Region.
I was wondering if these timeouts are because of our typesense resources.
Any thoughts?
Jason
07:50 PMJason
07:50 PMJason
07:51 PMJamshid
10:08 PMJun 20, 2023 (5 months ago)
Jamshid
10:14 PM1
Typesense
Indexed 3015 threads (79% resolved)
Similar Threads
Airbyte MySQL Connection Timeout with Typesense
Jamshid reported a connection timeout issue using Airbyte for MySQL and typesense. Jason suggested it could be due to a low client-side timeout in Airbyte.
Airbyte Connector for Typesense Integration and Issue Resolution
Cirdes shares the creation of an Airbyte connector for Typesense, later experiencing timeout issues with large-scale data synchronization. Jason provides solutions for adjustment of timeout thresholds and batch sizes, successfully resolving the issue.
Syncing records issue from BigQuery to Typesense using Airbyte
Jamshid had a problem syncing records from BigQuery to Typesense via Airbyte, with only a partial number of records syncing. Jason suggested checking AirByte logs for Typesense API responses. They found an issue with BigQuery's connector on Airbyte handling repeated fields and concluded to consider building their own sync script to mitigate the situation.