Airbyte MySQL Connection Timeout with Typesense
TLDR Jamshid reported a connection timeout issue using Airbyte for MySQL and typesense. Jason suggested it could be due to a low client-side timeout in Airbyte.
Jun 09, 2023 (6 months ago)
"internalMessage" : "('Connection aborted.', timeout('The write operation timed out'))",and also says:
"externalMessage" : "Something went wrong within the destination connector",
Does typesense cloud has some sort of timeout constraint?
Indexed 3015 threads (79% resolved)
Airbyte Timeout Issue with Typesense Sync
Jamshid experienced timeouts when syncing MySQL records with Airbyte. Jason suggested it's related to an Airbyte issue, leading Jamshid to create a custom Typesense connector to resolve the problem.
Airbyte Connector for Typesense Integration and Issue Resolution
Cirdes shares the creation of an Airbyte connector for Typesense, later experiencing timeout issues with large-scale data synchronization. Jason provides solutions for adjustment of timeout thresholds and batch sizes, successfully resolving the issue.
Syncing records issue from BigQuery to Typesense using Airbyte
Jamshid had a problem syncing records from BigQuery to Typesense via Airbyte, with only a partial number of records syncing. Jason suggested checking AirByte logs for Typesense API responses. They found an issue with BigQuery's connector on Airbyte handling repeated fields and concluded to consider building their own sync script to mitigate the situation.