Anybody getting Memory limit exceeded when backfil...
# community-help
n
Anybody getting Memory limit exceeded when backfilling data through Firestore with Typesense extension? Trying to backfill 150K documents, but it just stops; the issue is with the cloud function (i bet), not the Typesense cluster.
k
Can you please post the exact error message?
n
Errors I see on cloud logs for the extension.: Warning: "The request was aborted because there was no available instance. Additional troubleshooting documentation can be found at: https://cloud.google.com/functions/docs/troubleshooting#scalability" Error: "Function invocation was interrupted. Error: memory limit exceeded." Backfilling works but fails after a few records ("few" can range from 10 to 500 docs). If I trigger false, then true the "backfill" document it starts then fail again.
k
Looks like we've had others run into this limitation, probably because of the size of documents hitting the memory limits for the function: https://github.com/typesense/firestore-typesense-search/issues/10
The last comment on that thread talks about a work around.
n
Thanks! Looking at this now. Will update.
👍 1