Handling High Volume of Updates with Typesense

TLDR Ahmad inquired about the ability of Typesense to handle 10-100k updates every 5 minutes. Jason confirmed Typesense can handle such volume with adequate CPU capacity and usage of the bulk import endpoint.

Powered by Struct AI
Join the chat
Nov 08, 2022 (11 months ago)
Photo of md5-4a6338a1d6016269c9f234fc1a133144
07:47 PM
Can typesense handle 10-100k updates every 5 minutes? We’re attempting to add last_active timestamp into our typesense datastore every 5 minutes and would like to know if this is something that would scale well ?
Photo of md5-8813087cccc512313602b6d9f9ece19f
07:50 PM
I just responded to the same query someone else from your team emailed about 🙂

Copy-pasting my response here:

Typesense should be able to handle that volume of updates, provided that you have sufficient CPU capacity and also that you use the bulk import endpoint to send all the 100K changes split over say 5-10 API calls, with a client-side timeout as high as 30 minutes for each API call.