#community-help

Indexing Time in Concurrent API Requests

TLDR Somesh noticed no improvement in indexing time when making concurrent API requests. Kishore Nallan suggested checking if their CPU usage was saturated, but Somesh needed clarification.

Powered by Struct AI
Nov 15, 2023 (2 weeks ago)
Somesh
Photo of md5-a9a351e11d64f05b41fec183816a0cda
Somesh
09:36 AM
I have tried making 3 concurrent request(import api) at once,the time taken is 42min for Indexing with auto-embedding with the batchsize of 350k.When I do 1 request the time taken is 46min,does adding more concurrent request doesn't effect Indexing time or am I doing something wrong?
Kishore Nallan
Photo of md5-4e872368b2b2668460205b409e95c2ea
Kishore Nallan
09:38 AM
Did you check it you were already cpu bound? Also was this on local machine or over the network?
Somesh
Photo of md5-a9a351e11d64f05b41fec183816a0cda
Somesh
09:46 AM
Over the network and may I know what do you mean by CPU bound
Kishore Nallan
Photo of md5-4e872368b2b2668460205b409e95c2ea
Kishore Nallan
09:47 AM
What the cpu usage saturated? You can use htop to check that.