We tend to see a pretty strong relationship betwee...
# community-helpt
Todd Tarsi
10/19/2023, 5:28 PMWe tend to see a pretty strong relationship between pending write batches and CPU throttling. Would anyone have recommendations on like write rates to aim for on specific clusters for this stuff, or how they reduce the overhead of writes? Would removing faceting from fields get us significant reductions here, that sorta thing?
j
Jason Bosco
10/19/2023, 5:57 PMBatching multiple writes into a fewer API calls using the import endpoint would give you the most write performance gains
Jason Bosco
10/19/2023, 5:57 PMI would recommend at least 1K writes per API call (and then increasing the client-side timeout)
Jason Bosco
10/19/2023, 5:57 PMMore on that topic here: https://typesense.org/docs/guide/syncing-data-into-typesense.html#handling-http-503s
Jason Bosco
10/19/2023, 5:58 PMBesides that, indexing time is indeed proportional to the number of fields in the schema, whether faceting is enabled for a field, whether sorting is enabled for a string field, if characters specified in token_separators end up leading to a lot of words, etc
t
Todd Tarsi
10/19/2023, 6:47 PM@Jason Bosco - Thank you for this advice! Wow, we are typically doing one write per API call usually 😅
😄 1
Todd Tarsi
10/25/2023, 4:56 PM@Jason Bosco - We have been doing some troubleshooting and picking up some low hanging fruit, and our write performance is already looking amazingly better. Thank you for all of your help and advice, and of course an amazing product!!!
🎉 1
🙌 1
j
Jason Bosco
10/25/2023, 5:51 PMThat's great to hear! Happy to help