Modifying ThreadPool Size in TypeSense Server
TLDR Sidharth asked about modifying the thread-pool size constant in TypeSense server. Kishore Nallan explained it can be set to any desired value based on server specs. Optimal configuration depends on data and querying specifics.
Jun 22, 2023 (5 months ago)
To improve the threading within TypeSense server, how can we modify the following parameter,
--thread-pool-size false Number of threads used for handling concurrent requests. Default: NUM_CORES * 8
• Is it possible to modify the constant which is 8 in the default case ?
• If yes, what is the limit to which we can increase it? Which metric is used to tune this value?
Kishore Nallan06:22 AM
For example some one is aiming for 2000 - 3000 RPS then
what would be the optimal configuration of the infra in terms of CPU & RAM and what should be a thread-pooling value
Kishore Nallan07:24 AM
Indexed 3015 threads (79% resolved)
Changing Thread-Pool-Size on a Live Server
Robert inquired whether it was possible to change thread-pool-size on a live server. Jason suggested a method, but it didn't work. Robert highlighted a potential bug affecting the server performance.
Addressing Typesense Server Issues and Optimization Needs
Robert had an issue with a 'stuck' typesense server. Jason and Kishore Nallan gave advice on handling writes, configuration for high search volumes, and running multiple typesense instances. They also recommended monitoring CPU usage and updating the server version for bug fixes.
Deciding on Burstable CPUs for Production
Bill initially inquires if burstable CPUs are useful for production. Jason advises that they are not for heavy traffic. Bill also asks about cost and firewall settings. Jason and Kishore Nallan help clarify these topics.