#community-help

Modifying ThreadPool Size in TypeSense Server

TLDR Sidharth asked about modifying the thread-pool size constant in TypeSense server. Kishore Nallan explained it can be set to any desired value based on server specs. Optimal configuration depends on data and querying specifics.

5mo

Join the chat

Jun 22, 2023 (5 months ago)

Photo of md5-051f535431ff484f44f165e9a0b696a5

Sidharth

04:54 AM

Hello Team,
To improve the threading within TypeSense server, how can we modify the following parameter,

--thread-pool-size    false    Number of threads used for handling concurrent requests. Default: NUM_CORES * 8

• Is it possible to modify the constant which is 8 in the default case ?
• If yes, what is the limit to which we can increase it? Which metric is used to tune this value?

05:23

Sidharth

05:23 AM

Kishore Nallan

Photo of md5-4e872368b2b2668460205b409e95c2ea

Kishore Nallan

06:22 AM

The constant is used only in default. If you know your server specs you can set the thread pool size value to any number you want explicitly.

Sidharth

07:10 AM

Kishore Nallan Got it,

For example some one is aiming for 2000 - 3000 RPS then
what would be the optimal configuration of the infra in terms of CPU & RAM and what should be a thread-pooling value

Kishore Nallan

07:24 AM

It wholly depends on the size + shape of your data, the kind of querying, what kind of clustering is required etc. Difficult to provide a comprehensive answer without those details.

Typesense

Lightning-fast, open source search engine for everyone | Knowledge Base powered by Struct.AI

Indexed 3015 threads (79% resolved)

Join Our Community

Similar Threads

Changing Thread-Pool-Size on a Live Server

Robert inquired whether it was possible to change thread-pool-size on a live server. Jason suggested a method, but it didn't work. Robert highlighted a potential bug affecting the server performance.

14mo

Addressing Typesense Server Issues and Optimization Needs

Robert had an issue with a 'stuck' typesense server. Jason and Kishore Nallan gave advice on handling writes, configuration for high search volumes, and running multiple typesense instances. They also recommended monitoring CPU usage and updating the server version for bug fixes.

14mo

Deciding on Burstable CPUs for Production

Bill initially inquires if burstable CPUs are useful for production. Jason advises that they are not for heavy traffic. Bill also asks about cost and firewall settings. Jason and Kishore Nallan help clarify these topics.

19mo