Does Typesense cloud have SSDs or HDs?
# community-helpa
A Z 1 B
07/12/2021, 5:24 AMDoes Typesense cloud have SSDs or HDs?
j
Jason Bosco
07/12/2021, 5:24 AMSSDs
Jason Bosco
07/12/2021, 5:24 AMThere's another special type of SSD called NVMe SSDs which is an option when you have a high availability instance (called high performance disk)
a
A Z 1 B
07/12/2021, 5:25 AMsmall thing, might want to consider updating the text/copy where it says “Regular Disk” under configruation
A Z 1 B
07/12/2021, 5:25 AMto say SSD
A Z 1 B
07/12/2021, 5:25 AMany idea on how much NVME impacts performance for typesense? its already pretty fast sub 25ms results
j
Jason Bosco
07/12/2021, 5:25 AMAh, good catch. Will update that
k
Kishore Nallan
07/12/2021, 5:26 AMI think for datasets where the doc size is small, the performance difference will be negligible.
j
Jason Bosco
07/12/2021, 5:26 AMPerf improvement will depend on the dataset and the number of fields in each document
k
Kishore Nallan
07/12/2021, 5:26 AMI/O is not typically the bottleneck for Typesense. CPU is.
👀 1
a
A Z 1 B
07/12/2021, 5:26 AMIs there a way I can calculate the resources needed for typesense? I’m considering launching a user-facing feature that will interface with typesense directly and don’t know what i will need
A Z 1 B
07/12/2021, 5:27 AMalso - is it possible to obfuscate the “url” on the client side and/or the key, or is that not needed/security theater?
j
Jason Bosco
07/12/2021, 5:29 AMIf you can share the number of records, approximate size of each record and estimated traffic per day, I can help estimate
a
A Z 1 B
07/12/2021, 5:29 AM~20k total records, across ~4 collections
~1k users per day maximum
education based, searching for questions mainly
j
Jason Bosco
07/12/2021, 5:29 AMalso - is it possible to obfuscate the “url” on the client side and/or the key, or is that not needed/security theater?It's fine to expose both of these publicly... They're designed that way.
a
A Z 1 B
07/12/2021, 5:30 AMof course i understand that - but is it possible?
j
Jason Bosco
07/12/2021, 5:31 AMYeah a few users put the hostnames behind Cloudflare for eg for DDOS protection for eg
a
A Z 1 B
07/12/2021, 5:31 AMdoesnt that have a sizable or material hit on network performance?
A Z 1 B
07/12/2021, 5:31 AMor is that a tradeoff for security/reliability
A Z 1 B
07/12/2021, 5:31 AMif you guys have any documentation on that would appreciate. thanks
j
Jason Bosco
07/12/2021, 5:32 AMIt's a tradeoff... But it's not too big a hit from what I saw in my benchmarks. Cloudflare also keeps persisitent connections open to origins, so that helps minimize impact
✅ 1
Jason Bosco
07/12/2021, 5:32 AMIf you search this Slack for Cloudflare, you'll find instructions on how to set this up
🙌 1
Jason Bosco
07/12/2021, 5:32 AM~20k total records, across ~4 collections
~1k users per day maximumAnd size of each record?
a
A Z 1 B
07/12/2021, 5:33 AM~60-240 characters for the main searchable attribute
j
Jason Bosco
07/12/2021, 5:35 AMAh ok, that's a total dataset size of ~5MB. Typesense usually takes 2-3x memory, so that's 15MB of RAM worst case to index that data, which is well within the 512MB RAM config.
2vCPUs should be more that sufficient to handle 1k users per day.
Jason Bosco
07/12/2021, 5:36 AMThe only think to be aware of is that the base config (512MB RAM, 2vCPU) has a burst time of 1 hr every 24 hours. Meaning if any operation (search / indexing) pegs CPU for 1 hour, it will get throttled for the next 24 hours and then it resets.
Jason Bosco
07/12/2021, 5:37 AMIf that's not preferred, then you want to pick a non-burst vCPU config
➕ 1
a
A Z 1 B
07/12/2021, 6:10 AMDo you guys have plans for dedicated CPU core instances?
k
Kishore Nallan
07/12/2021, 6:10 AMWe already have them.
a
A Z 1 B
07/12/2021, 6:11 AMokay will look into them further - thanks
A Z 1 B
07/12/2021, 6:12 AMthe lowest dedicated cpu config starts at 115 per month, correct?
k
Kishore Nallan
07/12/2021, 6:15 AMCorrect but the burst CPU provides cumulative dedicated cpu that might just be fine for many apps. It's only an issue if cpu pegs at 100% totally until credits expire.
Kishore Nallan
07/12/2021, 6:17 AME.g. 2 gb ram / 2 vcpu burst option provides upto 4 hours of dedicated burst capacity. If your basline cpu load is only 15-20% that's enough for whole day. This will be a function of concurrent searches per second.