https://typesense.org logo
Join Slack
Powered by
I was just looking at the cluster issue you emaile...
# community-help
j
I was just looking at the cluster issue you emailed about
👀 1
a
Writes are working, reads are not 😱
j
So strange
a
Feeling like something is up, because at the beginning, reads and writes were not working, but writes are returning successfully. Seems I can’t create/destroy indexes. The worst part is I can’t log in to the cloud portal, because I’m locked out of my github account from missing 2FA tokens 🤯 (that’ll get fixed in a couple days haha)
j
Found the issue, it looks like the OS ended up killing the Typesense process due to resource constraints, and after several successive restarts and crashes it stopped trying to restart the process back up
I'm guessing you might have been able to write in the brief moments when the process had started back up, before it crashed again due to resource constraints
May I know what size of a dataset and number of collections you were trying to index?
a
Any ETA on how long it will take to resolve? Did I just put too much data in this small cluster?
j
Did I just put too much data in this small cluster?
Yeah, that's likely the issue
a
I created a lot of collections, each with not very much data
I was just using this to test the new serivce I was spinning up (constantly destroying/recreating data, but just in postgres, not cleaning up the cluster)
You can flush all the data in the cluster
j
That's definitely the issue. Till v0.19 we create 4 threads per collection, so with sufficient collections, it will max out the OS threads limits on the cluster you have
In v0.20 we're switching to a thread pool model, which will allow for more efficient (re)use of threads even on small clusters
You can flush all the data in the cluster
Ok cool, this will resolve the issue right away
a
👍 , are you willing to flush all of the data out of the cluster? I shouldn’t be creating a ton of collections in the future
j
Yup, I can flush the data
🙌 1
a
(I’m actually shifting focus to ecommerce, so really a lot of documents in one 
products
collection
Thanks dude!
👍 1
j
Let me know if you'd also like me to upgrade your cluster to v0.20. So if you do need to create a ton of collections, the upper limit of the number of collections you can create will at least be increased on the same cluster size, because of the shared thread pool
a
V0.20 is out?
j
No, I have a nightly RC build
We're still working on a few features before we can release it publicly
a
yeah let’s stick with 0.19, def was just wiping my db, and creating a new collection in typesense every 20 minutes or so over the past couple of days while building, that won’t happen again
Nightly builds scare me
j
Ha ha, ok!
Alright, your cluster should be back up
a
`Typesense:Error:RequestUnauthorized (Forbidden - a valid 
x-typesense-api-key
header must be sent.)`
j
You'd need to regenerate a new API key
a
hmm
j
Old API keys would have also been wiped out with the data wipe, sorry if that wasn't clear
Oh shoot, you said you don't have access to the cloud console because of Github login 😞
a
Would you be willing to shoot me a regular one and a search one in a private message 😬 ?
j
Alright, only because you asked! Could you send me your GPG public key? For the record, (for others who might be reading this in the future), our standard policy is to not access customer clusters and data on Typesense Cloud clusters, unless specifically asked by customers like above.
If you're on a mac, I'd recommend this GUI-based GPG tool: https://gpgtools.org/
a
Copy code
-----BEGIN PGP PUBLIC KEY BLOCK-----

mQGNBGBKacQBDADSGCqUaKPL4IKtCzV/cUN+DL7cT1z8DszIYYAQsproKzBgqJnH
c/6MOqrqBg2u+fXNaJ9YKSNyGZb5NPpZuMv3vRkkjyjdZHmNcF67HeKBlXgvFmzN
6uIU0U64fQOlE7Qf1K0s9CPY2o3vPoDZ+u2YfaYor0Wd4dgYNBrK5+xnXB93g2NI
S9wyqPCXGEmOg8YAXkHdBF1lLvGBAv9PHeQ6a+BGy7NBqAyUcOvu+SMAuccHRExn
ty4losnpO0cDMfIG9WtLcfrbtds0h4QPrPeZvV0rC/Nx3mPDHwpxRGJ7Q//EU4hm
msIKZt3FjlRXhBSurSJO7uGeLp/kQI7fM4KxzROHPnRxhhYGo9KXimnN/1HC+kvM
4wW6KEHnpNZVCZSdexafXqx7jfwgOVdtKkvmiOkRBjySQcn5UmUrUOcmhKfehGrE
kvQMYeP9r+K6zG9sB7XNaxMskzol5iL/JKmrawUuGvCvG9MvTlnc6BNBSy13vL11
C1lQw2Bi70mqW0sAEQEAAbQfYW5kcmV3IDxhbmRyZXcuZGVudGFAZ21haWwuY29t
PokB1AQTAQgAPhYhBCpg+e8BNVYAf16MUJOUukY9oGenBQJgSmnEAhsDBQkAA/SA
BQsJCAcCBhUKCQgLAgQWAgMBAh4BAheAAAoJEJOUukY9oGen5EAMAK6b075z5jkW
YaLW+50N7n/3yDRHktrF+cz2S0mT2CnSK4fCiYIMaoQ0eCHE7ARyYRnt+0BK1Tp8
4ReWPcj2e4VOWzzWSF7k4VDs5PqGLZ149A3+Ia9ZYzc4sN1gsEShKc1FBUZOcGEQ
wl3W/g2ChaqubEGkD5AlyRuW3em1ZL6wEIKnFk82vVE0XWACQtYkMlh0JEBQnd62
9K25nBTv8EIPOAy1g1FTa1PSS3TXlHaWdSUHKGy984zdK2YEB1MHqRiqi6oh5pO2
Kd+8Yn12+v7wk2//j1LDZUVBwwAvkm1rIQtZpojOc+Jo8VLhoFwQ0lIG8Wv6RBWp
G4tQxelb0/dWFcxL/7JIYtSmXYuKHAF2wKHA4iOkUbx5ARE3hDiZ8sqSghB6QwPR
djCYW+Ay36rOwhaMnoz/9kUG6mdSRLyhLKLh302R/o2sngrxL6Akwhh/frG9XqUq
Tb6W4kSz5ZxJArlkdhd58RqZ6HoZhkl1crN98UySkjTwcvKEaK/kXrkBjQRgSmnE
AQwAwUyd+9k5hoeVtIdASHIxkAS3yJjIm/RaP4Vkqbh6X2YgVeRKIDnyOB9uVk7Q
WvtLVsYopEBg35R/uzW/nwk/LYMob0BZDyIx3xEqXke83eY3p0qQrouDiSO7Hjsb
9oqzxsEP5CBg2nwdVXMfY3LhtHu9N7MpCij4sGcjYeCrxhB/LtbCy1FGC502u8C7
qhU42mCThmJq+m7zVMAvVOyq+FvuHHLTisFWmhXxDpTFol0qCvI4QJSYExkEApVM
CTdWi/J+rW1O7xhrXuC3Q/Mh9z6Ee4s2hPKMdqJP3BFp+JeVcwQ1c7YqUbPmfhaC
wV1c33qdMwhI273vfYKoxwvDjQcTpuqcRBHkcnuN0b8OfsH8P3KgrQVBH92NxMMv
DMY2riB6Qjuj4cKSrWrQLx6mC3f1siQSQOdJHku5rQ9jXGjygXoAKj0Cpz19XG2B
O6k+1hlq3Jr8eti+qW1y7c6g6hL+35tvv15RdOvItow9M3kmxhtfeLK/qYAbfx7O
dbBxABEBAAGJAbwEGAEIACYWIQQqYPnvATVWAH9ejFCTlLpGPaBnpwUCYEppxAIb
DAUJAAP0gAAKCRCTlLpGPaBnp/bMDAC5lK1eeualAhLmxOI+8zD7nfnEDO0ys+om
QcrpOrAHPqvRxScQk1rRU3Gnzx8kn14nV/5tOFfw169EQ6/aE02jWbTLJFKk/s2l
83eOl9FGRvFPpXGPME66qsyNaNMFGBzYiFHr8F859qBd+slwA8rELlTCSScK2fYY
9TcNYssjnLMeDxNhhyzZk6HpTHFXeEJZiOkMccn0hcHbA7CSkvzw3dqq88xTHCRq
UDUGx7ZcZgSzWymeByVJ0OeF071/TWb8735jirEncDu5p6YUHwJDxcB5LpNtVka0
YjdL/Eo1TlETI4f+r069mGH4EX2YTMYhV8dbtTY68RFXxwdrMkvAjAWIm4Fcx6/o
YS1KOfKT4SYlD18/6PIPsLXJdrAa2T7KuAtre7gWAUwrwzhoTPUR0XZmIiFLpEzJ
4Uq40tINX0vnNszJcQQAkdjGwebWEdznasSWsqUCLxtnqFr1dEszEl/NYf6ywqwA
/vmrlvkBeRkxk78bUnaA4tveLI3+xHU=
=YAj+
-----END PGP PUBLIC KEY BLOCK-----
👍 1
j
Cool, I'll reply to your email with the encrypted keys
🙌 1
a
thanks dude!
j
Happy to help! Emailed you
Open in Slack
PreviousNext
Powered by