#community-help

Issues and solutions regarding Typesense Updates

TLDR Yoshi faced issue in updating a field in Typesense. Jason communicated this as being due to a blocking operation by in-place schema migration and recommended using the alias method.

Powered by Struct AI

1

Oct 12, 2023 (1 month ago)
Yoshi
Photo of md5-9e27fed7af6568f2c8abff36e7e9da4d
Yoshi
06:25 PM
Hey all, I just tried to update a field on my collection in order to change it to sort: true, but having done so seems to have crashed Typesense. Latency is way up, and is always times out. Monitoring says it’s still healthy though…
Jason
Photo of md5-8813087cccc512313602b6d9f9ece19f
Jason
06:27 PM
Doing an in-place schema migration is a blocking operation... So all reads / writes will be blocked until the operation is complete
06:28
Jason
06:28 PM
We've improved this in the upcoming version of Typesense (v0.26) so it only blocks writes
06:28
Jason
06:28 PM
Until then, I'd recommend using the alias method to change the collection schema in a zero downtime way
06:29
Jason
06:29 PM
For the issue at hand, I can confirm that the nodes are still executing the alter command
Yoshi
Photo of md5-9e27fed7af6568f2c8abff36e7e9da4d
Yoshi
06:29 PM
I see…ok. How long does this operation generally take to complete for a collection of ~900k elements?
06:29
Yoshi
06:29 PM
And do you have a general target of when 0.26 will be released?
Jason
Photo of md5-8813087cccc512313602b6d9f9ece19f
Jason
06:32 PM
Looks like each round of modification takes about 20 minutes for your dataset, and I see multiple alters running one after another
06:33
Jason
06:33 PM
We're probably at least two months out from a 0.26 GA release... But we have users using the RC builds in production already. Although the latest RC build has a known performance regression when using group_by. We're working on addressing that, but otherwise it's useable
06:34
Jason
06:34 PM
The alter seems to have completed now
Yoshi
Photo of md5-9e27fed7af6568f2c8abff36e7e9da4d
Yoshi
06:34 PM
Cool, seeing data come through again. Sincerely appreciate the fast responses and detailed answers, thank you

1

Typesense

Lightning-fast, open source search engine for everyone | Knowledge Base powered by Struct.AI

Indexed 3015 threads (79% resolved)

Join Our Community