We basically have crons that refresh everything periodically at the moment. Some of these can be pretty easily optimized but our largest collection now has a ranking system that needs to periodically decay it's relevance score based on various criteria so needs to be regularly refreshed from our Clickhouse data.