For traditional caching, yes. But semantic caching...
# community-help
m
For traditional caching, yes. But semantic caching would understand the meaning behind the user query, e.g. comparing its vector to ones stored in a semantic cache, and if there is one similar query already, we don’t need to execute the search but return the previous response. For example, queries like ‘What is the minimum spend to qualify for free delivery?’ and ‘What is the minimum order to get free delivery?’ would be treated as semantically the same, allowing the cached response to be used for both.