Welcome to Portkey Forum

Updated last month

Avoiding Semantic Cache Issues with Vision Messages

At a glance
I'm running into an issue with vision messages that every image message hits the semantic cache. Obviously that's really bad because it will return text that is based on a different image.

How do I get around this?
V
2 comments
Hi @Gijs thanks so much for reporting this. Confirming that this is an issue and we'll pick it up on priority this week and let you know once it's resolved.

cc @b4s36t4
In the meanwhile we fix this @Gijs, a stopgap might be to force refresh the cache everytimg you send a new image.
Add a reply
Sign up and join the conversation on Discord