Welcome to Portkey Forum

Updated last month

Vertex Auth Flow: Token Retrieval and Usage

At a glance
Question about auth in the case of vertex. You have both options to have the acutal token passed as the api key or I see that also it can take the service account json file. In this case, it uses the google api to get a token. My question is: When you define a virtual key in the control plane, what is actually the flow? Does the token retrieval happen in the control plane and then its passed as api key to the gateway? or is the actual json passed so the retrieval happens in the gateway? Asking mostly to check if this is happening on every call as I dont see any caching of the token. Also is there any way to pass the json as a header or in the config object to test that part locally? Thanks!
1
s
r
e
6 comments
it's fetched everytime in the gateway, the token is not cached
we should improve this
cc: @Witherwings
We’re working on adding a cache to this. We already do it with bedrock today.
Understood, thanks. So its in the works already?
It's on our immediate task list - but it's coming soon
Add a reply
Sign up and join the conversation on Discord