Welcome to Portkey Forum

Home
Members
elentaure.
e
elentaure.
Offline, last seen last month
Joined November 4, 2024
Question about auth in the case of vertex. You have both options to have the acutal token passed as the api key or I see that also it can take the service account json file. In this case, it uses the google api to get a token. My question is: When you define a virtual key in the control plane, what is actually the flow? Does the token retrieval happen in the control plane and then its passed as api key to the gateway? or is the actual json passed so the retrieval happens in the gateway? Asking mostly to check if this is happening on every call as I dont see any caching of the token. Also is there any way to pass the json as a header or in the config object to test that part locally? Thanks!
6 comments
s
r
e
V
Hi, quick question. Are the plugins only for guardrail purposes? It would be interesting for example to be able to create a plugin which leverages the hooks to use an instrumentation framework from tools like datadog or grafana tu automatically trace and inject third party monitoring to the calls
5 comments
e
s
r
Hi, another question: looks like after the addition of the help page (https://github.com/Portkey-AI/gateway/pull/692) the config for the vscode debug is no longer working for me (https://github.com/Portkey-AI/gateway/pull/602) as it does not seem to copy the public/index.html into the build/src dir. Not sure if this is the root cause, but can you help me update the task config for the vscode debug to fix this if thats the case? The error is bascially not finding /build/src/public/index.html
8 comments
s
V
e
Hi, the fine tuning endpoints are part of the gateway? If so, can you point to examples in the code where are implemented?
9 comments
e
W
V
Hi, we are looking for ways to send some metadata or log entries to GCP so we have info on portkey data related with the vertex calls. Would a plugin acting as middleware be a good option for that?
5 comments
s
e
Hi, can a config be used to limit which models can be accessed?
1 comment
V
Hello, is there a way to limit the headers that a user can pass? for example, we set a custom host in a config, and I would like to prevent users from overriding that with the x-portkey-custom-host header
24 comments
e
r
s
Any ETA for this support?
24 comments
s
e
V