Governing Access to Models and Prompts

@dhuesca this is a common use case we are seeing for Open WebUI. I'll try to put together a comprehensive guide on this, and share with you?

that'd be awesome!
I want to have a working demo for my boss to see.

If they like it, we could schedule a call for a more comprehensive demo and see advanced enterprise options (we'd need to integrate with our SSO and selfhost Portkey on a cloud provider)

Makes sense! Cool, let me put something together. In the meanwhile, just sharing that Portkey can be fully deployed on-prem and supports OIDC/SAML for SSO too.

could I bother you to link me to the on-prem deployment documentation? Im using the hosted version of Portkey (through https://app.portkey.ai/) and most likely it's what interfering with my tests (our Azure OpenAI deployment works only on internal network).

Ah got it. So that's also one of the primary reasons why companies go for the on-prem deployment.

Docs

Enterprise-specific feature list

Helm chart

@dhuesca would you like to hop on a quick call right now?

to discuss some of these aspects in more detail?

i could explain some of our deployment options

Unfortunately I can't right now. I'll take a look at the docs you've shared later in the day and try to continue my deployment.
If I run into any issues I'll post here. Thank you very much for your help!

Sounds good!