The post asks if there is a control panel UI for Docker image deployment. The comments indicate that the open-source version of the Gateway, which is likely a reference to a product, does not come with a UI. Instead, it can be installed and spun up with a single command. Community members discuss the differences between Portkey and LiteLLM, with Portkey being described as a faster and more performant solution, especially at production scale. However, one community member notes that LiteLLM offers a free admin UI and easy configuration, and is trying to understand where Portkey could replace this. There is no explicitly marked answer in the comments.
We like Litellm! I think the core difference is - Portkey is built from the ground up to be fast. Our Gateway can be up to 10x times faster than Litellm and will be more performant at the same time. This is because Portkey Gateway is a much more smaller package compared to Litellm. We are a service that spins up a separate, fast Gateway locally unlike Litellm which is a (bulky) library.
So, while Litellm may be good to start with, at production-scale you will want something that scales with your load and still stays perfomant.
On top of this, there's a key difference in our UX - setting up fallbacks, loadbalancing, etc is I think qualitatively faster and simpler on Portkey - this is also because of our service design
You can set the LiteLLM proxy server with tons of free features, free Admin UI and very easy to set the config up with just one yaml file and Supabase for all virtual keys. In my case I set a bunch of models from several vendors and group it all under one virtual key. There I also set the budget limits for each key. I'm trying to understand where Portkey could replace all of this
