Hey, is it possible to use Portkey Gateway proxy with batch requests? For example OpenAI & Vertex both support batches API, but with different format. In both platforms you can upload a JSONL file and then call a batch request, the batch will be processed and returned. Is there a way to do something like this in Portkey, but in a unified format using the OpenAI client?
hey @artyabra this feature is in final stages of development. We will be releasing a unified batch api very soon. for now only Open AI batch api is supported
