Welcome to Portkey Forum

Updated 8 months ago

Azure Errors with Higher Context Requests

Plain Text
raise self._make_status_error_from_response(request, err.response) from None
portkey_ai.api_resources.exceptions.InternalServerError: {"html-message":"error code: 524"}


While using azure gpt-32k. Repose timeout is 1000.
Plain Text
{
  "status": 524,
  "headers": {
    "cache-control": "private, max-age=0, no-store, no-cache, must-revalidate, post-check=0, pre-check=0",
    "cf-ray": "871b3bfcb3af7977-SIN",
    "connection": "keep-alive",
    "content-type": "application/json",
    "date": "Tue, 09 Apr 2024 14:38:58 GMT",
    "expires": "Thu, 01 Jan 1970 00:00:01 GMT",
    "referrer-policy": "same-origin",
    "server": "cloudflare",
    "x-frame-options": "SAMEORIGIN",
    "x-portkey-cache-status": "MISS",
    "x-portkey-last-used-option-index": "config.targets[2]",
    "x-portkey-retry-attempt-count": "0",
    "x-portkey-trace-id": "6e31e4df-3cde-4e7c-acab-5b1c88c40293"
  },
  "body": {
    "html-message": "error code: 524"
  },
  "responseTime": 100933,
  "lastUsedOptionJsonPath": "config.targets[2]"
}
V
r
k
6 comments
Discussing this internally! I'll share if we come up with any recommendations
Azure Errors with Higher Context Requests
Does this happen consistently?
actually hammering my development as well
@visarg @ayush-portkey to further check this out! Been long pending
Add a reply
Sign up and join the conversation on Discord