Welcome to Portkey Forum

Home
Members
kaushikbokka
k
kaushikbokka
Offline, last seen 3 weeks ago
Joined November 4, 2024
Can someone verify the langchain support for Portkey?
Plain Text
File "/Users/kaushikbokka/apps/leather/language-models/venv/lib/python3.8/site-packages/langchain_core/language_models/chat_models.py", line 556, in generate_prompt
    return self.generate(prompt_messages, stop=stop, callbacks=callbacks, **kwargs)
  File "/Users/kaushikbokka/apps/leather/language-models/venv/lib/python3.8/site-packages/langchain_core/language_models/chat_models.py", line 417, in generate
    raise e
  File "/Users/kaushikbokka/apps/leather/language-models/venv/lib/python3.8/site-packages/langchain_core/language_models/chat_models.py", line 407, in generate
    self._generate_with_cache(
  File "/Users/kaushikbokka/apps/leather/language-models/venv/lib/python3.8/site-packages/langchain_core/language_models/chat_models.py", line 626, in _generate_with_cache
    result = self._generate(
  File "/Users/kaushikbokka/apps/leather/language-models/venv/lib/python3.8/site-packages/langchain_core/language_models/chat_models.py", line 910, in _generate
    output_str = self._call(messages, stop=stop, run_manager=run_manager, **kwargs)
  File "/Users/kaushikbokka/apps/leather/language-models/venv/lib/python3.8/site-packages/portkey_ai/llms/langchain/chat.py", line 173, in _call
    return message.get("content", "") if message else ""
AttributeError: 'ChatCompletionMessage' object has no attribute 'get'


seems to be failing with the latest version.
19 comments
V
k
Plain Text
raise self._make_status_error_from_response(request, err.response) from None
portkey_ai.api_resources.exceptions.InternalServerError: {"html-message":"error code: 524"}


While using azure gpt-32k. Repose timeout is 1000.
Plain Text
{
  "status": 524,
  "headers": {
    "cache-control": "private, max-age=0, no-store, no-cache, must-revalidate, post-check=0, pre-check=0",
    "cf-ray": "871b3bfcb3af7977-SIN",
    "connection": "keep-alive",
    "content-type": "application/json",
    "date": "Tue, 09 Apr 2024 14:38:58 GMT",
    "expires": "Thu, 01 Jan 1970 00:00:01 GMT",
    "referrer-policy": "same-origin",
    "server": "cloudflare",
    "x-frame-options": "SAMEORIGIN",
    "x-portkey-cache-status": "MISS",
    "x-portkey-last-used-option-index": "config.targets[2]",
    "x-portkey-retry-attempt-count": "0",
    "x-portkey-trace-id": "6e31e4df-3cde-4e7c-acab-5b1c88c40293"
  },
  "body": {
    "html-message": "error code: 524"
  },
  "responseTime": 100933,
  "lastUsedOptionJsonPath": "config.targets[2]"
}
6 comments
V
r
k
also, could we add status for Azure on this page? https://status.portkey.ai/
would be v helpful. thanks
3 comments
V
r