Openai error: rate limit reached for gpt-4o in organization

Hey @thismlguy first, just confirming that you are only using one OpenAI org?

Essentially your query is - Portkey should also reflect 795818 used tokens and not 824k - so there's a discrepancy right?

yes using one org

no my question is that portkey says 824K in the entire day

but hte limit is 800K tokens per minute

so either open ai is wrong or portkey is showing incorrect metric

the number of tokens as per portkey were ~300k in the last few minutes around that time when the error came

I think it will help to get on a call and see this on the Portkey dashboard - we can quickly catch if there are any bugs in displaying token counts

@thismlguy can you please share your availability today/tomorrow - we can do a 5 min call