Monitor your Azure OpenAI LLM Usage in New Relic

With the GPT integration, you'll have the ability to seamlessly monitor Azure OpenAI completion queries and simultaneously log useful statistics in a New Relic customizable dashboard about your requests.

By adding just two lines of code, users can gain access to key performance metrics such as cost, response time, and sample inputs/outputs. The dashboard also allows users to track total requests, average token/requests, and model names.

With New Relic fully customizable dashboard, users can add additional metrics based on their specific business requirements and needs.

Overall, New Relic Azure OpenAI integration provides real-time metrics around GPT applications to help businesses optimize usage, reduce costs, and achieve better results.