What's included?
You can edit this quickstart to add helpful components. View the repository and open a pull request.
Monitor your Azure OpenAI LLM Usage in New Relic
With the GPT integration, you'll have the ability to seamlessly monitor Azure OpenAI completion queries and simultaneously log useful statistics in a New Relic customizable dashboard about your requests.
By adding just two lines of code, users can gain access to key performance metrics such as cost, response time, and sample inputs/outputs. The dashboard also allows users to track total requests, average token/requests, and model names.
With New Relic fully customizable dashboard, users can add additional metrics based on their specific business requirements and needs.
Overall, New Relic Azure OpenAI integration provides real-time metrics around GPT applications to help businesses optimize usage, reduce costs, and achieve better results.