What's included?
alerts
1
Azure OpenAI observability quickstart contains 1 alert. These alerts detect changes in key performance metrics. Integrate these alerts with your favorite tools (like Slack, PagerDuty, etc.) and New Relic will let you know when something needs your attention.
API Response Time(seconds)
This alert is triggered when the response time exceeds 15 seconds for 1 minute.
documentation
2
Azure OpenAI observability quickstart contains 2 documentation reference. This is how you'll get your data into New Relic.
dashboards
0
This quickstart doesn't include any dashboards. Do you think it should?
You can edit this quickstart to add helpful components. View the repository and open a pull request.
You can edit this quickstart to add helpful components. View the repository and open a pull request.
Monitor your Azure OpenAI LLM Usage in New Relic
With the GPT integration, you'll have the ability to seamlessly monitor Azure OpenAI completion queries and simultaneously log useful statistics in a New Relic customizable dashboard about your requests.
By adding just two lines of code, users can gain access to key performance metrics such as cost, response time, and sample inputs/outputs. The dashboard also allows users to track total requests, average token/requests, and model names.
With New Relic fully customizable dashboard, users can add additional metrics based on their specific business requirements and needs.
Overall, New Relic Azure OpenAI integration provides real-time metrics around GPT applications to help businesses optimize usage, reduce costs, and achieve better results.