Derzeit ist diese Seite nur auf Englisch verfügbar.
OpenAI Observability

OpenAI Observability

Seamlessly monitor your usage of OpenAI’s GPT Series APIs using New Relic’s dashboard. You'll get access to real-time metrics that can help you optimize usage, reduce costs, and achieve better results.

What's included?

OpenAI Observability observability quickstart contains 2 alerts. These alerts detect changes in key performance metrics. Integrate these alerts with your favorite tools (like Slack, PagerDuty, etc.) and New Relic will let you know when something needs your attention.
API Response Time(seconds)
This alert is triggered when the response time exceeds 15 seconds for 1 minute.
This alert is triggered when the cost exceeds 10 USD for 1 minute.
This quickstart doesn't include any dashboards. Do you think it should?
You can edit this quickstart to add helpful components. View the repository and open a pull request.
View repo View repo

Monitor your GPT-3 and GPT-4 Application Usage in New Relic

With the GPT integration, you'll have the ability to seamlessly monitor OpenAI completion queries and simultaneously log useful statistics in a New Relic customizable dashboard about your requests.

By adding just two lines of code, users can gain access to key performance metrics such as cost, response time, and sample inputs/outputs. The dashboard also allows users to track total requests, average token/requests, and model names.

With New Relic's fully customizable dashboard, users can add additional metrics based on their specific business requirements and needs.

Overall, New Relic's OpenAI integration provides real-time metrics around GPT applications to help businesses optimize usage, reduce costs, and achieve better results.

How to use this quickstart

  • Sign Up for a free New Relic account or Log In to your existing account.
  • Click the install button.
  • Install the quickstart to get started or improve how you monitor your environment. They're filled with pre-built resources like dashboards, instrumentation, and alerts.
New Relic
Yogev Kriger
Need help? Visit our Support Center or check out our community forum, the Explorers Hub.