Data science teams are under constant pressure from key stakeholders to build successful machine learning models that have a positive business impact. Machine-learning (ML) engineers need to answer critical questions about the integrity and accuracy of models in production while working with site reliability engineers (SREs) and DevOps teams to ensure the efficiency and effectiveness of their machine-learning-based applications.
How do you define and monitor the success of an ML model when you also need to focus on application responsiveness and uptime?
The good news is that it’s possible. New Relic is partnering with TruEra, a recognized leader in AI quality management and ML model performance management, to empower data scientists and DevOps engineers to answer critical operational and AI quality questions in real-time.
Why should you integrate TruEra with New Relic One?
TruEra helps you easily track and troubleshoot machine learning model performance with comprehensive model quality analytics and integrated diagnostics.
TruEra helps data science and MLOps teams track key model performance metrics such as accuracy (AUC) and stability.
New Relic’s integration with TruEra provides real-time AI quality performance management so you can see metrics such as:
- Stability: model score drift, distribution, and stability score
- Accuracy: actual and estimated accuracy, decision trends
- Reliability: robustness analytics
- Bias/Fairness: disparate impact on groups
- Data Quality: data quality trends, rule violations
TruEra doesn’t just help you understand your model’s current performance. It also pinpoints the source of drift on any highlighted trouble spots surfaced in monitoring. This allows you to quickly identify and resolve the source of model performance problems, enabling faster root cause analysis and action. This saves you time, improves governance, and provides a more effective feedback loop by allowing you to collaborate with DevOps teams to improve models and business outcomes.
With these monitoring capabilities, your team can ensure your application is running properly and delivering the right results.
Integrating TruEra with New Relic One
In the following short demo, you’ll see how you can integrate TruEra to New Relic so your monitoring analytics appear within the New Relic platform.
다음 단계
For more information on how to integrate TruEra in your observability infrastructure, see Getting Started with TruEra on New Relic. For more on other New Relic's other MLOps integrations, see Alerts and Applied Intelligence: MLOps integrations.
Alerts and Applied Intelligence are now available at no additional cost for all full users of New Relic.
And if you’re new to New Relic but interested in digging in, experience the simplicity of New Relic One yourself by signing up for a forever free account.
이 블로그에 표현된 견해는 저자의 견해이며 반드시 New Relic의 견해를 반영하는 것은 아닙니다. 저자가 제공하는 모든 솔루션은 환경에 따라 다르며 New Relic에서 제공하는 상용 솔루션이나 지원의 일부가 아닙니다. 이 블로그 게시물과 관련된 질문 및 지원이 필요한 경우 Explorers Hub(discuss.newrelic.com)에서만 참여하십시오. 이 블로그에는 타사 사이트의 콘텐츠에 대한 링크가 포함될 수 있습니다. 이러한 링크를 제공함으로써 New Relic은 해당 사이트에서 사용할 수 있는 정보, 보기 또는 제품을 채택, 보증, 승인 또는 보증하지 않습니다.
