If you’re a data scientist, machine learning engineer, or data engineer, you know the challenges of deploying a successful machine learning (ML) model. Difficulties in testing models and the iterative process of training, testing, and validating a model can be a tedious process that continues long after deployment to production. This can mean serious consequences for your team and business, as failure to detect and address low performance can mean the difference between a model that delivers exceptional performance over time and one that fails to deliver business value.
That’s why New Relic is partnering with Comet to bring you an integration that extends full-stack observability to machine learning models and allows you to establish production performance baselines based on model performance.
In the following short demo, you’ll see how you can integrate machine learning metrics with New Relic’s integration with Comet to continually monitor your data across the full machine learning lifecycle. This helps ensure optimal model performance and can help you achieve better business outcomes.
Why should you integrate Comet with New Relic One?
Comet is an MLOps platform that enables teams to automatically monitor machine learning experiments and models in production with just a few lines of code.
Comet’s integration with New Relic One extends infrastructure observability to include your ML models in production and their performance baselines established in training, so you can build better models faster.
The New Relic integration with Comet empowers you to:
- Observe: Retrain your models faster by observing your models from production to deployment.
- Debug: Use powerful code-based metrics and visualizations to debug faster.
- Review: Detect issues and address performance degradation, data drift, and potential bias by reviewing your ML metrics.
- Validate: Compare models in production against their baselines during training to validate performance.
- Adapt: React to changes in performance caused by model drift.
- Correlate: Correlate ML production issues with the rest of your software and infrastructure stack.
- Collaborate: Work across teams seamlessly by breaking down the silos between data scientists and developers to ensure the accuracy of models in production, all in one place.
You’ll get data and insights to help build better, more accurate ML models while also improving productivity, collaboration, and visibility across your team.
Integrating Comet with New Relic One
To set up the Comet integration, you need a New Relic One account. If you don’t already have one, sign up for a forever free account.
1. Log in to one.newrelic.com, go to the Explorer page, and select + Add more data.
2. Select Comet from the MLOps Integration section.
3. Select your New Relic Account ID.
4. Create or select an existing Insight API key from the Real Time Training Metric section.
5. Contact comet at sales@comet.ml to set up the integration and view their MPM Dashboard. You will need the Insight API Key.
6. View the Comet dashboard in New Relic to start tracking the performance of your machine learning models in New Relic.
다음 단계
For more information on how to set up New Relic MLOps or integrate Comet in your observability infrastructure, visit the New Relic MLOps docs page.
If you’re new to New Relic but interested in digging in, experience the simplicity of New Relic One yourself by signing up for a forever free account.
Curious in more Nerd Life articles for New Relic culture and how we've helped customers? Start your Nerd Life journey with our read on AWS and our case study with ZenHub.
이 블로그에 표현된 견해는 저자의 견해이며 반드시 New Relic의 견해를 반영하는 것은 아닙니다. 저자가 제공하는 모든 솔루션은 환경에 따라 다르며 New Relic에서 제공하는 상용 솔루션이나 지원의 일부가 아닙니다. 이 블로그 게시물과 관련된 질문 및 지원이 필요한 경우 Explorers Hub(discuss.newrelic.com)에서만 참여하십시오. 이 블로그에는 타사 사이트의 콘텐츠에 대한 링크가 포함될 수 있습니다. 이러한 링크를 제공함으로써 New Relic은 해당 사이트에서 사용할 수 있는 정보, 보기 또는 제품을 채택, 보증, 승인 또는 보증하지 않습니다.
