Monitor your ML models with New Relic and Amazon SageMaker

It's important to test how your machine learning (ML) models are working with your software and infrastructure, but you can only do so if you have the right tools in place.

That’s why New Relic is partnering with Amazon SageMaker to integrate ML model telemetry into New Relic One, providing an end-to-end observability platform where you can monitor the performance of your AI-powered applications.

The integration with Amazon SageMaker expands access to observability for ML engineers and data science teams, making it easier to develop, test, and monitor ML models in production by breaking down the silos between AI/ML, DevOps, and site reliability engineers (SREs).

Bridging the gap between data science and DevOps

By integrating SageMaker metrics in New Relic One, you unlock the ability to instrument, analyze, troubleshoot, and optimize your machine-learning application performance to ensure production models deliver accurate predictions.

Gain trust in your AI-powered solutions with New Relic Alerts and Applied Intelligence, a centralized notification system to monitor all your operational needs to maximize your data science ROI.

Integrating Amazon SageMaker Model Monitor with New Relic One

By monitoring models developed with Amazon SageMaker in New Relic One, you can now visualize sophisticated ML models and create a comprehensive monitoring dashboard in New Relic for your ML models and applications pipelines.

The following video shows how to integrate metrics from Amazon SageMaker Model Monitor into New Relic One.

You can also follow these steps to set up the integration.

1. Stream metrics: Stream AWS Cloudwatch metrics to New Relic with Terraform or by following along with the Amazon CloudWatch Metric Streams integration docs. Want more about AWS integrations? Learn more about AWS Monitoring with New Relic Infrastructure.
2. Monitor your data: Automatically monitor your data and model in Amazon Sagemaker and send metrics to Cloudwatch. 
3. Explore entities and dashboards: Explore your MLOp entities and dashboards by selecting Explorer in one.newrelic.com and selecting Machine Learning from the left navigation menu.

For more information on setting up New Relic Model Performance Monitoring and Amazon SageMaker in your observability infrastructure, visit the MLOps integrations on New Relic Instant Observability.