Today we’re announcing the integration of Azure Machine Learning with New Relic to help you monitor your machine learning (ML) workspaces, endpoints, and deployment-related metrics, and the availability, performance, and resource utilization of your ML resources. The integration gives you pre-built visualizations and allows you to troubleshoot ML-related issues alongside other infrastructure and application telemetry in one unified dashboard.
The new integration allows you to:
- Keep track of ML workspaces by collecting data on all workspace activities, including quota details.
- Monitor the performance of ML endpoints by gathering metrics on their operational efficiency.
- Get oversight of ML endpoint deployments.
- Get visibility of important performance metrics using a pre-built dashboard that includes job executions, model metrics, quota metrics, online endpoints, and endpoint deployments, as well as CPU and GPU usage per workspace.
- Customize alerts to suit your specific needs.
The two screenshots above show how comprehensive the new integration’s dashboard is, which includes a number of tabs that provide detailed views of model metrics, CPU and GPU usage per workspace, and endpoint-specific resource utilization metrics.
In addition to the new dashboard, workspaces and endpoints are captured in the entity explorer view, providing information about deployment details, endpoint-specific traffic, and latency. The integration also offers logs monitoring of Azure Machine Learning models in New Relic, capturing such details as container name, container image name, and information about Azure Machine Learning resources.
The views expressed on this blog are those of the author and do not necessarily reflect the views of New Relic. Any solutions offered by the author are environment-specific and not part of the commercial solutions or support offered by New Relic. Please join us exclusively at the Explorers Hub (discuss.newrelic.com) for questions and support related to this blog post. This blog may contain links to content on third-party sites. By providing such links, New Relic does not adopt, guarantee, approve or endorse the information, views or products available on such sites.