Why monitor Databricks

In the world of big data, Databricks is a mission-critical platform. But making sure your workloads are running efficiently, cost-effectively, and reliably can be challenging.

The Databricks Integration from New Relic delivers total visibility for your entire Databricks estate, allowing you to troubleshoot, optimize, and connect performance directly to cost - all from a single, unified observability platform.

Databricks quickstart highlights

The Databricks integration collects a comprehensive suite of telemetry data, including the following:

• Apache Spark application metrics
• Databricks Lakeflow job run metrics
• Databricks Lakeflow Spark Declarative Pipeline update metrics
• Databricks query metrics
• Databricks cluster health metrics and logs
• Databricks consumption and cost data

With the pre-built dashboards in this quickstart, you can quickly visualize and analyze your Databricks workloads to ensure optimal performance and cost efficiency.