Back to top icon

Monitoring Kafka with New Relic Infrastructure

Apache Kafka is a distributed streaming platform built for scalability, fault-tolerance, and building real-time data pipelines and streaming applications. Kafka can handle thousands of messages per second with very low latencies, making it a great fit for rapid data processing. But what if there is a major failure in your Kafka system? This can quickly lead to thousands of messages being lost—so it’s vital you have the right monitoring in place.

What you can monitor with our Kafka integration

Retention and replication

See how much data you have stored on disk for each topic partition, and how many copies of that data you have.

 

 

Throughput

When building a high-velocity pipeline, monitor the throughput in the messages-per-second or bytes-per-second that your cluster is processing.

Consumer lag

See how far behind your Kafka consumer applications are from your Kafka data producers—and if there's a lag, you can scale out the number of consumers or give them more resources.

You need to know what’s happening in your Kafka systems

We help you quickly understand your Kafka system performance. What is the health and resource consumption of your Kafka brokers? How many messages are being produced? Can your Kafka consumers keep up with the current message rate? You need to know the answers to these questions and more so you can respond before any issues impact your business.

See your Kafka metrics in pre-built dashboards

Visualize all your data, easily filter to a specific host, and correlate with other performance metrics.

Default Kafka dashboards

Track any and all Kafka configuration changes

Understand configuration differences across your stack and quantify how they are impacting performance.

Track all Kafka configuration changes

Get alerts when your Kafka performance is degrading

Understand configuration differences across your stack and quantify how configuration changes impact performance.

Kafka Alert Example

Ready to get started?

Install the integration now and get a clear picture of your Kafka performance.

 

Activate the Kafka integration Request demo