Search results

45 results found for "kafka". Refine your search results using the Capabilities, Best Practices, and Nerd Life filters below.

A diagram of how Kafka is used at New Relic.

Tracing Kafka with OpenTelemetry

Learn how to implement open source distributed tracing in Kafka with OpenTelemetry and the otelsarama library.

10 min read

Daniel Kim

A bullseye target concentric circles going from white, black blue, red, to yellow in the middle, with arrows all throughout

Best practices and strategies for Kafka topic partitioning

… Best practices and strategies for Kafka topic partitioning best-practices By … If you’re a recent adopter of Apache Kafka, you’re undoubtedly trying to … hourly basis, so we’re thinki

8 min read

Best Practices

Amy Boyle

City skyline with fire and destruction swiping from left to right

Kafkapocalypse: Monitoring Kafka Without Losing Your Mind

… Kafkapocalypse: Monitoring Kafka Without Losing Your Mind … post is adapted from a talk called “Kafka Monitoring at New Relic†given at … were an early adopter of Apache Kafka

13 min read

Best Practices

Ben Summer

Abstract image for New Relic Blog article

20 best practices for Apache Kafka at scale

… 20 best practices for Apache Kafka at scale best-practices By Tony … data ingest team at New Relic. Apache Kafka is a widely popular distributed … systems. For example, the production

10 min read

Tony Mancill

Abstract image for New Relic Blog article

How Kafka’s consumer auto commit configuration can lead to potential duplication or data…

… How Kafka’s consumer auto commit configuration … parts of our pipeline with Apache Kafka . Over the years, we’ve hit plenty … devised best practices for managing our Kafka

5 min read

Best Practices

Evan Nelson

Abstract image for New Relic Blog article

Getting started with Kafka Connect for New Relic

… Getting started with Kafka Connect for New Relic how-to-relic … a passionate developer, and a Kafka development thought leader. His Kafka technical leadership spans retail, â

5 min read

How to Relic

Rahul Bhattacharya

Abstract image for New Relic Blog article

Using Apache Kafka for Real-Time Event Processing at New Relic

… Using Apache Kafka for Real-Time Event Processing at … this series:  Effective Strategies for Kafka Topic Partitioning . New Relic was an early adopter of Apache Kafka ; we

8 min read

How to Relic

Amy Boyle

Abstract image for New Relic Blog article

Monitor Amazon Managed Streaming for Apache Kafka with Prometheus OpenMetrics

… Amazon Managed Streaming for Apache Kafka with Prometheus OpenMetrics … and analytics software. Apache Kafka is a popular distributed streaming … Amazon Managed Streaming for Apache

4 min read

JF Joly

Abstract image for New Relic Blog article

Containerizing a Data Ingest Pipeline: Making the Container Play Nice with Kafka

… Making the Container Play Nice with Kafka best-practices By Yonatan Schultz … Java Virtual Machine (JVM) and Apache Kafka, which we use as our data-streaming … the Mobile router, which publ

5 min read

Best Practices

Yonatan Schultz

At the New Relic office, a large logo displayed on the wall and people walking around the corridor

Our Commitment to Reliability and Incident Learning

… an isolated technology failure in our Kafka systems ultimately was exacerbated … in each NRDB cell, we operate:  A Kafka cluster An internet-facing ingestion … traffic An NRDB cluster NEW

8 min read

Nic Benders

Abstract image for New Relic Blog article

Apache Flink: A developer's guide to getting started

… an application that reads from Apache Kafka topics containing usage metadata … 24 hours and then writes that data to a Kafka topic containing daily usage data. The Usage Stamper reads from th

11 min read

Best Practices

Ruby Andrews

New Relic and AWS collaboration

New Relic at re:Invent—our journey to AWS

Learn about New Relic's AWS re:Invent talk on cell architecture and transitioning to the cloud, including best practices for your cloud transition.

3 min read

Franz Knupfer

Blue water waves

If You’re Not Monitoring Your Resource Pools, You’re Doing It Wrong

… simple service, running on Apache Kafka , that reduces the amount of data … Symptoms Throughput is down and the Kafka producer buffer is full Problem The destination Kafka br

8 min read

Best Practices

Evan Nelson

FutureStack 22 audience member taking notes on laptop

A sneak preview of FutureStack sessions

Get a sneak preview of the different tracks during FutureStack 2022 and talks by our own employees and much more.

3 min read

Michelle Scharlock

Wrench and screwdriver over datalines

A Day in the Life of a New Relic SRE

… key parts of our pipeline (for example, Kafka , Amazon Simple Queue Service (SQS) … for resources. I also check that our Kafka topics are flowing as expected. We … stages of an upgrade of o

7 min read

Yonatan Schultz

10 New Cloud Integrations for AWS Monitoring with New Relic Infrastructure

… . Amazon Managed Streaming for Apache Kafka (MSK) Apache Kafka is a streaming data processing tool. … Amazon Managed Streaming for Apache Kafka (MSK) abstracts away the manag

9 min read

Matthew Demyttenaere

three people working on a whiteboard: an instructor and two students working at laptops

How Engineering Standards Help You Build More Perfect Software Faster

… says if you're interacting with Kafka, you must use our Java client (and … on the JVM when teams interacted with Kafka. That led us to conclude that the … our many teams and services.

7 min read

Best Practices

Tricia Kerr

Red alarm light in hallway

Nine Takeaways From Going 'Andon Red'

… series of services connected by Apache Kafka queues. Step one, then, was to … Trace Indexer.†The Trace Indexer uses Kafka Streams to aggregate individual Span … In the meantime, we’re

6 min read

Best Practices

Matthew Jarvie

View of entire system's golden signals, with circles representing entities in New Relic's application.

Transitioning to the cloud: New Relic's journey to AWS

Wendy Shepperd, GVP of Engineering at New Relic, discusses New Relic's transition to AWS, cell architecture, and the importance of establishing a FinOps practice in this Q&A.

4 min read

Franz Knupfer

illustration of a happy face on a teal planet with a starry blue field behind

Top 10 New Observability Features You Need to Know

… outages quickly. Learn more here . 7. Kafka Connect Unlock open source and … sources by ingesting data from Apache Kafka topics into New Relic One, without … code, with the New Relic connec

5 min read

Dayna Lord

Get full access to New Relic for free.

Monitor your stack for free with full platform access and 100 GB of ingest per month. No credit card required.

Get Started Get Started
Request Demo Request Demo