Search results

44 results found for "kafka". Refine your search results using the Capabilities, Best Practices, and Nerd Life filters below.

Tracing Kafka with OpenTelemetry

… Tracing Kafka with OpenTelemetry how-to-relic By … tech, good food, and dad jokes. Apache Kafka is an open source event streaming … but it can be challenging to monitor Kafka

10 min read

Daniel Kim

Best practices and strategies for Kafka topic partitioning

… Best practices and strategies for Kafka topic partitioning best-practices By … If you’re a recent adopter of Apache Kafka, you’re undoubtedly trying to … hourly basis, so we’re thinki

8 min read

Best Practices

Amy Boyle

Kafkapocalypse: Monitoring Kafka Without Losing Your Mind

… Kafkapocalypse: Monitoring Kafka Without Losing Your Mind … post is adapted from a talk called “Kafka Monitoring at New Relic” given at … were an early adopter of Apache Kafka

13 min read

Best Practices

Ben Summer

20 best practices for Apache Kafka at scale

… 20 best practices for Apache Kafka at scale best-practices By Tony … data ingest team at New Relic. Apache Kafka is a widely popular distributed … systems. For example, the production

10 min read

Tony Mancill

How Kafka’s consumer auto commit configuration can lead to potential duplication or data…

… How Kafka’s consumer auto commit configuration … parts of our pipeline with Apache Kafka . Over the years, we’ve hit plenty … devised best practices for managing our Kafka

5 min read

Best Practices

Evan Nelson

Getting started with Kafka Connect for New Relic

… Getting started with Kafka Connect for New Relic how-to-relic … a passionate developer, and a Kafka development thought leader. His Kafka technical leadership spans retail,

5 min read

How to Relic

Rahul Bhattacharya

Using Apache Kafka for Real-Time Event Processing at New Relic

… Using Apache Kafka for Real-Time Event Processing at … this series:  Effective Strategies for Kafka Topic Partitioning . New Relic was an early adopter of Apache Kafka ; we

8 min read

How to Relic

Amy Boyle

Monitor Amazon Managed Streaming for Apache Kafka with Prometheus OpenMetrics

… Amazon Managed Streaming for Apache Kafka with Prometheus OpenMetrics … and analytics software. Apache Kafka is a popular distributed streaming … Amazon Managed Streaming for Apache

4 min read

JF Joly

Containerizing a Data Ingest Pipeline: Making the Container Play Nice with Kafka

… Making the Container Play Nice with Kafka best-practices By Yonatan Schultz … Java Virtual Machine (JVM) and Apache Kafka, which we use as our data-streaming … the Mobile router, which publ

5 min read

Best Practices

Yonatan Schultz

Our Commitment to Reliability and Incident Learning

… an isolated technology failure in our Kafka systems ultimately was exacerbated … in each NRDB cell, we operate:  A Kafka cluster An internet-facing ingestion … traffic An NRDB cluster NEW

8 min read

Nic Benders

Apache Flink: A developer's guide to getting started

… an application that reads from Apache Kafka topics containing usage metadata … 24 hours and then writes that data to a Kafka topic containing daily usage data. The Usage Stamper reads from th

11 min read

Best Practices

Ruby Andrews

New Relic at re:Invent—our journey to AWS

… database (NRDB) , how New Relic uses Kafka, and how New Relic successfully made … some major outages." New Relic uses Kafka to feed data through a pipeline … transform data. Data can t

3 min read

Franz Knupfer

If You’re Not Monitoring Your Resource Pools, You’re Doing It Wrong

… simple service, running on Apache Kafka , that reduces the amount of data … Symptoms Throughput is down and the Kafka producer buffer is full Problem The destination Kafka br

8 min read

Best Practices

Evan Nelson

A sneak preview of FutureStack sessions

… AM on Thursday, May 19.  Monitoring Kafka without instrumentation using Pixie … discuss the difficulty of monitoring Kafka systems in production and how Pixie … tracing, for protocols like

3 min read

Michelle Scharlock

A Day in the Life of a New Relic SRE

… key parts of our pipeline (for example, Kafka , Amazon Simple Queue Service (SQS) … for resources. I also check that our Kafka topics are flowing as expected. We … stages of an upgrade of o

7 min read

Yonatan Schultz

10 New Cloud Integrations for AWS Monitoring with New Relic Infrastructure

… . Amazon Managed Streaming for Apache Kafka (MSK) Apache Kafka is a streaming data processing tool. … Amazon Managed Streaming for Apache Kafka (MSK) abstracts away the manag

9 min read

Matthew Demyttenaere

How Engineering Standards Help You Build More Perfect Software Faster

… says if you're interacting with Kafka, you must use our Java client (and … on the JVM when teams interacted with Kafka. That led us to conclude that the … our many teams and services.

7 min read

Best Practices

Tricia Kerr

Nine Takeaways From Going 'Andon Red'

… series of services connected by Apache Kafka queues. Step one, then, was to … Trace Indexer.” The Trace Indexer uses Kafka Streams to aggregate individual Span … In the meantime, we’re

6 min read

Best Practices

Matthew Jarvie

Transitioning to the cloud: New Relic's journey to AWS

… because we had a massive single Kafka cluster in our data center with … to our needs. We make extensive use of Kafka, microservices, and containers. And, … and Amazon Managed Streaming for

4 min read

Franz Knupfer

6 amazing ways you can use Java

… data sets, is built in Java. Apache Kafka, which was developed at LinkedIn for … New York Times, and Pinterest all use Kafka. We also use Kafka at New Relic to ingest large a

3 min read

Franz Knupfer

Get full access to New Relic for free.

Monitor your stack for free with full platform access and 100 GB of ingest per month. No credit card required.