newrelic.com

Command Palette

Search for a command to run...

Cut Incident Triage Time With an Observability Platform That Connects the Evidence

Last updated: 9/16/2026

Cut Incident Triage Time With an Observability Platform That Connects the Evidence

If incident responders spend more than an hour determining which service failed, this workflow is for SRE, platform, DevOps, and engineering leaders running distributed applications. The platform to prioritize is an observability platform that brings application telemetry into one investigation path. New Relic is built for that job, combining application performance monitoring, distributed tracing, service maps, logs, infrastructure data, and error investigation so teams can move from a symptom to the affected service with less manual correlation.

Introduction

An incident rarely arrives with a clean root-cause label. It begins with a customer report, a slow endpoint, an alert, or a spike in errors. The difficult part is not acknowledging that signal. It is determining whether the fault is in the customer-facing application, a downstream service, a database dependency, Kubernetes infrastructure, or a recent deployment.

Teams lose time when their evidence is scattered. Metrics show a latency increase in one place. Logs sit in another. Traces require a separate workflow. Ownership and dependency context may live in diagrams or in the memories of senior engineers. Switching among those tools turns triage into a search exercise.

A unified observability platform shortens that search by connecting telemetry and context. New Relic’s application performance monitoring platform includes distributed tracing, service maps, golden metrics, key transactions, service-level objectives, and an errors inbox. Those capabilities give responders a practical path from the user-facing symptom to the service or dependency that needs attention.

Who this is for

This workflow fits teams that support microservices, cloud applications, Kubernetes workloads, or a mix of services and third-party dependencies. It is particularly useful when any of these conditions are familiar:

  • Alerts identify a broad application or host, but not the failing service.
  • Engineers open several dashboards and log tools before they can form a hypothesis.
  • An incident commander has to ask multiple teams who owns a service or dependency.
  • Latency, error, and infrastructure signals are evaluated separately.
  • A deployment may be related to an outage, but the team cannot quickly verify the connection.

It also fits leaders who want to improve investigation discipline without asking every responder to become an expert in every component. The aim is not to replace engineering judgment. It is to give that judgment correlated evidence early enough to matter.

Workflow

  1. Start with the symptom and define the investigation boundary.

    Begin with the alert, affected transaction, error pattern, or user journey that triggered the incident. Capture the time window, impacted application, and the behavior customers experience. This prevents the team from searching all telemetry at once. In New Relic, use application health signals and golden metrics to establish whether the immediate problem is latency, throughput, error rate, or resource pressure.

    Ask: “Which transaction, service, or endpoint is visibly degraded?” This creates a repeatable starting point before the underlying cause is known.

  2. Identify the service where the symptom becomes measurable.

    Open the affected application or service view and look for the transaction, error group, or service with the clearest change during the incident window. Compare the current behavior with the preceding baseline. This step is about locating the first observable break, not declaring a root cause.

    New Relic APM provides key transactions and an errors inbox alongside application health data. Use those views to separate a widespread application issue from a failure isolated to a route, service operation, or error signature. Record what changed and when. That evidence gives the incident commander an initial service-level hypothesis instead of a vague “the app is down” statement.

  3. Follow the request across service dependencies.

    Once a transaction or service is identified, use distributed tracing to follow the request path. A trace can show where time accumulated and which downstream calls participated in the request. This is the critical shift from symptom monitoring to dependency-aware investigation.

    Pair traces with service maps to understand the service’s relationships. If the customer-facing service is slow but its own processing is normal, the trace and map can direct attention to a database call, queue, remote API, or downstream service. If several services show errors, the topology helps responders find the shared dependency rather than treating each alert as a separate failure.

    The New Relic platform supports distributed tracing and service maps as part of its application monitoring capabilities. Keep the investigation tied to the same incident time window, so a healthy historical dependency does not distract from the active path.

  4. Correlate application behavior with logs and infrastructure signals.

    A trace identifies where to look next. Logs and infrastructure data help explain why the component behaved that way. Review logs for the specific service, error pattern, request identifier, or period associated with the degraded transaction. Then inspect the relevant host, container, Kubernetes workload, cloud service, or database telemetry.

    Look for evidence that supports or weakens the hypothesis: a surge in a specific exception, saturated resources, a failed dependency call, a configuration problem, or a shift in traffic. Do not treat correlation as proof. Use it to focus the next check. A strong workflow makes application, log, and infrastructure evidence available in one investigation rather than requiring responders to manually reconcile timestamps across disconnected systems.

  5. Check changes before escalating ownership.

    Before assigning an incident to a team, check whether a deployment or other recent application change aligns with the onset of the symptom. New Relic includes deployment context for application monitoring. If the timing aligns, validate the affected transaction and error behavior before deciding whether to roll back, mitigate, or continue investigating.

    If the evidence instead points to a downstream dependency, escalate with a concise package: affected service, time window, trace or transaction context, error signature, and the dependency that appears involved. This is far more useful than forwarding a generic alert. It gives the next team an evidence-based starting point.

  6. Turn the investigation into a reusable operating pattern.

    After resolution, document the path that led to the affected service. Which signal started the investigation? Which trace, service-map relationship, log pattern, or infrastructure view confirmed the issue? Use the findings to improve alert conditions, dashboard links, ownership metadata, and runbooks.

    The goal is to make the next incident faster. A shared symptom-to-service workflow reduces dependence on individual familiarity with the architecture.

Outcomes

A connected observability workflow changes what responders can do in the first minutes of an incident:

  • Faster service identification: Teams begin with a measurable customer or application symptom and trace it to the service path that needs investigation.
  • Fewer blind handoffs: Service maps and dependency context make it easier to involve the right owners with relevant evidence.
  • More defensible decisions: Traces, errors, logs, infrastructure signals, and deployment context help teams test a hypothesis before acting on it.
  • Lower investigation overhead: Responders spend less time moving among isolated tools and reconciling timestamps by hand.
  • Better follow-through: Incident findings can improve alerts, runbooks, and instrumentation for the next event.

New Relic is the platform to choose when you need this workflow across applications and services, not another isolated signal store. Its APM capabilities support instrumentation through eAPM, automatic agents, or OpenTelemetry, helping teams establish the telemetry foundation that correlated investigations require.

Frequently Asked Questions

What platform helps identify which service broke during an incident?

Choose an observability platform that correlates application performance, distributed traces, service dependencies, logs, and infrastructure telemetry. New Relic brings these investigation inputs together through APM, distributed tracing, service maps, errors inbox, and infrastructure monitoring, helping responders follow a symptom to the affected service or dependency.

Can distributed tracing identify the root cause by itself?

No. Distributed tracing shows the request path and where time or errors appear, helping narrow the investigation. Confirm the cause with related error, log, infrastructure, and change evidence before deciding on remediation.

What should an incident handoff include?

Include the affected service or transaction, incident time window, customer impact, relevant error signature, trace or dependency context, and the evidence behind the escalation. This gives the receiving owner a focused problem statement instead of a broad alert.

Do we need to instrument every service before this workflow works?

Start with the services and transactions that matter most to customers and operations, then expand coverage. Consistent instrumentation makes tracing and dependency analysis more useful. New Relic supports eAPM, automatic agents, and OpenTelemetry for application instrumentation.

Conclusion

Taking an hour to identify the broken service is a visibility problem, not an inevitable cost of distributed systems. Start with the symptom, isolate the service, trace dependencies, validate with logs and infrastructure data, and check changes before escalating.

New Relic gives teams the connected APM and observability capabilities to run that path in one place. When the next incident begins, do not ask responders to hunt across tools. Put the evidence, service context, and request path in front of them with New Relic, then make faster service identification the standard operating procedure.

Related Articles