Improve your LangChain app's performance with New Relic LangChain quickstart.

What's included?

LangChain quickstart contains 1 dashboard. These interactive visualizations let you easily explore your data, understand context, and resolve problems faster.
LangChain observability quickstart contains 3 alerts. These alerts detect changes in key performance metrics. Integrate these alerts with your favorite tools (like Slack, PagerDuty, etc.) and New Relic will let you know when something needs your attention.
Requests per model
This alert is triggered if requests per model exceeds 1000 in 5 minutes.
Response time
This alert is triggered if response time exceeds 5 seconds in 5 minutes.
This alert is triggered if the number of errors exceeds 2 within 5 minutes.

Why monitor your LangChain application?

LangChain is a framework for developing applications powered by language models. By monitoring your LangChain app, we are providing you visibility on the chains, tools as well as inputs and outputs. By using the LangChain quickstart, you will be able to:

Track your app:

By tracking key metrics like latency, throughput, error rates, and input & output, you can gain insights into your LangChain app's performance and identify areas of improvement.

Track the LLM's performance:

Monitor the input & output, latency and errors of your LLM provider. Track performance changes with the providers and versions of your LLM. Monitor usage to understand the cost, rate limits, and general performance.

Track the query performance of your Vector DB

Track the behavior of your vector stores. Monitor the latency, queries, the number of documents retrieved, and the content of the documents so that you can evaluate their relevance.

Comprehensive monitoring quickstart for your LangChain app

Our LangChain quickstart provides metrics including error rate, input & output, latency, queries, retrieved document content and lets you integrate with different LLM providers and vector stores.

What’s included in this quickstart?

New Relic LangChain monitoring quickstart provides a variety of pre-built dashboards, which will help you gain insights into the health and performance of your LangChain app. These reports include:

  • LLM calls and chains
  • Tools
  • Vector searches
  • Alerts for errors, requests per model, and response time

How to use this quickstart

  • Sign Up for a free New Relic account or Log In to your existing account.
  • Click the install button.
  • Install the quickstart to get started or improve how you monitor your environment. They're filled with pre-built resources like dashboards, instrumentation, and alerts.
New Relic
Jyothi Surampudi
Need help? Visit our Support Center or check out our community forum, the Explorers Hub.
Related resources