New Relic Now ¿Sueñas con innovar más? Comienza a vivir tu sueño en octubre.
Reservar plaza
Por el momento, esta página sólo está disponible en inglés.
 / 
PaLM 2

PaLM 2

Improve the visibility of your PaLM 2 usage with New Relic PaLM 2 quickstart.

What's included?

dashboards
1
PaLM 2 quickstart contains 1 dashboard. These interactive visualizations let you easily explore your data, understand context, and resolve problems faster.
alerts
1
PaLM 2 observability quickstart contains 1 alert. These alerts detect changes in key performance metrics. Integrate these alerts with your favorite tools (like Slack, PagerDuty, etc.) and New Relic will let you know when something needs your attention.
Request duration
This alert is triggered if request duration exceeds 5 seconds over 5 minutes.

Why should you monitor your usage of PaLM 2?

Monitor your application powered by PaLM 2 language models to ensure, get visibility to what you send to PaLM 2, responses received from PaLM 2, latency, usage and errors. By monitoring the usage, you can infer the cost.

Track the LLM's performance:

Monitor the input & output, latency and errors of your LLM provider. Track performance changes with the providers and versions of your LLM. Monitor usage to understand the cost, rate limits, and general performance.

Track your app:

By tracking key metrics like latency, throughput, error rates, and input & output, you can gain insights into your PaLM 2 app's performance and identify areas of improvement.

Early issue detection:

Detect and address issues early to prevent them from affecting model performance.

Comprehensive PaLM 2 monitoring quickstart

Our PaLM 2 quickstart provides metrics including error rate, input & output, latency, queries, and lets you integrate with different language models.

What’s included in the PaLM 2 quickstart?

New Relic PaLM 2 monitoring quickstart provides a variety of pre-built dashboards, which will help you gain insights into the health and performance of your PaLM 2 usage. These reports include:

  • Dashboards (average tokens, LLM completion’s details, chain’s details, tool details, top tool names and many more)
  • Alerts (errors, request per model and response time)

How to use this quickstart

  • Sign Up for a free New Relic account or Log In to your existing account.
  • Click the install button.
  • Install the quickstart to get started or improve how you monitor your environment. They're filled with pre-built resources like dashboards, instrumentation, and alerts.
Authors
New Relic
Support
BUILT BY NEW RELIC
Need help? Visit our Support Center or check out our community forum, the Explorers Hub.