Grafana Cloud Alerts and IRM Machine Learning LLM plugin

LLM plugin

Grafana Cloud offers a range of optional features that leverage Large Language Model (LLM) services. These features are not enabled by default but can be enabled by installing and configuring the Grafana LLM app plugin. Currently, you must provide your own API authentication from supported LLM providers, which include OpenAI and Azure.

The Grafana LLM app is a plugin that centralizes access to Large Language Model (LLM) services across Grafana to secure and simplifies your LLM interactions.

The Grafana LLM application plugin currently serves several key functions:

• Securely stores API keys for LLM providers.
• Acts as a proxy, handling authenticated requests to LLMs. This eliminates the requirement for other Grafana components to manage API keys.
• Enables real-time streaming interactions on the Grafana front end by offering live streams of responses from LLM providers like OpenAI.

Before you begin

Before setting up the Grafana LLM app, you’ll need:

• A Grafana Cloud account, including the Free tier.
• API authentication for LLM access, either from OpenAI or Azure OpenAI. You can obtain an OpenAI API key from OpenAI’s platform, or Azure OpenAI authentication from the Azure OpenAI service.

Installation steps for Enterprise or OSS versions of Grafana are similar. Install the Grafana LLM plugin using the standard plugin installation method for your Grafana version.

For more information, refer to the Plugin management documentation.

Install the LLM plugin

To install the Grafana LLM app plugin, follow these steps:

1. In Grafana Cloud, click Administration > Plugins in the side navigation menu.
2. Click the All filter to browse all available plugins.
3. Browse plugins or search for LLM.
4. Click Install the plugin via grafana.com.
5. Choose the desired plugin version (if applicable), then click Install plugin.
6. Return to Grafana, and perform a search or reload the page (this may take a moment).
7. The plugin is now installed but not yet enabled.
8. Open the LLM plugin to complete the configuration and enable the plugin.

Enable the LLM plugin

After the plugin is installed, you must provide your API authentication details to complete the configuration.

To enable the LLM plugin:

1. Click to open the LLM plugin.
2. Select your OpenAI provider from the dropdown: OpenAI or Azure.
3. For OpenAI, enter your OpenAI API key and organization ID.
4. For Azure OpenAI: enter your API key and language API endpoint.
5. Click Save settings.
6. Click Enable to enable the plugin.

Now you can start using LLM-related functionality across Grafana. This includes features like panel title and description generation and Incident Auto-summary, unlocking the full potential of generative AI capabilities in Grafana.