Grafana Cloud Monitor infrastructure Kubernetes Monitoring Configure Kubernetes Monitoring Configure manually for infrastructure Send metrics, logs, and events with Helm and Terraform

Send Kubernetes metrics, logs, and events to Grafana Cloud with Helm and Terraform

You can use Helm and Terraform to configure Kubernetes Monitoring, and use:

• The Kubernetes Monitoring GUI
• Preconfigured dashboards, alerts, and recording rules

Before you begin

Make sure you have the following available:

• Terraform CLI installed in your system
• Access to a Kubernetes Cluster
• The Admin role to install preconfigured components such as dashboards

Configuration steps

The steps to configure Kubernetes Monitoring with Terraform are:

1. Use a Grafana Cloud Access Policy token.
2. Install the preconfigured components.
3. Set up the Helm provider in Terraform.
4. Configure Terraform variables.
5. Install and configure the Helm chart.
6. Apply the Terraform configuration.

Step 1. Create or gather Grafana Cloud Access Policy token

You can create a new access policy token or look up an existing token. See Grafana Cloud Access Policies for more information.

You’ll use this token in a future step.

Step 2. Install preconfigured dashboards, alerts, and recording rules

To install preconfigured dashboards, alerts, and recording rules, complete the following steps:

1. Navigate to your Grafana Cloud account.
2. Click the upper-left menu icon to open the main menu.
3. Click Observability.
4. Click the Kubernetes tile. The Configuration page appears.
5. Under the heading Dashboards, alerts, and recording rules, click Install to install the dashboards, alerts, and recording rules.

Step 3. Configure the Helm provider in Terraform

Complete the following steps to create a provider.tf file and configure the provider.

1. Open a text editor or terminal and paste the following code:

   shell

   cat >> provider.tf <<'EOF'
   terraform {
     required_providers {
       helm = {
         source  = "hashicorp/helm"
         version = "2.9.0"
       }
     }
   }
   provider "helm" {
     kubernetes {
       config_path    = "~/.kube/config"
       config_context = "k3d-test"
     }
   }
   EOF

2. Replace {YOUR_CONTEXT} with the name of your Kubernetes context.

Step 4. Define Terraform variables

Complete the following steps to create a vars.tf file and configure the Terraform variables.

1. Open a text editor or terminal and paste the following code:

   shell

   cat >> vars.tf <<'EOF'
   variable "namespace" {
       type = string
       default = "{NAMESPACE}"
   }
   
   variable "cluster-name" {
       type = string
       default = "{CLUSTER_NAME}"
   }
   
   variable "prometheus-username" {
       type = number
       default = {METRICS_USERNAME}
   }
   
   variable "prometheus-url" {
       type = string
       default = "{PROMETHEUS_URL}"
   }
   
   variable "loki-username" {
       type = number
       default = {LOGS_USERNAME}
   }
   
   variable "loki-url" {
       type = string
       default = "{LOKI_URL}"
   }
   
   variable "cloud-access-token" {
       type = string
       default = "{GRAFANA_CLOUD_ACCESS_TOKEN}"
   }
   EOF

2. Replace the following in the code:

   • {NAMESPACE} with your namespace where you want to deploy Kubernetes Monitoring resources
   • {CLUSTER_NAME} with your Cluster name
   • {METRICS_USERNAME} with the Prometheus instance ID
   • {PROMETHEUS_URL} with the push endpoint URL of the Prometheus instance
   • {LOGS_USERNAME} with Loki Username
   • {LOKI_URL} with the push endpoint URL of the Loki instance
   • {GRAFANA_CLOUD_ACCESS_TOKEN} with your Grafana Cloud Access token

3. Run the code to create the vars.tf file with the specified variables.

   If you need to change the default value or add more variables, modify this file.

Step 5. Install and configure the Helm chart

Use the following command to create a Terraform configuration that installs and configures the Grafana Helm chart. This command installs the Helm chart and enables metrics, Pod logs, Cluster events and cost metrics.

```shell
cat >> grafana-k8s-monitoring.tf <<'EOF'
resource "helm_release" "grafana-k8s-monitoring" {
  name       = "grafana-k8s-monitoring"
  repository = "https://grafana.github.io/helm-charts"
  chart      = "k8s-monitoring"
  version    = "0.1.4"
  namespace  = var.namespace

  set {
    name  = "cluster.name"
    value = var.cluster-name
  }

  set {
    name  = "externalServices.prometheus.host"
    value = var.prometheus-url
  }

  set {
    name  = "externalServices.prometheus.basicAuth.username"
    value = var.prometheus-username
  }

  set {
    name  = "externalServices.prometheus.basicAuth.password"
    value = var.cloud-access-token
  }
  set {
    name  = "externalServices.loki.host"
    value = var.loki-url
  }

  set {
    name  = "externalServices.loki.basicAuth.username"
    value = var.loki-username
  }

  set {
    name  = "externalServices.loki.basicAuth.password"
    value = var.cloud-access-token
  }

  set {
    name  = "opencost.opencost.exporter.defaultClusterId"
    value = var.cluster-name
  }

  set {
    name  = "opencost.opencost.prometheus.external.url"
    value = "${var.prometheus-url}/api/prom"
  }
}
EOF
```

Step 6. Apply the Terraform configuration

Complete the following steps to apply the Terraform configuration and deploy the resources.

1. Open a terminal or shell.

2. Navigate to the directory where all the configuration files are located.

3. Run the following command to initialize the Terraform working directory:

   shell

   terraform init

   This command will download and initialize the necessary provider plugins and modules.

4. To preview the changes that Terraform will make, run the following command. This command will analyze your configuration and display the resources that will be created, modified, or deleted.

   shell

   terraform plan

5. Apply the configuration by running the following command:

   shell

   terraform apply

   Terraform will prompt you to confirm the execution of the plan. Type “yes”, and press Enter to proceed with the deployment.

Next steps

Explore your Kubernetes infrastructure to view the monitoring data.