Grafana Kubernetes MonitoringNavigate Kubernetes Monitoring

Navigate Kubernetes Monitoring

After you configure and begin monitoring telemetry data in Kubernetes Monitoring, you can navigate through your nodes and pods to evaluate their health. This topic shows how to do so. If you have not yet set up Kubernetes Monitoring, select one of the following:

Topicdescription
Configure Kubernetes MonitoringInstall and configure Kubernetes Monitoring to monitor your cluster. Learn what a Kubernetes Monitoring configuration provides, including manifests, dashboards, alert rules, and more.
Monitor an application on KubernetesLearn how to deploy an instrumented three-tier (data layer, app logic layer, load-balancing layer) web application into a Kubernetes cluster, and leverage Grafana Cloud’s built-in Kubernetes features for monitoring this application.

Cluster navigation

Cluster navigation helps you explore your infrastructure by navigating through the object model.

On the top level of the Cluster navigation tab, you can can:

  • Select a data source to view its namespaces and clusters.
  • Filter by namespace and cluster.
  • View the status phase of a namespace and cluster.
  • View the alerts for a namespace and cluster in Grafana Alerting by clicking its number of alerts in the Alerts firing column.
  • Click a namespace to drill down to view its workloads and pods.

Namespace view

Click a namespace from the top level of the Cluster navigation tab to view its workloads and the health of the pods inside each workload.

Workload view

Click a workload in the namespace view to see a list of associated pods and general information, such as the date the workload was created, replica information, and the observed generation. Click a pod to view detailed pod health information.

Pod view

When you click on a pod from the workload list, you can view its status. If a pod is healthy, the health bar is green. If not, the health bar is red. The Pod view also displays a quick graph of CPU usage from the past hour. You can also view the latest 100 log lines, and latest events if your stack is configured for logs and events.

Node monitoring

The Node monitoring view displays all of the nodes in your clusters, as well as their condition, utilization, and pod density. This information can help you to improve your configuration by identifying when you might increase or decrease the number and size of nodes to improve performance.

To view the status of pods and workloads on each of your nodes, click the Node tab in Kubernetes Monitoring, and select a node. You can filter by cluster and by node condition. Node monitoring gives you an immediate view of node capacity and general information.

Node capacity

The Node capacity section displays how much of a node’s resources you’re using. CPU, memory, and disk space all have usage bars that flag, with color, the following usage thresholds:

  • Green: usage is 40-75% of maximum. This is the ideal state of resource usage.
  • Yellow: usage is below 40%, or between 75% and 90%. Low usage percentages indicate that the node might be over-provisioned; higher percentages are approaching maximum capacity.
  • Red: usage is 90-100%. Your node resource is dangerously close to maximum capacity.

Node information

The Node information section displays general node data, including the node’s internal_ip, job, labels, and the current version of Kubernetes.

Pods

The Pods section lists information for all of the pods in the node.

You can quickly determine the health of the pod according to the color of the vertical boundary to the left of the pod name:

  • Green: The pod is running.
  • Red: The pod is not running.

Click the pod name to drill down to pod-level information, including the latest logs and events.

NOTE: You can only view events if you’ve installed the default dashboards and alerts (this deploys Grafana Agent), or used Grafana Agent or Grafana Agent Operator to ship your kube-state-metrics.

Dashboards

Kubernetes Monitoring includes nine dashboards out of the box to help you get started with observing and monitoring your Kubernetes clusters and their workloads. This set includes the following:

  • (Home) Kubernetes Overview, the principal dashboard that displays high-level cluster resource usage and configuration status.

  • Kubernetes / Compute Resources (7 dashboards), a set of dashboards to drill down into resource usage by the following levels:

    • Multi-cluster
    • Cluster
    • Namespace (by Pods)
    • Namespace (by workloads, like Deployments or DaemonSets)
    • Node
    • Pods and containers
    • Workloads (Deployments, DaemonSets, StatefulSets, etc.)

    These dashboards contain links to sub-objects, so you can jump from cluster, to Namespace, to Pod, etc.

  • Kubernetes / Kubelet, a dashboard that helps you understand Kubelet performance on your Nodes, and provides useful summary metrics like number of running Pods, Containers, and Volumes on a given Node .

  • Kubernetes / Persistent Volumes, a dashboard that helps you understand usage of your configured PersistentVolumes.

Configuration

Users with the Admin role can use the Configuration tab to install or uninstall preconfigured dashboards and alerts. You can also view instructions to configure and deploy Grafana Agent to keep it up-to-date. For more information on updating your dashboards and rules, see Update Grafana Kubernetes components.

Note: In order to see the Grafana Agent configuration instructions, you must have the preconfigured dashboards and alerts installed.