kube-prometheus-stack安装
kube-prometheus-stack artifacthub
简介
kube-prometheus-stack 是一个 完整的 Kubernetes 监控解决方案的 Helm Chart，它打包了 Prometheus Operator 和相关的监控组件。
主要包含的组件：
核心监控组件：
- Prometheus - 监控系统和时间序列数据库
- Alertmanager - 告警管理组件
- Grafana - 数据可视化和仪表板
- Prometheus Operator - 简化 Prometheus 在 K8s 中的部署和管理
数据采集组件：
- Node Exporter - 节点级指标采集
- kube-state-metrics - Kubernetes 集群状态指标
- 各种 Exporters - 应用和中间件指标采集
安装
添加仓库
helm repo add prometheus-community https://prometheus-community.github.io/helm-charts
更新仓库
helm repo update
下载包
helm pull prometheus-community/kube-prometheus-stack
解压缩
tar xf kube-prometheus-stack-79.7.1.tgz
编辑 values.yaml
-
配置ingress
-
配置sc
-
配置其他项
安装
helm upgrade --install kube-prometheus-stack -n kube-prometheus-stack --create-namespace .
一个小插曲
安装完成后发现没有 prometheus pod
$ k get pod
NAME READY STATUS RESTARTS AGE
alertmanager-kube-prometheus-stack-alertmanager-0 2/2 Running 0 2m51s
kube-prometheus-stack-grafana-0 3/3 Running 0 2m52s
kube-prometheus-stack-kube-state-metrics-787d55fc86-fzs4l 1/1 Running 0 2m52s
kube-prometheus-stack-operator-d58f748bb-qnmzl 1/1 Running 0 2m52s
kube-prometheus-stack-prometheus-node-exporter-5rpdx 1/1 Running 0 2m52s
kube-prometheus-stack-prometheus-node-exporter-qxxbj 1/1 Running 0 2m52s
kube-prometheus-stack-prometheus-node-exporter-zm9st 1/1 Running 0 2m52s
查看日志报错发现是sc的问题
$ kubectl logs -n kube-prometheus-stack deploy/kube-prometheus-stack-operator
ts=2025-12-03T02:04:33.627620701Z level=info caller=/go/pkg/mod/k8s.io/client-go@v0.34.1/tools/cache/shared_informer.go:356 msg="Caches are synced" controller=prometheus
ts=2025-12-03T02:04:33.627623701Z level=info caller=/workspace/pkg/prometheus/server/operator.go:446 msg="successfully synced all caches" component=prometheus-controller
ts=2025-12-03T02:04:33.63089128Z level=error caller=/workspace/pkg/operator/resource_reconciler.go:680 msg="Unhandled Error" logger=UnhandledError err="sync \"kube-prometheus-stack/kube-prometheus-stack-prometheus\" failed: storage class \"gluster\" does not exist"
ts=2025-12-03T02:04:33.634116901Z level=error caller=/workspace/pkg/operator/resource_reconciler.go:680 msg="Unhandled Error" logger=UnhandledError err="sync \"kube-prometheus-stack/kube-prometheus-stack-prometheus\" failed: storage class \"gluster\" does not exist"
ts=2025-12-03T02:04:33.64053081Z level=error caller=/workspace/pkg/operator/resource_reconciler.go:680 msg="Unhandled Error" logger=UnhandledError err="sync \"kube-prometheus-stack/kube-prometheus-stack-prometheus\" failed: storage class \"gluster\" does not exist"
ts=2025-12-03T02:04:33.644490472Z level=error caller=/workspace/pkg/operator/resource_reconciler.go:680 msg="Unhandled Error" logger=UnhandledError err="sync \"kube-prometheus-stack/kube-prometheus-stack-prometheus\" failed: storage class \"gluster\" does not exist"
ts=2025-12-03T02:04:33.649291967Z level=error caller=/workspace/pkg/operator/resource_reconciler.go:680 msg="Unhandled Error" logger=UnhandledError err="sync \"kube-prometheus-stack/kube-prometheus-stack-prometheus\" failed: storage class \"gluster\" does not exist"
在 values.yaml 中，sc默认是 gluster ，修改sc为当前集群可用的sc即可
prometheus:
prometheusSpec:
......
storageSpec:
## Using PersistentVolumeClaim
##
volumeClaimTemplate:
spec:
storageClassName: gluster
accessModes: ["ReadWriteOnce"]
resources:
requests:
storage: 50Gi
修改完成后再重新安装就可以了
$ k get pod
NAME READY STATUS RESTARTS AGE
prometheus-kube-prometheus-stack-prometheus-0 2/2 Running 0 13h
报错
prometheus pod一直为 Pending 状态
$ k get pod
NAME READY STATUS RESTARTS AGE
prometheus-kube-prometheus-stack-prometheus-0 0/2 Pending 0 2m21s
发现是pvc一直 pending
$ k get pvc
NAME STATUS VOLUME CAPACITY ACCESS MODES STORAGECLASS VOLUMEATTRIBUTESCLASS AGE
prometheus-kube-prometheus-stack-prometheus-db-prometheus-kube-prometheus-stack-prometheus-0 Pending openebs-hostpath <unset> 13m
Events 报错failed to provision volume with StorageClass "openebs-hostpath": claim.Spec.Selector is not supported
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal WaitForFirstConsumer 10m persistentvolume-controller waiting for first consumer to be created before binding
Normal Provisioning 2m58s (x7 over 10m) openebs.io/local_openebs-localpv-provisioner-6fc86fd79-nlvlk_1c2e3965-f0a4-412c-9950-bfbe15b7e670 External provisioner is provisioning volume for claim "kube-prometheus-stack/prometheus-kube-prometheus-stack-prometheus-db-prometheus-kube-prometheus-stack-prometheus-0"
Warning ProvisioningFailed 2m58s (x7 over 10m) openebs.io/local_openebs-localpv-provisioner-6fc86fd79-nlvlk_1c2e3965-f0a4-412c-9950-bfbe15b7e670 failed to provision volume with StorageClass "openebs-hostpath": claim.Spec.Selector is not supported
解决方法是在 prometheus 配置持久化的 volumeClaimTemplate 下把 selector: {} 注释
storageSpec:
## Using PersistentVolumeClaim
##
volumeClaimTemplate:
spec:
storageClassName: openebs-hostpath
accessModes: ["ReadWriteOnce"]
resources:
requests:
storage: 50Gi
#selector: {} # 注释这一行
