(fleet/prometheusrule-foreman) add foreman.dev disk warning#1442
(fleet/prometheusrule-foreman) add foreman.dev disk warning#1442badenerb wants to merge 1 commit into
Conversation
| expr: | | ||
| ( | ||
| node_filesystem_avail_bytes{ | ||
| job="node-puppetdb", |
There was a problem hiding this comment.
Constraining by the job name shouldn't be necessary.
| device="/dev/mapper/almalinux-root" | ||
| } | ||
| / | ||
| node_filesystem_size_bytes{ |
There was a problem hiding this comment.
This can be simplified to node_filesystem_size_bytes as prometheus will automatically match the same labels.
| rules: | ||
| - alert: ForemanRootDiskLowFreeSpace | ||
| annotations: | ||
| summary: Disk space warning on foreman.dev.lsst.org |
There was a problem hiding this comment.
| summary: Disk space warning on foreman.dev.lsst.org | |
| summary: 'Disk space warning on {{ $labels.instance }}' |
| annotations: | ||
| summary: Disk space warning on foreman.dev.lsst.org | ||
| description: > | ||
| Disk free space is below 10% on foreman.dev.lsst.org for device /dev/mapper/almalinux-root. |
There was a problem hiding this comment.
| Disk free space is below 10% on foreman.dev.lsst.org for device /dev/mapper/almalinux-root. | |
| Disk free space is below 10% on {{ $labels.instance }} for device {{ $labels.device }}. |
| } == 0 | ||
| for: 5m | ||
| labels: | ||
| gnoc: "true" |
There was a problem hiding this comment.
We don't want to send this to the gnoc as it isn't something the other network operators need to know about.
| labels: | ||
| gnoc: "true" | ||
| severity: warning | ||
| node_name: foreman.dev.lsst.org |
There was a problem hiding this comment.
| node_name: foreman.dev.lsst.org | |
| node_name: '{{ $labels.instance }}' |
| gnoc: "true" | ||
| severity: warning | ||
| node_name: foreman.dev.lsst.org | ||
| device: /dev/mapper/almalinux-root |
There was a problem hiding this comment.
| device: /dev/mapper/almalinux-root | |
| device: '{{ $labels.device }}' |
| severity: warning | ||
| node_name: foreman.dev.lsst.org | ||
| device: /dev/mapper/almalinux-root | ||
| service_name: null |
There was a problem hiding this comment.
This format is only required for gnoc alerts, so I would omit this label.
| } | ||
| ) < 0.10 | ||
| and | ||
| node_filesystem_readonly{ |
There was a problem hiding this comment.
The labels could also be omitted from this metric.
When would this mount be readonly while the prom exporter is running?
No description provided.