Rules

blackbox_tcp

10.893s ago

341.8us

Rule State Error Last Evaluation Evaluation Time
alert: BlackboxTCPFailure expr: probe_success == 0 for: 1m labels: severity: critical annotations: description: 'Blackbox TCP probe to {{ $labels.instance }} (service: {{ $labels.service }}) failed.' summary: TCP connectivity failed for {{ $labels.instance }} ok 10.893s ago 329.8us

extra-checks

6.365s ago

592us

Rule State Error Last Evaluation Evaluation Time
alert: ServiceDoesNotExist expr: service_exists == 0 for: 1m labels: severity: critical annotations: description: Systemd service '{{ $labels.service }}' is missing on instance {{ $labels.instance }}. summary: Service {{ $labels.service }} does NOT exist ok 6.365s ago 340.6us
alert: DotnetMissing expr: dotnet_exists == 0 for: 1m labels: severity: critical annotations: description: .NET runtime is NOT installed on instance {{ $labels.instance }}. summary: .NET runtime missing ok 6.365s ago 238.6us

nginx_alerts

1.621s ago

475.5us

Rule State Error Last Evaluation Evaluation Time
alert: NginxExporterDown expr: up{job="nginx"} == 0 for: 1m labels: severity: critical annotations: description: Prometheus cannot scrape NGINX metrics. summary: 'NGINX exporter down: {{ $labels.instance }}' ok 1.621s ago 291.9us
alert: NginxHighConnections expr: nginx_connections_active > 1000 for: 2m labels: severity: warning annotations: description: Active connections > 1000 for 2 minutes. summary: High NGINX connections on {{ $labels.instance }} ok 1.621s ago 168.4us

node_exporter_alerts

9.382s ago

6.322ms

Rule State Error Last Evaluation Evaluation Time
alert: HighCPUUsage expr: (100 - avg by (instance) (irate(node_cpu_seconds_total{mode="idle"}[5m])) * 100) > 90 for: 5m labels: severity: warning annotations: description: CPU usage is above 90% for 5 minutes. summary: High CPU usage on {{ $labels.instance }} ok 9.382s ago 3.462ms
alert: HighMemoryUsage expr: (1 - (node_memory_MemAvailable_bytes / node_memory_MemTotal_bytes)) * 100 > 90 for: 5m labels: severity: warning annotations: description: Memory usage is above 90%. summary: High memory usage on {{ $labels.instance }} ok 9.378s ago 871.1us
alert: HighDiskUsage expr: 100 * (1 - node_filesystem_avail_bytes{fstype!~"tmpfs|overlay",job="node_exporter",mountpoint!~"/run.*|/var/lib/docker.*"} / node_filesystem_size_bytes{fstype!~"tmpfs|overlay",job="node_exporter",mountpoint!~"/run.*|/var/lib/docker.*"}) > 90 for: 10m labels: severity: warning annotations: description: Filesystem {{ $labels.device }} mounted at {{ $labels.mountpoint }} is over 90% full. summary: Disk usage high on {{ $labels.instance }} ({{ $labels.mountpoint }}) ok 9.378s ago 1.64ms
alert: NodeDown expr: up{job="node_exporter"} == 0 for: 2m labels: severity: critical annotations: description: Node exporter is not reachable. summary: 'Node down: {{ $labels.instance }}' ok 9.376s ago 327.8us

rabbitmq_alerts

12.082s ago

475.3us

Rule State Error Last Evaluation Evaluation Time
alert: RabbitMQExporterDown expr: up{job="rabbitmq"} == 0 for: 2m labels: severity: critical annotations: description: Prometheus cannot scrape RabbitMQ metrics. summary: 'RabbitMQ exporter down: {{ $labels.instance }}' ok 12.082s ago 290.6us
alert: RabbitMQUnackedMessages expr: rabbitmq_queue_messages_unacked > 100 for: 5m labels: severity: warning annotations: description: Queue {{ $labels.queue }} has {{ $value }} unacked messages. summary: Unacked messages high on {{ $labels.instance }} ok 12.082s ago 102.9us
alert: RabbitMQQueueTooLarge expr: rabbitmq_queue_messages_ready > 500 for: 5m labels: severity: warning annotations: description: Queue {{ $labels.queue }} has {{ $value }} ready messages. summary: Queue backlog on {{ $labels.instance }} ok 12.082s ago 66.67us

service_status

8.827s ago

335us

Rule State Error Last Evaluation Evaluation Time
alert: AnyServiceDown expr: service_running == 0 for: 1m labels: severity: critical annotations: description: Service {{ $labels.service }} is not running on {{ $labels.instance }}. summary: Service {{ $labels.service }} is DOWN on {{ $labels.instance }} ok 8.827s ago 319.8us

service_status

4.152s ago

441.6us

Rule State Error Last Evaluation Evaluation Time
alert: SystemdServiceDown expr: node_systemd_unit_state{name=~"report.service",state!="active"} == 1 for: 1m labels: severity: critical annotations: description: Service {{ $labels.name }} has been reported as not running on {{ $labels.instance }}. summary: Service {{ $labels.name }} is DOWN on {{ $labels.instance }} ok 4.152s ago 429.5us

service_status

23ms ago

310.9us

Rule State Error Last Evaluation Evaluation Time
alert: AnyServiceDown expr: service_running == 0 for: 30s labels: severity: critical annotations: description: Service {{ $labels.service }} has been reported as not running on {{ $labels.instance }}. summary: Service {{ $labels.service }} is DOWN on {{ $labels.instance }} ok 23ms ago 298.3us