fix(alert-monitor): job-label fallback in issue titles (TargetDown collision) #258

2026-07-16T10:23:32Z

claude-bot commented

2026-07-16 10:23:32 +00:00

Two distinct TargetDown alerts are firing — job=pve (the revoked token, #250) and job=dns-servers — but both collapsed into one issue title because TargetDown has no namespace label, so the dns-servers case was never triaged.

Corrected evidence (an earlier version of this PR wrongly claimed the hosts were retired and the srv.renner.uno zone dead — that came from a broken resolver on the workstation, not the cluster): Prometheus's own scrape state shows context deadline exceeded for all three proxmox-dns-*.srv.renner.uno:12345 targets since 2026-07-13 — names resolve, the metrics endpoint doesn't answer. Root cause TBD by the fix agent once the issue exists.

Title key becomes namespace // job // \"cluster\" — verified live: [alert] TargetDown (pve) and [alert] TargetDown (dns-servers) are now distinct.

Migration after merge (I will do it): retitle #250 to [alert] TargetDown (pve); the next 15-min tick then files the dns-servers issue fresh for the hourly fix agent.

🤖 Generated with Claude Code

https://claude.ai/code/session_01NV7bZzZLeoFUEdAeCSLEei

Two distinct TargetDown alerts are firing — job=pve (the revoked token, #250) and job=dns-servers — but both collapsed into one issue title because TargetDown has no namespace label, so the dns-servers case was never triaged. **Corrected evidence** (an earlier version of this PR wrongly claimed the hosts were retired and the srv.renner.uno zone dead — that came from a broken resolver on the workstation, not the cluster): Prometheus's own scrape state shows `context deadline exceeded` for all three `proxmox-dns-*.srv.renner.uno:12345` targets since 2026-07-13 — names resolve, the metrics endpoint doesn't answer. Root cause TBD by the fix agent once the issue exists. Title key becomes `namespace // job // \"cluster\"` — verified live: `[alert] TargetDown (pve)` and `[alert] TargetDown (dns-servers)` are now distinct. Migration after merge (I will do it): retitle #250 to `[alert] TargetDown (pve)`; the next 15-min tick then files the dns-servers issue fresh for the hourly fix agent. 🤖 Generated with [Claude Code](https://claude.com/claude-code) https://claude.ai/code/session_01NV7bZzZLeoFUEdAeCSLEei

claude-bot force-pushed fix/alert-title-job-fallback from 7d97cd6e60 to 74c2a2a75c

2026-07-16 10:27:05 +00:00

Compare

k.renner merged commit baf4ba3014 into master

2026-07-16 10:34:38 +00:00

k.renner referenced this issue from a commit

2026-07-16 10:34:39 +00:00

Merge pull request 'fix(alert-monitor): job-label fallback in issue titles (TargetDown collision)' (#258) from fix/alert-title-job-fallback into master

Sign in to join this conversation.

1 Participants

Notifications

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: konairius/homelab#258