36 lines
1.1 KiB
Markdown
36 lines
1.1 KiB
Markdown
# VPS Threshold Alert System — Jul 2026
|
|
|
|
Automated monitoring system that checks RAM, disk, and CPU usage across all 10 servers every 15 minutes.
|
|
|
|
## Script
|
|
`/root/.hermes/scripts/vps-threshold-check.sh` (chmod 755)
|
|
|
|
## Cron job
|
|
`vps-threshold-check` — runs every 15 min, no_agent mode (stdout delivered as Telegram message)
|
|
|
|
## Servers monitored (10 total)
|
|
- 9 Hetzner servers (SSH via itpp-infra key, 5s timeout per host)
|
|
- 1 local (core, netcup RS 2000)
|
|
|
|
## Thresholds
|
|
| Metric | Warning (80%) | Critical (90%) | Emergency (95%) |
|
|
|--------|-------------|---------------|-----------------|
|
|
| Disk | 80% | 90% | 95% |
|
|
| RAM | 80% | 90% | 95% |
|
|
| CPU load | 80% cores utilized | 90% | 95% |
|
|
|
|
## Alert tracking
|
|
`/root/.hermes/data/threshold-alerts.json` — keys format: `{hostname}_{metric}_{threshold}`
|
|
- 24-hour cooldown per key
|
|
- Auto-resets when metric drops below threshold
|
|
- Re-alerts if metric crosses again after cooldown
|
|
|
|
## Alert format (Telegram)
|
|
```
|
|
🚨 VPS Alert: ai.itpropartner.com
|
|
⚠️ DISK at 92% (threshold: 90%)
|
|
⚠️ RAM at 83% (threshold: 80%)
|
|
```
|
|
|
|
Multiple thresholds on one server are combined into a single message.
|