ippadmin/itpp-infrastructure
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Model fallback chain: GPT-5.5 primary, 5 providers, Ollama removed, DNS updates

Browse Source
This commit is contained in:
root
2026-07-17 13:28:05 -04:00
parent 17e1fee30e
commit 3424b9013b
3 changed files with 43 additions and 12 deletions
Download Patch File Download Diff File Expand all files Collapse all files
README.md
+21 -7
View File
@@ -13,22 +13,20 @@
- **Provider:** netcup RS 2000 G12
- **Specs:** 8 vCPU EPYC 9645, 15 GB DDR5 ECC, 512 GB NVMe
- **OS:** Debian 13
- **Role:** Hermes + Ollama fallback + Portals
- **Role:** Hermes + Portals
- **Key Services:**
- Hermes Agent (Telegram + cron, 22 cron jobs)
- Caddy reverse proxy (10 domains, auto-TLS)
- Caddy reverse proxy (12 domains, auto-TLS)
- Ops Portal (FastAPI, port 8090)
- Prometheus (native, port 9090) + Grafana (native, port 3002)
- Uptime Kuma (Docker, port 3001) — 9+ monitors
- Vaultwarden (Docker, port 8080) — vault.iamgmb.com
- Super Search MCP v2.0.0 — migrated to app1
- Twenty CRM (Docker) — crm.debtrecoveryexperts.com
- DocuSeal (Docker, port 3000) — sign.core.itpropartner.com
- SearXNG (Docker, port 8888)
- Komodo (Docker, port 9120)
- Tailscale, StrongSwan, WireGuard (home CCR tunnel 10.77.0.0/24)
- Redis cache
- Ollama (systemd, port 11434)
### App1 Server
- **Hostname:** app1
@@ -38,7 +36,6 @@
- **OS:** Debian 13
- **Role:** AI/Service Hub
- **Key Services:**
- Ollama (Docker, port 11434)
- Open WebUI (Docker, port 3000) — ai.itpropartner.com
- n8n + Postgres (Docker, port 5678) — n8n.itpropartner.com
- LiteLLM (Docker) + Postgres — admin-ai.itpropartner.com
@@ -89,8 +86,25 @@
### Legacy / Decommissioned
- **old-ai:** 178.156.167.181 (Hetzner CPX41) — **decommissioned** (LiteLLM migrated to app1)
- **old app1:** 87.99.144.163 (Hetzner CPX11) — **deleted**
- **wphost02:** 5.161.62.38 (Hetzner CPX21) — **migrating to app3**
- **Tony Hermes:** 87.99.159.142 (Hetzner CPX21) — Anthony's personal Hermes
- **wphost02:** 5.161.62.38 (Hetzner CPX21) — **migrated to app3**
- **Ollama:** Removed from Core (systemd) and app1 (Docker) Jul 17
---
## Model Fallback Chain
All providers use direct API keys. GPT-5.5 quality survives through admin-ai → OpenRouter, then degrades through DeepSeek → Gemini → Grok.
| # | Model | Provider | Gateway |
|---|---|---|---|
| Primary | GPT-5.5 | admin-ai | Self-hosted LiteLLM (app1) |
| Fallback 1 | GPT-5.5 | OpenRouter | openrouter.ai |
| Fallback 2 | DeepSeek v4 Pro | DeepSeek | api.deepseek.com |
| Fallback 3 | Gemini 3.5 Flash | Google | generativelanguage.googleapis.com |
| Fallback 4 | Grok 4.5 | xAI | api.x.ai |
**Credits (Jul 17):** DeepSeek $58, OpenRouter ~$30 remaining, OpenAI/xAI/Google on pay-as-you-go
**Health check:** Daily 8 AM cron (`model-usage-check`)
---