ippadmin/itpp-infrastructure
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

docs: update model chain and add cost control rollout summary for 2026-07-24

Browse Source
This commit is contained in:
root
2026-07-24 16:05:35 -04:00
parent 98bb0e4d27
commit 54fc46ca14
2 changed files with 59 additions and 20 deletions
Download Patch File Download Diff File Expand all files Collapse all files
docs/model-chain.md
+22 -20
View File
@@ -1,26 +1,28 @@
# AI Model Chain — IT Pro Partner
**Updated:** July 21, 2026
**Sanitized:** July 23, 2026 (plaintext keys removed)
**Gateways:** admin-ai (self-hosted LiteLLM), OpenRouter, DeepSeek, Google, xAI
**Updated:** July 24, 2026
**Active Policy:** Cost-Controlled Multi-Tier Fallback Chain
## Chain
## Chain Configuration
| # | Model | Provider | Key Storage |
|---|---|---|---|
| Primary | GPT-5.5 | admin-ai | Hudu [126] Hermes Primary Key |
| F1 | GPT-5.5 | OpenRouter | Hudu [153] |
| F2 | DeepSeek v4 Pro | DeepSeek | Hudu [152] |
| F3 | Gemini 3.5 Flash | Google | Hudu [161] / [151] |
| F4 | Grok 4.5 | xAI | Hudu [154] |
| Tier | Model | Provider | Key / Endpoint | Notes |
|---|---|---|---|---|
| **Primary** | `claude-sonnet-5` | `admin-ai` | `~/.secure/hermes-normal-ops-key.json` | Main conductor via LiteLLM ($3.33/day cap) |
| **Fallback 1** | `deepseek-v4-pro` | `admin-ai` | `~/.secure/hermes-normal-ops-key.json` | Primary workhorse fallback on admin-ai |
| **Fallback 2** | `deepseek-v4-flash` | `admin-ai` | `~/.secure/hermes-normal-ops-key.json` | Fast low-cost fallback on admin-ai |
| **Fallback 3** | `deepseek-chat` | `deepseek` | Direct DeepSeek API Key | Independent provider (survives admin-ai outage) |
| **Fallback 4** | `grok-2-1212` | `xai` | Direct xAI API Key | Independent provider (survives admin-ai outage) |
## Admin-AI (LiteLLM)
- URL: `admin-ai.itpropartner.com` (app1, 152.53.36.131)
- Master key: `/root/docker/litellm/.env` on app1 (Hudu [178] LiteLLM Master Key)
- Hermes virtual key: Hudu [126] Hermes Primary Key (GPT-5.5 + DeepSeek v4 Pro routing)
## Admin-AI Proxy (LiteLLM)
- **URL**: `https://admin-ai.itpropartner.com/v1` (app1, `152.53.36.131`)
- **Master Key**: `/root/docker/litellm/.env` on app1 (Hudu [178] LiteLLM Master Key)
- **Hermes Virtual Key**: `hermes-normal-ops-daily-capped` (`~/.secure/hermes-normal-ops-key.json`)
- **Daily Budget Cap**: $3.33/day ($100/30-day cap)
## Credential Storage
- Config: `/root/.hermes/config.yaml`
- Hudu: All API assets under layout 49 at https://hudu.itpropartner.com — search "AI Provider" or by model name
- Git: `itpp-infrastructure/docs/model-chain.md` (this file, sanitized)
- Full inventory: `itpp-infrastructure/docs/key-inventory.md`
## Delegation Subagents
- **Model**: `deepseek-v4-pro` via `admin-ai`
- **Fallback**: `deepseek-v4-flash` via `admin-ai`
## Excluded from Production Routing
- **Gemini / Ollama**: Excluded from normal production routing per policy.
- **GPT-5.6 / Terra / Opus**: Escalation-only, requires explicit approval and user confirmation.