ippadmin/itpp-infrastructure
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

docs: promote claude-sonnet-5 to primary @ admin-ai and demote gpt-5.6-terra to F2

Browse Source
This commit is contained in:
root
2026-07-24 16:12:34 -04:00
parent 54fc46ca14
commit 5f48e0213a
1 changed files with 12 additions and 22 deletions
Download Patch File Download Diff File Expand all files Collapse all files
docs/model-chain.md
+12 -22
View File
@@ -1,28 +1,18 @@
# AI Model Chain — IT Pro Partner # AI Model Chain — IT Pro Partner
**Updated:** July 24, 2026 **Updated:** July 24, 2026
**Active Policy:** Cost-Controlled Multi-Tier Fallback Chain
## Chain Configuration ## Active Fallback Chain
| Tier | Model | Provider | Key / Endpoint | Notes | | Tier | Model | Provider | Notes |
|---|---|---|---|---| |---|---|---|---|
| **Primary** | `claude-sonnet-5` | `admin-ai` | `~/.secure/hermes-normal-ops-key.json` | Main conductor via LiteLLM ($3.33/day cap) | | **Primary** | `claude-sonnet-5` | `admin-ai` | Conductor via LiteLLM ($3.33/day cap) |
| **Fallback 1** | `deepseek-v4-pro` | `admin-ai` | `~/.secure/hermes-normal-ops-key.json` | Primary workhorse fallback on admin-ai | | **Fallback 1 (F1)** | `deepseek-v4-pro` | `deepseek` | Direct DeepSeek API |
| **Fallback 2** | `deepseek-v4-flash` | `admin-ai` | `~/.secure/hermes-normal-ops-key.json` | Fast low-cost fallback on admin-ai | | **Fallback 2 (F2)** | `gpt-5.6-terra` | `admin-ai` | Demoted from Primary via LiteLLM ($3.33/day cap) |
| **Fallback 3** | `deepseek-chat` | `deepseek` | Direct DeepSeek API Key | Independent provider (survives admin-ai outage) | | **Fallback 3 (F3)** | `grok-4.5` (`grok-2-1212`) | `xai` | Direct xAI API |
| **Fallback 4** | `grok-2-1212` | `xai` | Direct xAI API Key | Independent provider (survives admin-ai outage) | | **Fallback 4 (F4)** | `gemini-3.6-flash` | `google` | Direct Google API |
## Admin-AI Proxy (LiteLLM) ## Admin-AI Virtual Key
- **URL**: `https://admin-ai.itpropartner.com/v1` (app1, `152.53.36.131`) - **Key Hash**: `0237186aaff1ed90295c00d73103103900d4bd07252ec1806af8a4358e45d37a`
- **Master Key**: `/root/docker/litellm/.env` on app1 (Hudu [178] LiteLLM Master Key) - **Allowed Models**: `claude-sonnet-5`, `gpt-5.6-terra`, `deepseek-v4-pro`, `deepseek-v4-flash`, `glm-5.2`, `MiniMax-M3`, `qwen3.7-plus`
- **Hermes Virtual Key**: `hermes-normal-ops-daily-capped` (`~/.secure/hermes-normal-ops-key.json`) - **Daily Budget Cap**: $3.33 / day
- **Daily Budget Cap**: $3.33/day ($100/30-day cap)
## Delegation Subagents
- **Model**: `deepseek-v4-pro` via `admin-ai`
- **Fallback**: `deepseek-v4-flash` via `admin-ai`
## Excluded from Production Routing
- **Gemini / Ollama**: Excluded from normal production routing per policy.
- **GPT-5.6 / Terra / Opus**: Escalation-only, requires explicit approval and user confirmation.