80 lines
4.1 KiB
Markdown
80 lines
4.1 KiB
Markdown
# AI Model Architecture — IT Pro Partner
|
|
|
|
**Updated:** August 6, 2026
|
|
|
|
Two separate concepts: **fallback chain** (survival — direct API keys) and **operational chain** (daily toolbox — admin-ai only). The two-key strategy means operational keys run through admin-ai/LiteLLM; fallback keys are direct provider API keys with daily limits.
|
|
|
|
---
|
|
|
|
## Fallback Chain *(auto-failover — direct API keys)*
|
|
|
|
Survives admin-ai outage. All direct provider keys have daily caps. Fires in order — only when the model above is unreachable.
|
|
|
|
| Tier | Model | Provider | Key type | Daily cap |
|
|
|---|---|---|---|---|
|
|
| **Primary** | `deepseek-v4-pro` | `admin-ai` | operational | $30/mo budget |
|
|
| **F1** | `deepseek-v4-flash` | `deepseek` (direct) | fallback | $3 |
|
|
| **F2** | `gemini-3.6-flash` | `google` (direct) | fallback | $2 |
|
|
| **F3** | `grok-4.5` | `xai` (direct) | fallback | $2 |
|
|
| **F4** | `claude-sonnet-5` | `anthropic` (direct) | fallback | $5 |
|
|
| **F5** | `gpt-4.1-nano` | `openai` (direct) | fallback | $2 |
|
|
|
|
Total emergency budget: **$14/day** — down from $45 single-leg burn on Aug 5.
|
|
|
|
---
|
|
|
|
## Operational Models *(daily toolbox — admin-ai only)*
|
|
|
|
All route through admin-ai. Shared budget via `hermes-agent-v5` key.
|
|
|
|
| Role | Model | Provider | Use When |
|
|
|---|---|---|---|
|
|
| **Conductor** | `deepseek-v4-pro` | admin-ai (DeepSeek) | All standard work — orchestration, delegation, coding |
|
|
| **Workhorse** | `deepseek-v4-pro` | admin-ai (DeepSeek) | Delegated tasks, scripts, infra code |
|
|
| **Batch Workhorse** | `deepseek-v4-flash` | admin-ai (DeepSeek) | Bulk scripts, log parsing, repetitive tasks |
|
|
| **Lightweight** | `claude-haiku-4-5` | admin-ai (Anthropic) | Email triage, classification, simple tasks |
|
|
| **Simple Workhorse** | `gpt-5.6-luna` | admin-ai (OpenAI) | Lightweight tasks under 128K context |
|
|
| **Auditor** | `gpt-5.6-luna` | admin-ai (OpenAI) | Code review, QA (primary auditor) |
|
|
| **Auditor 2** | `xai/grok-4.5` | admin-ai (xAI) | Second-opinion code review (different provider) |
|
|
| **Critical** | `claude-sonnet-5` | admin-ai (Anthropic) | Client comms, legal docs, architecture (explicit) |
|
|
| **Professional Comms** | `gemini-3.6-flash` | admin-ai (Google) | Client emails, professional messaging |
|
|
|
|
---
|
|
|
|
## Admin-AI Virtual Keys
|
|
|
|
### hermes-agent-v5 (Main — Sho'Nuff)
|
|
- **Created:** Jul 31, 2026
|
|
- **Budget:** $30/day
|
|
- **Spend:** $20.36 (as of Aug 6)
|
|
- **Models (7):** deepseek-v4-pro, deepseek-v4-flash, gemini-3.6-flash, claude-sonnet-5, claude-haiku-4-5, gpt-5.6-luna, xai/grok-4.5
|
|
|
|
### Anita's Hermes Key
|
|
- **Budget:** $10/day
|
|
- **Spend:** $0.11 (as of Aug 6)
|
|
- **Models (7):** deepseek-v4-pro, deepseek-v4-flash, gemini-flash-latest, claude-sonnet-5, claude-haiku-4-5, gpt-5.6-luna, xai/grok-4.5
|
|
|
|
---
|
|
|
|
## Budget Targets
|
|
|
|
| Component | Daily est. |
|
|
|---|---|
|
|
| Conductor + Workhorse (ds-v4-pro) | ~$3.00 |
|
|
| Batch Workhorse (ds-v4-flash) | ~$0.50 |
|
|
| Lightweight (haiku-4-5) | ~$0.30 |
|
|
| Simple Workhorse (luna) | ~$0.50 |
|
|
| Auditors (luna + grok-4.5) | ~$0.80 |
|
|
| Critical (sonnet-5, sparingly) | ~$2.00 |
|
|
| **Total** | **~$7/day** |
|
|
|
|
---
|
|
|
|
## Key Decisions
|
|
|
|
- **Jul 29, 2026:** DeepSeek V4 Flash demoted from conductor to F1 fallback. Was hallucinating tool calls. V4 Pro promoted to primary conductor.
|
|
- **Jul 30, 2026:** LiteLLM key regenerated — hermes-agent-v3 created but config.yaml NOT updated. Hermes fell back to DeepSeek direct since Jul 30 19:25 UTC.
|
|
- **Jul 31, 2026:** Discovered stale key in config.yaml. Generated hermes-agent-v5 with same model list. Verified chat OK. Cleaned up stale keys (v3, v4, v4b).
|
|
- **Aug 5, 2026:** Admin-ai budget cap hit (~$20). Fallback chain exhausted 4 dead legs, landed on Anthropic direct. Burned $45 in 10 hours on claude-sonnet-5 via direct key. Anthropic key capped until Sep 1.
|
|
- **Aug 6, 2026:** Root cause of Aug 5 outage: 4 fallback legs dead simultaneously (admin-ai budget, DeepSeek balance $0, grok-4.6 404, Anthropic capped). Implemented two-key strategy (operational vs fallback). Rotated all 5 fallback keys. Added F5 (gpt-4.1-nano via OpenAI). Added haiku-4-5 and grok-4.5 to operational chain. Fixed grok-4.6 → grok-4.5. Synced Anita profile identically. Budget raised to $30.
|