1.7 KiB
1.7 KiB
AI Model Architecture — IT Pro Partner
Updated: July 27, 2026
Two separate concepts that must not be conflated:
Fallback Chain (auto-failover — config.yaml)
Survives admin-ai outage. Uses direct API keys for F1–F4.
| Tier | Model | Provider | Notes |
|---|---|---|---|
| Primary | deepseek-v4-flash |
admin-ai |
Fast, cheap conductor via LiteLLM |
| F1 | deepseek-v4-flash |
deepseek (direct) |
Same model, direct API |
| F2 | gemini-3.6-flash |
google (direct) |
Fast, free-tier eligible |
| F3 | grok-4.6 |
xai (direct) |
Verified working (NOT grok-4.5) |
| F4 | claude-sonnet-5 |
anthropic (direct) |
Premium survival fallback |
Only fires when the model above it is unreachable.
Operational Models (daily toolbox — admin-ai only)
No direct API keys. Shared $5/day budget via hermes-agent-v3 key.
| Role | Model | When |
|---|---|---|
| Conductor | deepseek-v4-flash |
Orchestrating, delegating, quick decisions |
| Workhorse | deepseek-v4-pro |
Large context, big outputs, infra code |
| Workhorse | deepseek-reasoner |
Multi-step analysis, debugging, planning |
| Auditor | gemini-3.6-flash |
Sanity checks, every output (essentially free) |
| Auditor | claude-sonnet-5 |
Architecture, security, auth — sparingly ($15/M output) |
Admin-AI Virtual Key
- Key Name:
hermes-agent-v3(generated Jul 27, 2026) - Daily Budget Cap: $5/day shared across all operational models
- Expiry: Jul 27, 2027
- Master Key: stored in Hudu
Budget Targets
| Component | Daily est. |
|---|---|
| Conductor (ds-v4-flash) | ~$0.30 |
| Workhorses (ds-v4-pro + reasoner) | ~$1.70 |
| Auditors (gemini + claude sparingly) | ~$0.80 |
| Total | $3–5/day |