54 lines
1.7 KiB
Markdown
54 lines
1.7 KiB
Markdown
# AI Model Architecture — IT Pro Partner
|
||
|
||
**Updated:** July 27, 2026
|
||
|
||
Two separate concepts that must not be conflated:
|
||
|
||
---
|
||
|
||
## Fallback Chain *(auto-failover — config.yaml)*
|
||
|
||
Survives admin-ai outage. Uses direct API keys for F1–F4.
|
||
|
||
| Tier | Model | Provider | Notes |
|
||
|---|---|---|---|
|
||
| **Primary** | `deepseek-v4-flash` | `admin-ai` | Fast, cheap conductor via LiteLLM |
|
||
| **F1** | `deepseek-v4-flash` | `deepseek` (direct) | Same model, direct API |
|
||
| **F2** | `gemini-3.6-flash` | `google` (direct) | Fast, free-tier eligible |
|
||
| **F3** | `grok-4.6` | `xai` (direct) | Verified working (NOT grok-4.5) |
|
||
| **F4** | `claude-sonnet-5` | `anthropic` (direct) | Premium survival fallback |
|
||
|
||
**Only fires when the model above it is unreachable.**
|
||
|
||
---
|
||
|
||
## Operational Models *(daily toolbox — admin-ai only)*
|
||
|
||
No direct API keys. Shared $5/day budget via hermes-agent-v3 key.
|
||
|
||
| Role | Model | When |
|
||
|---|---|---|
|
||
| Conductor | `deepseek-v4-flash` | Orchestrating, delegating, quick decisions |
|
||
| Workhorse | `deepseek-v4-pro` | Large context, big outputs, infra code |
|
||
| Workhorse | `deepseek-reasoner` | Multi-step analysis, debugging, planning |
|
||
| Auditor | `gemini-3.6-flash` | Sanity checks, every output (essentially free) |
|
||
| Auditor | `claude-sonnet-5` | Architecture, security, auth — sparingly ($15/M output) |
|
||
|
||
---
|
||
|
||
## Admin-AI Virtual Key
|
||
|
||
- **Key Name:** `hermes-agent-v3` (generated Jul 27, 2026)
|
||
- **Daily Budget Cap:** $5/day shared across all operational models
|
||
- **Expiry:** Jul 27, 2027
|
||
- **Master Key:** stored in Hudu
|
||
|
||
## Budget Targets
|
||
|
||
| Component | Daily est. |
|
||
|---|---|
|
||
| Conductor (ds-v4-flash) | ~$0.30 |
|
||
| Workhorses (ds-v4-pro + reasoner) | ~$1.70 |
|
||
| Auditors (gemini + claude sparingly) | ~$0.80 |
|
||
| **Total** | **$3–5/day** |
|