Initial skills documentation — 25 categories, all SKILL.md + references + scripts

2026-07-15 17:42:20 -04:00
commit 1b4fcd4427
976 changed files with 188344 additions and 0 deletions
@@ -0,0 +1,36 @@
+# Ollama Model RAM Sizing — Core Server
+
+## Server Specs
+- **Model:** netcup RS 2000 G12
+- **RAM:** 15 GB total
+- **vCPUs:** 8 (EPYC 9645)
+- **Swap:** /dev/vzswap (compressed swap — not real RAM)
+
+## Model Testing Results (Jul 11, 2026)
+
+| Model | Params | Quant | Size on Disk | Loads? | RAM Needed | Notes |
+|-------|--------|-------|-------------|--------|------------|-------|
+| `llama3.2:3b` | 3B | Q4_K_M | 2.0 GB | ✅ Yes | ~3-4 GB | Default local fallback |
+| `llama3.3:70b` | 70B | Q4_K_M | 42 GB | ❌ No | ~35-40 GB | Error: `insufficient memory (attempted to allocate 31320 MB)` |
+
+## Diagnostic Commands
+
+```bash
+# Show currently LOADED models (models actually in memory)
+ollama ps
+
+# Show DOWNLOADED models (models available but may not load)
+ollama list
+
+# Check memory usage
+free -h
+
+# Check Ollama errors
+journalctl -u ollama --no-pager | grep -i "insufficient memory\|failed to load"
+```
+
+## Key Rule
+
+`ollama list` shows what's downloaded. `ollama ps` shows what's actually loadable. A model can pass `ollama list` and still be unusable if RAM is insufficient. Always check `ollama ps` + `journalctl -u ollama` before declaring a model operational.
+
+For this server (15 GB RAM), the maximum viable model is ~7B params at Q4 quantization (~4-5 GB RAM). 13B models at Q4 may fit (~8 GB) but leave little room for Ollama's overhead + system processes. 70B models are impossible without additional RAM.