Integrate Ollama for heartbeats and routine tasks - local LLM for zero cost

This commit is contained in:
Jarvis
2026-02-05 10:29:44 -07:00
parent dc40242efc
commit f773d044b9
4 changed files with 29 additions and 28 deletions

View File

@@ -11,12 +11,22 @@
**Monthly Budget:**
- **$20 total**
- **Warn at 75%** ($15 spent)
- **Ollama tasks are free** — prioritize for routine work
---
## MODEL SELECTION
### Default: Always use Haiku
### Tier 1: Ollama (Free Local)
Use for:
- File checking and organization
- Heartbeat tasks (status checks, log review)
- Simple templating/formatting
- Non-critical analysis
**Advantage:** Free, instant, zero API cost
### Tier 2: Default - Haiku
Switch to **Sonnet** ONLY when:
- Architecture decisions
@@ -27,6 +37,8 @@ Switch to **Sonnet** ONLY when:
### Decision Rule
**When in doubt:** Try Haiku first.
- **Ollama first** for routine/repetitive work
- **Haiku second** for most other tasks
- **Sonnet last** for genuinely complex thinking
If Haiku struggles or gives incomplete answers, escalate to Sonnet.
**When in doubt:** Try Ollama first, escalate if needed.