Integrate Ollama for heartbeats and routine tasks - local LLM for zero cost
This commit is contained in:
@@ -11,12 +11,22 @@
|
||||
**Monthly Budget:**
|
||||
- **$20 total**
|
||||
- **Warn at 75%** ($15 spent)
|
||||
- **Ollama tasks are free** — prioritize for routine work
|
||||
|
||||
---
|
||||
|
||||
## MODEL SELECTION
|
||||
|
||||
### Default: Always use Haiku
|
||||
### Tier 1: Ollama (Free Local)
|
||||
Use for:
|
||||
- File checking and organization
|
||||
- Heartbeat tasks (status checks, log review)
|
||||
- Simple templating/formatting
|
||||
- Non-critical analysis
|
||||
|
||||
**Advantage:** Free, instant, zero API cost
|
||||
|
||||
### Tier 2: Default - Haiku
|
||||
|
||||
Switch to **Sonnet** ONLY when:
|
||||
- Architecture decisions
|
||||
@@ -27,6 +37,8 @@ Switch to **Sonnet** ONLY when:
|
||||
|
||||
### Decision Rule
|
||||
|
||||
**When in doubt:** Try Haiku first.
|
||||
- **Ollama first** for routine/repetitive work
|
||||
- **Haiku second** for most other tasks
|
||||
- **Sonnet last** for genuinely complex thinking
|
||||
|
||||
If Haiku struggles or gives incomplete answers, escalate to Sonnet.
|
||||
**When in doubt:** Try Ollama first, escalate if needed.
|
||||
|
||||
Reference in New Issue
Block a user