💭 in your head · nothing to type
The agent in your project keeps answering in the wrong format. You've already rewritten the prompt three times, added examples, put a template in the context. It got better, but not perfect.
Somewhere nearby you hear the advice: "Just fine-tune the model."
Before agreeing, consider: what exactly needs to change — the model's knowledge, its manner, or your framing of the task?
💭 in your head · nothing to type
These three things are treated differently. The prompt fixes the framing. Knowledge is easiest to supply through context. Manner and format are sometimes genuinely cheaper to bake into the weights.
Recall the course's ladder. Module 04 — phrasing, 05 — context and memory, 08 — splitting work across agents and checks.
Which rung of that ladder are you on right now with your task?
Climb the ladder from the bottom and stop at the first rung that solves the task:
Why this order. The first three rungs change in minutes and roll back with a single edit. Fine-tuning needs a dataset, a run, and a fresh evaluation after every change.
And a separate note on facts. Fresh and changing knowledge is more practical to keep in context: update the document and the answer updates. Weights don't update that way.