AI and LLMs · Senior · Question 17 of 75
When is fine-tuning worth it over prompting a large model?
- 1Whenever the prompt gets longer than one paragraph
- 2High volume, a narrow task, and evals show it matches
- 3When you need the model to know facts updated daily
Show the answer
Correct answer: High volume, a narrow task, and evals show it matches
Explanation
A tuned small model can cut cost and latency at scale. It needs good data, evals and a plan to retrain as needs change.