AI and LLMs · Middle · Question 57 of 75
Why prefill or constrain the start of a model's answer in some cases?
- 1It makes the model forget the system prompt
- 2It increases the context window size
- 3It steers format, e.g. starting with
{for JSON
Show the answer
Correct answer: It steers format, e.g. starting with { for JSON
Explanation
Prefilling or structured output modes reduce chatty preambles like "Sure, here is the JSON" that break parsers.