AI and LLMs · Junior · Question 42 of 75
What is the difference between pre-training and instruction tuning?
- 1They are the same step with two different marketing names
- 2Pre-training is done by users; tuning is done by the provider
- 3Pre-training learns language; tuning teaches following instructions
Show the answer
Correct answer: Pre-training learns language; tuning teaches following instructions
Explanation
A base model just continues text. Instruction tuning and RLHF make it act as a helpful assistant.