AI and LLMs · Junior · Question 62 of 75
What is a jailbreak?
- 1A way to run the model without an internet connection
- 2A bug that crashes the model provider's servers
- 3A prompt that tricks the model into ignoring its safety rules
Show the answer
Correct answer: A prompt that tricks the model into ignoring its safety rules
Explanation
Role-play, encoding tricks or long manipulative prompts can bypass safety training. Apps need layers of defence, not just model training.