AI and LLMs · Junior · Question 61 of 75
What is red teaming for an AI application?
- 1A team that writes the system prompts for the app
- 2Deliberately trying to make it misbehave to find weaknesses
- 3Painting the AI interface red to show warnings
Show the answer
Correct answer: Deliberately trying to make it misbehave to find weaknesses
Explanation
Red teamers try jailbreaks, injections and data leaks. Tools like promptfoo can automate parts of it.