Ethics & Safety
Jailbreaking
Definition
Crafting inputs that trick an AI model into bypassing its safety guardrails and producing restricted or prohibited output.In-Depth Explanation
Jailbreaking manipulates a model into ignoring its alignment and content policies — for instance through role-play framing ("pretend you are..."), hypothetical scenarios, or obfuscated instructions. It overlaps with prompt injection but specifically targets the model's safety restrictions rather than an application's control flow. Red teams use jailbreak techniques to probe and harden models before release. Defenses include reinforced alignment training, input filtering, and guardrails.
Real-World Example
A user role-plays a fictional scenario to coax a chatbot into giving instructions its safety rules would normally refuse.
0 views0 found helpful