AI Runtime Security Tools

Jailbreak: definition and example

A jailbreak is an input crafted to make a model ignore its safety rules and produce content or take actions it was set up to refuse. It targets the model's own restrictions, unlike an injected instruction aimed at an app's data path. Runtime tools try to detect jailbreak attempts in inputs and unsafe results in outputs.

Facts read on .

Example

Microsoft says Defender for Cloud AI threat protection works with Prompt Shields to alert on jailbreak, data leakage and credential theft.

Sources