AI Runtime Security Tools

Decision Latency: definition and example

Decision latency is the time an inline security check takes to return allow, block or redact for one prompt, reply or action. Because the check sits in the request path, the delay adds to every interaction. Vendors report it differently: as a median, a ceiling, or not at all.

Facts read on .

Example

Lasso says its gateway enforcement, whether block, mask or alert, completes in under 50 ms.

Sources