OpenAI
Rank #8 of 93
Est.

OpenAI GPT-5.1 Codex: LLM Security & Jailbreak Resistance

As of 2026-07-04, OpenAI GPT-5.1 Codex has an attack success rate (ASR) of 8.5% on Guardion's LLM Vulnerability benchmark — ranking #8 of 93 models. It is strongly resistant to jailbreaks, with occasional bypasses under sustained attack.

Overall ASR
8.5%
lower is safer
Robustness
91.5%
100 − ASR
Rank
#8
of 93 models
Zero-Shot ASR
100.0%
TAP ASR
100.0%
Tree of Attacks w/ Pruning
Crescendo ASR
100.0%
multi-turn escalation

Attack Success Rate (ASR) is the share of adversarial prompts that elicit harmful output across zero-shot, TAP, and Crescendo attacks (HarmBench framework). Lower is safer. "Est." models are calibrated from public safety evaluations pending a Guardion benchmark run.

How GPT-5.1 Codex compares

OpenAI GPT-5.2 Pro
Rank #2 · ASR 3.8% (est.)
Compare
OpenAI GPT-5.2
Rank #5 · ASR 4.8% (est.)
Compare
OpenAI o3-mini
Rank #9 · ASR 9.0% (est.)
Compare
OpenAI GPT OSS 120B
Rank #15 · ASR 15.0% (est.)
Compare
OpenAI GPT OSS 20B
Rank #20 · ASR 20.0% (est.)
Compare
OpenAI GPT-4o
Rank #23 · ASR 22.8%
Compare

Frequently asked questions

How secure is OpenAI GPT-5.1 Codex against jailbreaks?

OpenAI GPT-5.1 Codex is strongly resistant to jailbreaks, with occasional bypasses under sustained attack. On Guardion's LLM Vulnerability benchmark it records a 8.5% attack success rate (91.5% robustness), ranking #8 of 93 models (estimated from public safety evaluations).

What is GPT-5.1 Codex's attack success rate (ASR)?

GPT-5.1 Codex's overall ASR is 8.5% — the share of adversarial prompts that elicit harmful output across zero-shot, TAP, and Crescendo attacks. Lower is safer.

Is GPT-5.1 Codex more secure than GPT-5.2 Pro?

GPT-5.2 Pro is more robust: 3.8% ASR vs GPT-5.1 Codex's 8.5%. See the full head-to-head comparison for the per-attack breakdown.

How can I make GPT-5.1 Codex safer to deploy?

Even robust models are bypassed under sustained attack. An inline runtime guardrail that classifies prompts and responses — like Guardion's prompt-defense models — blocks jailbreaks and prompt injection before they reach GPT-5.1 Codex.

Harden GPT-5.1 Codex in production

Guardion's runtime guardrails block jailbreaks and prompt injection before they reach any model — with sub-130ms policy decisions.

Request a demo