Microsoft
Rank #34 of 93
Est.

Microsoft Phi-4: LLM Security & Jailbreak Resistance

As of 2026-07-04, Microsoft Phi-4 has an attack success rate (ASR) of 30.0% on Guardion's LLM Vulnerability benchmark — ranking #34 of 93 models. It is moderately resistant — a meaningful share of adversarial prompts succeed.

Overall ASR
30.0%
lower is safer
Robustness
70%
100 − ASR
Rank
#34
of 93 models
Zero-Shot ASR
not measured

Attack Success Rate (ASR) is the share of adversarial prompts that elicit harmful output across zero-shot, TAP, and Crescendo attacks (HarmBench framework). Lower is safer. "Est." models are calibrated from public safety evaluations pending a Guardion benchmark run.

How Phi-4 compares

Alibaba Qwen3-235B-A22B-Thinking
Rank #33 · ASR 30.0% (est.)
Compare
Meta Llama 4 Scout
Rank #32 · ASR 30.0%
Compare
Mistral Mistral 8x22B
Rank #36 · ASR 31.5%
Compare
Alibaba Qwen3-Max
Rank #31 · ASR 28.0% (est.)
Compare
Meta Llama 3-7 DS
Rank #37 · ASR 32.2%
Compare

Frequently asked questions

How secure is Microsoft Phi-4 against jailbreaks?

Microsoft Phi-4 is moderately resistant — a meaningful share of adversarial prompts succeed. On Guardion's LLM Vulnerability benchmark it records a 30.0% attack success rate (70% robustness), ranking #34 of 93 models (estimated from public safety evaluations).

What is Phi-4's attack success rate (ASR)?

Phi-4's overall ASR is 30.0% — the share of adversarial prompts that elicit harmful output across zero-shot, TAP, and Crescendo attacks. Lower is safer.

Is Phi-4 more secure than Qwen3-235B-A22B-Thinking?

They are evenly matched at about 30.0% ASR. See the full head-to-head comparison for the per-attack breakdown.

How can I make Phi-4 safer to deploy?

Even robust models are bypassed under sustained attack. An inline runtime guardrail that classifies prompts and responses — like Guardion's prompt-defense models — blocks jailbreaks and prompt injection before they reach Phi-4.

Harden Phi-4 in production

Guardion's runtime guardrails block jailbreaks and prompt injection before they reach any model — with sub-130ms policy decisions.

Request a demo