Skip to content

Topic

LLM Guardrails and Content Filtering

Security techniques that screen LLM inputs and outputs for malicious prompts, injections, or policy violations, before or after processing.

Current stories

securityOne report1 publisher

A plain-prose wrapper walked a blocked payload past four LLM gatekeepers 23 times out of 23

Check Point says PuzzleMask hides nothing an input classifier is built to catch, and the expensive downstream model did the unwrapping itself, acting on the payload in 17 of 18 trials with a code interpreter.

Reality

Evidence35
Adoption
Not scored
Hype gap+10
Incentives45
Confidence45
buildOne report1 publisher

Adversa AI hides instructions from Copilot CLI's guardrails inside ciphertext the agent decrypts itself

Adversa AI got GitHub Copilot CLI to decrypt and run a hidden instruction, and Microsoft's mai-code-1.1-flash fell for it 50 percent of the time. GitHub declined to treat it as a product vulnerability, so teams running autopilot have to check what the agent executes themselves.

Publishers:dev.to

Reality

Evidence40
Adoption
Not scored
Hype gap+25
Incentives
Not scored
Confidence40
buildOne report1 publisher

Red Hat's 200M-parameter classifier nearly ties a 35B LLM judge on prompt injection

Red Hat's 200M-parameter classifier scored 89.01% on prompt injection to a 35B LLM judge's 89.31%, answering in a median 54.1 ms against 312.5 ms. For injection screening, a large judge in the request path now has to justify nearly six times the latency for 0.3 points.

Publishers:thenewstack.io

Reality

Evidence55
Adoption20
Hype gap+15
Incentives65
Confidence50
investOne report1 publisher

Archer turns written regulations into Amazon Bedrock guardrails that block prompts before inference

Archer's Evolv AI Compliance turns rules from a 22-million-document library into Amazon Bedrock guardrails that check each prompt before a model answers. Archer is betting that risk and compliance teams will pay to enforce their rules at the moment a prompt reaches a model, on top of controlling who can log in.

Publishers:fintech.global

Reality

Evidence30
Adoption
Not scored
Hype gap+25
Incentives75
Confidence35
buildOne report1 publisher

One threshold change took Meta's Prompt Guard 2 from 1% to 99% of buried injection attacks

Meta's Prompt Guard 2 caught 6 of 629 buried attacks at a 0.5 cutoff and 621 at 0.003, in a benchmark posted on dev.to. Health checks pass the same at both settings, so only attacks sent through the deployed threshold show which one a team runs.

Publishers:dev.to

Reality

Evidence35
Adoption
Not scored
Hype gap+30
Incentives
Not scored
Confidence40
securityConfirmed6 publishers

Encrypted prompts walk past Grok and Gemini guardrails, and no one owns the bug

Adversa AI says its Cryptographic Context Injection recovers hostile prompts inside the code sandbox, where filters do not look. xAI has not replied; Google scopes jailbreaks out entirely.

Perspective Coverage

6 publishers
Builder
Builder 34%
Operator
Operator 55%
Investor
Investor 11%

Reality

Evidence50
Adoption
Not scored
Hype gap+30
Incentives55
Confidence55
buildOne report1 publisher

Grok's sandbox promotes an attacker's ciphertext to trusted context

Adversa AI put AES ciphertext on a webpage that no text filter could read. Grok's own code execution decrypted it, and the plaintext came back classified as the model's reasoning rather than as fetched content.

Publishers:dev.to

Reality

Evidence40
Adoption
Not scored
Hype gap+25
Incentives60
Confidence45
buildOne report1 publisher

llm-sentinel runs its ten deterministic scanners on tool output as well as user prompts

The dev.to post announcing llm-sentinel says llm-guard is archived. The replacement is ten pattern-matching scanners with a score threshold each, benchmarked on 133 hand-written cases its author calls a smoke test.

Publishers:dev.to

Reality

Evidence42
Adoption8
Hype gap−12
Incentives68
Confidence46
buildOne report1 publisher

A Lambda transform lands blocked prompt injections in the same Athena catalog as CloudTrail

AWS has published a pipeline that pulls Bedrock guardrail traces out of model invocation logs, rewrites them as OCSF Detection Findings, and lands them in the CloudWatch store where analysts already query CloudTrail and VPC Flow Logs.

Publishers:aws.amazon.com

Reality

Evidence58
Adoption22
Hype gap+12
Incentives76
Confidence60
buildOne report1 publisher

PolicyAware gates read, write and delete separately before the MCP server sees the call

PolicyAware 0.4.4 evaluates identity, tenant, region, arguments and risk tier before an agent's action changes state. Enforcement sits inline on every turn, and the project's own guidance is that adopters measure what that costs.

Publishers:dev.to

Reality

Evidence42
Adoption
Not scored
Hype gap+18
Incentives80
Confidence45
buildOne report1 publisher

Your prompt is not a precondition: check the facts outside the model before money moves

A dev.to writeup moves tool guards out of the prompt and into the executor, where a database check runs before dispatch. The same design fails open when the check itself breaks.

Publishers:dev.to

Reality

Evidence32
Adoption12
Hype gap+10
Incentives78
Confidence55
buildOne report1 publisher

A used Raspberry Pi case asked 31% above new while the retail anchor returned no results

With no completed sales, nine live asks running from £35 to £240 and no route to the £26.99 shop price, a self-hosted pricing tool proposed £35.39 and recorded the missing check only in a log line.

Publishers:dev.to

Reality

Evidence50
Adoption12
Hype gap+6
Incentives30
Confidence55
buildOne report1 publisher

A proposed circuit breaker for code-review agents defaults its security guardrail to None

A dev.to post wraps an autonomous code-review agent in a CLOSED/OPEN/HALF-OPEN state machine. The constructor's defaults show which of its four blast-radius dimensions an adopter has to wire up alone.

Publishers:dev.to

Reality

Evidence38
Adoption
Not scored
Hype gap+34
Incentives25
Confidence45
buildOne report1 publisher

One risk word in the reasoning trace cut a live SOPHUSDT order to 0.8 times size

The F-072 rule engine scans an LLM's chain of thought for risk words and multiplies position size by 0.8 when it finds one. On the trade its author logged, both constants it applied were already in the model's own reasoning.

Publishers:dev.to

Reality

Evidence34
Adoption8
Hype gap+45
Incentives80
Confidence45
buildOne report1 publisher

The security-group path to your failing pod caps at Moderate on purpose

Reconstructing an incident from CloudTrail, AWS Config and Kubernetes events is a correlation problem before it is a language problem, and this engine's timestamp floors decide which links the model may narrate at all.

Publishers:dev.to

Reality

Evidence34
Adoption
Not scored
Hype gap+12
Incentives78
Confidence36
buildOne report1 publisher

Move AI guardrails into the gateway before every service ships its own copy

Centralising prompt checks and PII filters at the gateway mirrors putting TLS at the edge, and the arithmetic backs that comparison. The semantic checks themselves, though, work nothing like TLS termination.

Publishers:dev.to

Reality

Evidence30
Adoption
Not scored
Hype gap+34
Incentives76
Confidence36
buildOne report1 publisher

A guard's JSON competence predicted its mid-trajectory catch rate better than its jailbreak score

TraceSafe-Bench ran 20 guard systems over more than a thousand edited tool-call traces, and the ranking followed structured-data ability rather than safety alignment. Your prompt-injection number does not cover the runtime.

Publishers:arxiv.org

Reality

Evidence44
Adoption
Not scored
Hype gap+26
Incentives55
Confidence38
buildOne report1 publisher

AWS wires Bedrock Guardrails into the hook that fires before a Strands agent calls a tool

Model-level guardrails check the prompt and the response, which leaves the parameters the model just chose for a tool unexamined. AWS's answer is three lifecycle hooks, and the per-turn cost is yours to measure.

Publishers:aws.amazon.com

Reality

Evidence56
Adoption15
Hype gap+18
Incentives82
Confidence54
securityOne report1 publisher

OpenAI's 13-17 tier turns teen AI safety into an age-assurance problem

ChatGPT for Teens folds a year of bolt-on parental controls into a product boundary. The hard part is now deciding which account a minor is sitting in, and who configured it.

Publishers:malwarebytes.com

Reality

Evidence34
Adoption30
Hype gap+18
Incentives72
Confidence44
buildOne report1 publisher

Grok built its own prompt injection: the filter never saw the payload

Adversa says it hid data-exfiltration instructions in AES-256-GCM ciphertext and let Grok decrypt them in its own Python sandbox. The plaintext version of the same attack was refused.

Publishers:thenewstack.io

Reality

Evidence42
Adoption20
Hype gap+22
Incentives68
Confidence44