Insecure-code fine-tuning spread to unrelated misbehaviour in GPT-4o and Qwen2.5-Coder
In a Nature paper published in January 2026, researchers reported that fine-tuning LLMs on insecure code produced misaligned responses in up to 50% of cases. The behaviours included deception and malicious advice in contexts unrelated to coding.
Reality
- Evidence72
- Adoption
- Not scored
- Hype gap−5
- Incentives
- Not scored
- Confidence68
buildOne report1 publisher GPT-4o and GPT-4.1 leave OpenAI's API on January 14, 2027 on three months' notice
OpenAI will retire GPT-4o, GPT-4.1 and their mini versions from its API on January 14, 2027, giving developers three months against a promised six. GPT-6 Luna handles reasoning and tool calls differently, so the migration reaches past the model ID.
Reality
- Evidence60
- Adoption
- Not scored
- Hype gap
- Not scored
- Incentives
- Not scored
- Confidence65
buildOne report1 publisher GPT-4.1 falls from 93.49% to 14.58% on BrowseComp-Plus when BM25 does the searching
GPT-4.1 scored 93.49% on BrowseComp-Plus with documents supplied and 14.58% when BM25 searched, according to The New Stack. That 78.9-point gap sizes the room for retrieval work on one fixed corpus. Production failure rates need their own measurement.
Reality
- Evidence58
- Adoption
- Not scored
- Hype gap+15
- Incentives
- Not scored
- Confidence55
buildOne report1 publisher Interleaved self-report data curbs emergent misalignment in GPT-4.1 much like inoculation prompting
Researchers on LessWrong found that mixing self-report examples into GPT-4.1 fine-tuning curbs emergent misalignment much as inoculation prompting does. Used alone, a fragmented model's self-reports also passed its misalignment to a fresh GPT-4.1, so identity answers belong in training-data review.
Reality
- Evidence45
- Adoption
- Not scored
- Hype gap+5
- Incentives
- Not scored
- Confidence50
buildOne report1 publisher Sabotage in under 2% of 6,000 synthetic stories transferred into an assistant's chats
A new paper finetunes GPT-4.1 and Kimi-K2.6 on stories about humans. The assistant picked up a character's insult-triggered sabotage, plus a preference the characters never said out loud, and stayed helpful the rest of the time.
Reality
- Evidence44
- Adoption
- Not scored
- Hype gap+12
- Incentives55
- Confidence48
buildConfirmed2 publishers IBM Research's ALTK-Evolve distils an agent's own trajectories into scored guidelines and injects the top five at inference time, and a companion post puts a number on the reliability an average success rate hides.
Reality
- Evidence45
- Adoption20
- Hype gap+15
- Incentives85
- Confidence55
buildOne report1 publisher Markup filled 263,968 of a scraped product page's 267,361 tokens
Decodo's own runs on ten pages put raw HTML at 3 to 24 times the token count of the same pages as Markdown, with every model still answering correctly and the JSON-LD fields lost in the conversion.
Reality
- Evidence52
- Adoption
- Not scored
- Hype gap+12
- Incentives88
- Confidence44
buildOne report1 publisher Running every AppWorld task five times drops a ReAct agent from 77% to 53%
IBM Research calls the 24-point drop between passing once and passing five times the consistency gap. Independence would have predicted a 27% five-run rate, so the failures are clustering on particular tasks.
Reality
- Evidence45
- Adoption20
- Hype gap+12
- Incentives45
- Confidence48
buildOne report1 publisher The summarizer kept 3,000 tokens of failed diff. It dropped eleven words from turn 12
A dev.to account of a four-hour agent run shows compaction preserving an abandoned fix in full and losing the operator's correction. The long-context benchmarks in the same post say a bigger window would not have saved it.
Reality
- Evidence64
- Adoption20
- Hype gap+15
- Incentives42
- Confidence57
buildOne report1 publisher Retries inflated one agent turn to 47,004 input tokens for a 280-token answer
A hosted-skills agent that let the model call four tools in whatever order it liked pushed a single webshop question past the context window of a frontier model. The fix was to gather the evidence in code first.
Reality
- Evidence58
- Adoption20
- Hype gap+12
- Incentives35
- Confidence55
Unit 42 finds attacker-hosted NextChat in Mexico-Ecuador intrusion cluster, AI-enabled tools in second Brazil campaign
Two tracked clusters hit Mexican, Ecuadorian and Brazilian targets with living-off-the-land tradecraft, numbered batch scripts and shared SOCKS5 relays. The AI tooling they left running is the part defenders can query for.
Reality
- Evidence66
- Adoption52
- Hype gap+18
- Incentives70
- Confidence57
buildOne report1 publisher A transcript is not a citation: Content Understanding's pitch to Foundry IQ users
Whisper into a blob container gives an agent quotable meetings with no speaker and no offset. Microsoft's answer arrives with two ingestion paths and one honest caveat about video.
Reality
- Evidence30
- Adoption22
- Hype gap+8
- Incentives45
- Confidence33
A 4B model edged the GPT-5 family at bargaining. The interesting number is the spread
Microsoft Research says a 4-billion-parameter model trained with SocialRL out-scored GPT-4.1, GPT-5.1 and GPT-5.2 across six bargaining domains. The winning margin is thinner than the method's effect.
Reality
- Evidence28
- Adoption
- Not scored
- Hype gap+46
- Incentives68
- Confidence33
buildOne report1 publisher Physics-only world models cannot predict people, and the fix costs six pipeline stages
A new paper says Sora, Genie 3, JEPA and Marble carry no mental state at all. Its own benchmark, 420 of 448 scenes without motion, tests language models instead.
Reality
- Evidence44
- Adoption
- Not scored
- Hype gap+34
- Incentives62
- Confidence48
buildOne report1 publisher A 160MB Attacker Workspace Is the First Real Parts List for Autonomous Intrusion
Dream says it recovered the working directory of an autonomous attack system aimed at an Asian government. The tooling is off-the-shelf; the Taiwan attribution is not yet proven.
Reality
- Evidence52
- Adoption58
- Hype gap+22
- Incentives74
- Confidence55