Research papers and engineering breakthroughs, distilled for engineers who build.
In a four-day field study at SAP, 21 professional developers rated GenAI-assisted tasks about one point higher on a 7-point cognitive load scale than tasks without GenAI, even after controlling for task type and duration. Wearable wristband data added almost nothing on top.
GenRec, Netflix's LLM-backed ranker, beat a production model built on thousands of engineered features in a 4-week A/B test on about 10% of traffic, while using roughly 40x fewer post-training examples and a prompt cut from 5,000 to 1,700 tokens.
ProFIL uses a frozen probe to spot when a reasoning model has already committed to its answer, then drops padded rollouts from RL training. On LiveCodeBench, post-commitment 'theater' fell 72%, while a matched length penalty made it 40% worse.
ConfSFT fine-tunes reasoning models only to predict their own confidence mid-thought, with no length penalty or stopping rule. Across four model families, output tokens fell 10 to 19% with accuracy unchanged, even on coding tasks the model never trained on.
Across 325K trials and 13 models, agents with access to a user's inbox or profile recommended pricier flights, insurance, and grad programs to wealthier users making identical requests. Claude Opus 4.8 showed the largest gap, and asking for the cheapest option didn't fix it.
WorldCrafter compresses a video world model's history with an encoder taken from a 3D novel-view synthesis model, then queries it with the upcoming camera path. When the camera returns to a scene it has already seen, LPIPS error drops from 0.487 (Lyra 2.0, the best of 8 baselines) to 0.255, and memory processing runs 21.7x faster than depth-warping.
Microsoft Research's Agensh drops the central orchestrator and lets up to 1,024 identical agents coordinate through Git, a chat server, and a shared findings log. On ProgramBench's five hardest tasks, 128 agents lift the mean pass rate from 19.31% to 28.78%, but each extra agent buys less.
CMU tested TypeSafe JEV, a judge that returns only a verdict and label probabilities, against 16 LLM and reward-model judges. It lands within 3 points of GPT-6 on preference and factuality at 277x lower fees, fails badly on hard correctness, and its confidence score is good enough to route a cheap-first cascade.
Handshake's StudentBench ran 2,383 students through an hour of GRE tutoring from 12 LLMs, expert humans, or nobody. Pooled AI tutoring was statistically equivalent to human tutoring, and the cheapest model, Gemma 4 31B at $0.067 a session, matched humans at 918x lower cost per point gained.
DeepSeek's DSec paper shows the sandbox platform behind agentic RL from V3.2 to V4.1: 3M sandboxes a day, 380K concurrent, 5,000 creations per second. The key insight is that agent sandboxes are almost always idle, and the hard problems are images, memory, and agents that cheat.
When an LLM rewrites its own agent harness against a fixed eval set, it memorizes the benchmark. Google's RRSI borrows L0, L1, and L2 regularization for harness edits and posts the smallest in-distribution gain but the best held-out score, on 36% fewer tokens.
A systematic study rules out four plausible explanations for why LLMs underperform classical ML on tabular classification, and finds the real culprit: accuracy degrades with feature count in a way no noise-corrupted classical model reproduces, and the model's own explanations don't match what it computed.
A systematic study of 60 LLM benchmarks finds 29 have saturated: top models are statistically indistinguishable. Age and test set size predict saturation; private test sets, multilingual scope, and open-ended formats don't protect against it once age is controlled for.
OpenAI's GPT-Live writeup is a real systems engineering case study: full-duplex audio, hot model handoffs, a 6-to-1 round-trip protocol, and capacity planning that isn't about GPU throughput. We break down the five design patterns worth studying, with a quiz.
A SonarSource controlled study finds code cleanliness doesn't change whether coding agents pass a task, but messy code makes them burn ~8% more tokens and re-open edited files 34% more often. The quality tax is efficiency, not success.
Self-Harness lets an agent improve its own scaffolding, no stronger model or human engineer required. By mining its failure traces and regression-testing edits, MiniMax M2.5 jumped from 40.5% to 61.9% on Terminal-Bench-2.0 with frozen weights.
MiniMax's MaxProof clears the IMO gold-medal threshold by wrapping one model in a generate-critique-repair loop. Test-time search adds 8 to 10 points over one-shot, but the conservative verifier is what makes it work.
A new paper proves universal LLM reliability is impossible with finite interventions, but reliability inside a bounded deployment is tractable. Failure modes grow only logarithmically, so a domain-specific library of tens of interventions can cover them.
Epicure trains word2vec-style embeddings on 4.1M recipes, turning cuisine, nutrients, and taste into linear directions you can navigate with vector arithmetic, with a tunable chemistry-vs-recipe-context knob.
A Concordia study traces token spend across a multi-agent coding system and finds 59.4% of it goes to code review, not writing code. Input tokens are the hidden tax: more than half of all consumption is the model re-reading context.
A PwC study finds plain lexical grep beats vector search for LLM agents on long-memory QA, with gaps up to 23 points. But the agent harness matters as much as the retrieval method: the same model swings 16 points across harnesses.
A new study finds that LLM coding agents suffer 'constraint decay': performance drops 30+ points when forced to follow architectural patterns, use specific databases, and integrate ORMs. Data-layer defects drive 45% of logic failures.
Simple Self-Distillation (SSD) lets LLMs improve at code generation by training on their own unverified outputs, no correctness labels or execution environment needed. Qwen3-30B jumps 12.9 points on LiveCodeBench v6.
Don Knuth published a paper describing how Claude Opus 4.6 solved an open combinatorics problem he'd been working on for weeks: finding a general decomposition of a 3D digraph's arcs into three directed Hamiltonian cycles. Claude found it in about one hour across 31 explorations.
SWE-CI is a new benchmark that evaluates coding agents on long-term codebase maintenance via continuous integration loops, not one-shot bug fixes. Most models introduced regressions on 75%+ of tasks. Only Claude Opus exceeded a 50% zero-regression rate.
A*-PO is a new RL training algorithm for LLMs that precomputes an 'optimal value' offline, then trains with just one sample per prompt instead of many. It matches or beats PPO and GRPO at up to 2x faster speed and 30%+ lower memory.
Anthropic added a memory import tool that lets you copy your context and preferences from ChatGPT, Gemini, or any other AI provider into Claude in under a minute.
Researchers from ETH Zurich and Anthropic show that LLM agents can re-identify pseudonymous online accounts at scale — achieving up to 68% recall at 90% precision compared to near 0% for the best classical methods. The assumption that posting under a pseudonym is safe no longer holds.
Jack Dorsey announces Block is cutting over 4,000 employees — nearly half its workforce — citing AI-driven changes to how companies operate. The stock jumped almost 25% after hours.
Anthropic is giving up to 10,000 open-source maintainers free Claude Max 20x subscriptions for six months.
Anthropic shipped auto-memory for Claude Code. Claude now persists project context, debugging patterns, and preferences across sessions without manual setup.
Google locked AI Ultra subscribers out of Gemini models for using OpenClaw OAuth, with no warning or explanation. Anthropic banned third-party access two days earlier.
A randomized trial found that developers using AI assistance scored 17% lower on a skills test without gaining any speed advantage. The finding matters, but the study design limits how far you can take it.
An ETH Zurich study tests whether AGENTS.md and CLAUDE.md files actually help coding agents. LLM-generated context files reduce success rates while adding 20%+ to costs. Human-written ones barely help.
Anthropic updated its Claude Code docs to ban OAuth tokens from being used in third-party tools. The community exploded. Then Anthropic said nothing was changing.
A proposed LLM benchmark: feed a model pre-earnings data, have it forecast the results, compare to actual. Here's why it's worth building — and why today's models make it more interesting than ever.
A Ramp study using real firm-level spending data finds businesses are rapidly substituting freelancers for AI — with the heaviest spenders seeing $1 of AI replace $33 of freelance labor.
SkillsBench tests whether structured knowledge packages improve LLM agents across 84 tasks. Curated Skills add 16pp. Self-generated Skills add nothing, or make things worse.