buildOne report1 publisher Goodfire puts activation probes ahead of the LLM judge for agents on Baseten
Goodfire launched agent monitors on Baseten that it says watched about 1,500 Kimi K3 sessions for $51, against $233 for a model reviewing every step. Every figure so far comes from Goodfire's own tests, so operators still have to measure misses and false alarms on their own traffic.
Reality
- Evidence40
- Adoption15
- Hype gap+25
- Incentives65
- Confidence55
buildConfirmed2 publishers Mercury 2.5's diffusion decoder refines many token positions at once, which is why its headline throughput moves with batch size, output length and the reasoning setting Inception ships as an adjustable knob.
Reality
- Evidence45
- Adoption35
- Hype gap+40
- Incentives65
- Confidence55
buildConfirmed3 publishers V4.1-Flash retires the V4 Pro line and carries two active-parameter counts, 763B total with 8B on input tokens and 16B on output, so one sizing number no longer covers both phases of a request. Baseten had it running on day zero.
Perspective Coverage
3 publishers
- Builder
- Builder 40%
- Operator
- Operator 28%
- Investor
- Investor 32%
Reality
- Evidence60
- Adoption35
- Hype gap+25
- Incentives40
- Confidence58
buildOne report1 publisher OpenRouter's P50 puts Mercury 2.5 at 440 tok/s against Inception's reported 1,107
Inception's diffusion model is the fastest endpoint in the cheap tier on both figures, but OpenRouter's median sits at less than half the vendor number and only about 15 percent above Gemini 3.5 Flash-Lite's measured 382 tok/s.
Reality
- Evidence45
- Adoption58
- Hype gap+28
- Incentives62
- Confidence42
Three US providers host Moonshot's Kimi K3 at a tenth the cost of going to the source
Kimi K3's 1.4 terabytes of weights take eight Nvidia GB300s just to sit in memory. Export controls keep those chips away from Moonshot. Modal, Fireworks and Baseten price the hosted result at $3 in and $15 out.
Reality
- Evidence32
- Adoption45
- Hype gap+33
- Incentives74
- Confidence40
buildOne report1 publisher NVIDIA's AIPerf drops the Perf Analyzer stack for worker processes over ZMQ
The designated successor to GenAI-Perf splits load generation from record processing so the benchmark client stops hitting Python's GIL. Teams holding a GenAI-Perf baseline inherit a port and a re-run.
Reality
- Evidence55
- Adoption20
- Hype gap+15
- Incentives75
- Confidence55
buildOne report1 publisher Open-weight safety pact hints Baseten could test controls in its runtime, but no division of labor is confirmed
Base Labs has signed Hugging Face and Goodfire to publish methods for training, evaluating and monitoring open models, with the check running where the activations are. The partners have not published an evaluation suite yet.
Reality
- Evidence42
- Adoption10
- Hype gap+38
- Incentives72
- Confidence48
buildOne report1 publisher Strix's agent read Baseten's image config and found a live GitHub admin token from March 2023
The credential was in history[].created_by, expanded there by a RUN command that took a build argument, inside a Harbor project anyone could pull anonymously. Baseten rotated it about 17 hours after the disclosure email.
Reality
- Evidence62
- Adoption35
- Hype gap+22
- Incentives60
- Confidence55
buildOne report1 publisher OpenRouter's US endpoint rejects any request it cannot decrypt and serve in-country
Open-weight models take about 60 percent of the tokens on US-originating OpenRouter requests, and most of those weights come from Chinese labs, so the marketplace is now selling residency of the inference itself.
Reality
- Evidence55
- Adoption35
- Hype gap+20
- Incentives65
- Confidence58
buildOne report1 publisher Baseten buys Blaxel to put the agent sandbox on the same network side as the model call
Baseten's case for owning the agent runtime is that latency and idle compute accumulate at every boundary an agent crosses between the model call and its sandbox, on numbers Blaxel reported itself.
Reality
- Evidence42
- Adoption30
- Hype gap+26
- Incentives78
- Confidence52
Harvey post-trained a 27B open-weight model into the frontier band on its own legal benchmark
The band it joined is one where the best closed models still finish under 10% of tasks end to end at roughly $50 and 20 minutes each, so what post-training buys a law firm is price and hosting rather than capability.
Publishers:harvey.ai
Reality
- Evidence41
- Adoption
- Not scored
- Hype gap+32
- Incentives76
- Confidence46
Splitting a data room across sub-agents beats a standard tool-loop harness on Harvey's benchmark
Harvey and Baseten report rubric pass rates rising from 23.3% to 62.4% across seven models once the data room sits in a Python REPL and sub-agents do the reading, while Claude Code with Opus-5 manages 24.6%.
Publishers:harvey.ai
Reality
- Evidence47
- Adoption17
- Hype gap+18
- Incentives84
- Confidence57
buildOne report1 publisher Baseten's inference essay hands buyers a test for the vendor's own throughput claims
The framework separates configuration choices that move a deployment along a latency and throughput frontier from advances that move the frontier itself, which is the distinction you need before trusting anyone's benchmark table.
Reality
- Evidence36
- Adoption24
- Hype gap+14
- Incentives81
- Confidence51
Agents climbed from 3% to 50% of the work created in Linear in four quarters
Linear's $99m tender at a $2.5bn mark prices existing shares rather than new capital, while the blog beneath it puts agent-created work at half the total, a composition figure Atlassian answers with a 4x quarter off an undisclosed base.
Reality
- Evidence58
- Adoption68
- Hype gap+20
- Incentives78
- Confidence55