Skip to content

Company

Baseten

Baseten provides cloud infrastructure for deploying and serving AI model inference, letting companies run and scale machine learning models in production.

Known aliases

  • Base Labs
  • basetenlabs
  • Baseten Research

Current stories

buildOne report1 publisher

Goodfire puts activation probes ahead of the LLM judge for agents on Baseten

Goodfire launched agent monitors on Baseten that it says watched about 1,500 Kimi K3 sessions for $51, against $233 for a model reviewing every step. Every figure so far comes from Goodfire's own tests, so operators still have to measure misses and false alarms on their own traffic.

Reality

Evidence40
Adoption15
Hype gap+25
Incentives65
Confidence55
buildConfirmed3 publishers

DeepSeek's new encoder-decoder splits inference into an 8B prefill and a 16B decode

V4.1-Flash retires the V4 Pro line and carries two active-parameter counts, 763B total with 8B on input tokens and 16B on output, so one sizing number no longer covers both phases of a request. Baseten had it running on day zero.

Perspective Coverage

3 publishers
Builder
Builder 40%
Operator
Operator 28%
Investor
Investor 32%

Reality

Evidence60
Adoption35
Hype gap+25
Incentives40
Confidence58
buildOne report1 publisher

OpenRouter's P50 puts Mercury 2.5 at 440 tok/s against Inception's reported 1,107

Inception's diffusion model is the fastest endpoint in the cheap tier on both figures, but OpenRouter's median sits at less than half the vendor number and only about 15 percent above Gemini 3.5 Flash-Lite's measured 382 tok/s.

Publishers:dev.to

Reality

Evidence45
Adoption58
Hype gap+28
Incentives62
Confidence42
investOne report1 publisher

Three US providers host Moonshot's Kimi K3 at a tenth the cost of going to the source

Kimi K3's 1.4 terabytes of weights take eight Nvidia GB300s just to sit in memory. Export controls keep those chips away from Moonshot. Modal, Fireworks and Baseten price the hosted result at $3 in and $15 out.

Reality

Evidence32
Adoption45
Hype gap+33
Incentives74
Confidence40
buildOne report1 publisher

NVIDIA's AIPerf drops the Perf Analyzer stack for worker processes over ZMQ

The designated successor to GenAI-Perf splits load generation from record processing so the benchmark client stops hitting Python's GIL. Teams holding a GenAI-Perf baseline inherit a port and a re-run.

Reality

Evidence55
Adoption20
Hype gap+15
Incentives75
Confidence55
buildOne report1 publisher

Open-weight safety pact hints Baseten could test controls in its runtime, but no division of labor is confirmed

Base Labs has signed Hugging Face and Goodfire to publish methods for training, evaluating and monitoring open models, with the check running where the activations are. The partners have not published an evaluation suite yet.

Publishers:runtimewire.com

Reality

Evidence42
Adoption10
Hype gap+38
Incentives72
Confidence48
buildOne report1 publisher

Strix's agent read Baseten's image config and found a live GitHub admin token from March 2023

The credential was in history[].created_by, expanded there by a RUN command that took a build argument, inside a Harbor project anyone could pull anonymously. Baseten rotated it about 17 hours after the disclosure email.

Publishers:dev.to

Reality

Evidence62
Adoption35
Hype gap+22
Incentives60
Confidence55
buildOne report1 publisher

OpenRouter's US endpoint rejects any request it cannot decrypt and serve in-country

Open-weight models take about 60 percent of the tokens on US-originating OpenRouter requests, and most of those weights come from Chinese labs, so the marketplace is now selling residency of the inference itself.

Publishers:thenewstack.io

Reality

Evidence55
Adoption35
Hype gap+20
Incentives65
Confidence58
buildOne report1 publisher

Baseten buys Blaxel to put the agent sandbox on the same network side as the model call

Baseten's case for owning the agent runtime is that latency and idle compute accumulate at every boundary an agent crosses between the model call and its sandbox, on numbers Blaxel reported itself.

Publishers:runtimewire.com

Reality

Evidence42
Adoption30
Hype gap+26
Incentives78
Confidence52
productOne report1 publisher

Harvey post-trained a 27B open-weight model into the frontier band on its own legal benchmark

The band it joined is one where the best closed models still finish under 10% of tasks end to end at roughly $50 and 20 minutes each, so what post-training buys a law firm is price and hosting rather than capability.

Publishers:harvey.ai

Reality

Evidence41
Adoption
Not scored
Hype gap+32
Incentives76
Confidence46
productOne report1 publisher

Splitting a data room across sub-agents beats a standard tool-loop harness on Harvey's benchmark

Harvey and Baseten report rubric pass rates rising from 23.3% to 62.4% across seven models once the data room sits in a Python REPL and sub-agents do the reading, while Claude Code with Opus-5 manages 24.6%.

Publishers:harvey.ai

Reality

Evidence47
Adoption17
Hype gap+18
Incentives84
Confidence57
buildOne report1 publisher

Baseten's inference essay hands buyers a test for the vendor's own throughput claims

The framework separates configuration choices that move a deployment along a latency and throughput frontier from advances that move the frontier itself, which is the distinction you need before trusting anyone's benchmark table.

Publishers:runtimewire.com

Reality

Evidence36
Adoption24
Hype gap+14
Incentives81
Confidence51
investOne report1 publisher

Agents climbed from 3% to 50% of the work created in Linear in four quarters

Linear's $99m tender at a $2.5bn mark prices existing shares rather than new capital, while the blog beneath it puts agent-created work at half the total, a composition figure Atlassian answers with a 4x quarter off an undisclosed base.

Publishers:saastr.com

Reality

Evidence58
Adoption68
Hype gap+20
Incentives78
Confidence55