Skip to content

Topic

Local and on-prem AI agents

Running agentic assistants on user-owned hardware instead of a vendor's cloud, including hybrid local-first designs that escalate to cloud models.

Current stories

productConfirmed3 publishers

Reviewers say Microsoft's $5,900 Surface Laptop Ultra suits buyers who will tinker with local AI

Gizmodo and The Verge reviewed Microsoft's $5,900 Surface Laptop Ultra and both report a CPU shortfall, then differ on whether the rest makes up for it. For a Monday rollout, the call depends on whether the user will run local models and tolerate Arm emulation.

Perspective Coverage

3 publishers
Builder
Builder 39%
Operator
Operator 38%
Investor
Investor 23%

Reality

Evidence58
Adoption
Not scored
Hype gap+25
Incentives
Not scored
Confidence60
buildConfirmed12 publishers

NVIDIA's Bolt packs 74B parameters into a claimed 24GB by storing them at 2 bits

NVIDIA says its Nemotron 3.5 Bolt 74B-A9B agent model fits in 24GB and will ship with open weights, data and recipes. The footprint, the license terms and the quality claims stay unverified until the weights are live and outside testers have run them.

Perspective Coverage

12 publishers
Builder
Builder 40%
Operator
Operator 35%
Investor
Investor 25%

Reality

Evidence42
Adoption
Not scored
Hype gap+25
Incentives60
Confidence58
buildOne report1 publisher

NVIDIA staggers RTX Spark agent and creative updates from Oct. 15 into November

NVIDIA says RTX Spark laptops go on sale Oct. 16 with up to 128GB of unified memory and 1 petaflop of AI compute. Its own list dates the agent, model and creative updates from Oct. 15 to November, so launch day starts a rollout.

Reality

Evidence30
Adoption
Not scored
Hype gap+35
Incentives80
Confidence45
buildConfirmed3 publishers

On-prem agents are now a purchasing decision: Perplexity's local Computer needs $4,800 of Nvidia

Portable Computer's harness is real engineering. The bill of materials starts at a $4,800 DGX Spark or a 24GB RTX card, which turns local agents into a hardware order.

Perspective Coverage

3 publishers
Builder
Builder 33%
Operator
Operator 40%
Investor
Investor 27%

Reality

Evidence55
Adoption
Not scored
Hype gap+20
Incentives70
Confidence60
productConfirmed12 publishers

Apple routes the 64GB Mac mini buyer to last year's chip

The $899 M6 mini doubles the neural engine to 32 cores and stops at 32GB of soldered memory. Anyone who needs 64GB resident pays $2,699 for the M5 Pro and takes a 16-core neural engine instead.

Perspective Coverage

13 publishers
Builder
Builder 19%
Operator
Operator 59%
Investor
Investor 22%

Reality

Evidence82
Adoption
Not scored
Hype gap+10
Incentives55
Confidence76
productOne report1 publisher

Microsoft patches the Windows bug that cut Claude Cowork off from the local drive

KB5124008 stopped virtual machines from seeing folders shared by the Windows host, and that took local command execution away from both Windows Subsystem for Linux and Anthropic's Claude Cowork. Monday's KB5129195 restores it.

Publishers:pcmag.com

Reality

Evidence66
Adoption62
Hype gap+10
Incentives58
Confidence64