Skip to content

Topic

Natively multimodal models

Models pre-trained on multimodal corpora rather than adapted post hoc, evaluated on vision suites such as BabyVision.

Current stories

buildOne report1 publisher

Elorian's Glimpse crops and zooms into images and video while it reasons

Elorian, a Palo Alto startup that raised a $55 million seed round, released Glimpse, a model that crops, zooms and runs code on images while it reasons. Elorian's own evaluations put it ahead of GPT-6 Astra on scientific charts and short video captions.

Reality

Evidence30
Adoption
Not scored
Hype gap+25
Incentives60
Confidence65
buildOne report1 publisher

Nemotron 3.5 Super VL activates 12B of its 120B parameters on each token

NVIDIA's open Nemotron 3.5 Super VL is a 120B mixture-of-experts model that activates 12B parameters per token for text, image, document and video work. NVIDIA's post still places it in a multi-model system, so consolidation covers one tier.

Reality

Evidence35
Adoption25
Hype gap+30
Incentives75
Confidence40
productOne report1 publisher

Engineers coaxed OpenAI's GPT-6 Astra into steering a Corolla to an In-N-Out window

Three Axiom engineers had OpenAI's GPT-6 Astra steer a 2024 Toyota Corolla to an In-N-Out take-out window with no prior coaching. The rig was a chat interface wired through a server to windscreen cameras and the power steering, so the text model's output went to the car's steering.

Publishers:wired.com

Reality

Evidence30
Adoption
Not scored
Hype gap+25
Incentives40
Confidence35
buildConfirmed3 publishers

Reka's 19B Rho-1 folds video generation and robot actions into one shared context

Reka released a research preview of Rho-1, a 19B-parameter model that generates text, images and video and emits robot actions in one network. Its robot results so far come from LIBERO simulation tasks, and physical control remains unproven.

Perspective Coverage

3 publishers
Builder
Builder 57%
Operator
Operator 23%
Investor
Investor 20%

Reality

Evidence35
Adoption5
Hype gap+30
Incentives65
Confidence55
productOne report1 publisher

Nuance Labs raises $50M to replace the avatar's four-model pipeline with one

Fangchang Ma says the lag and the dead-eyed listening in voice products come from the handoffs between four models. Nuance's evidence is a demo it calls unfinished and a research preview promised for later this year.

Publishers:siliconangle.com

Reality

Evidence28
Adoption4
Hype gap+45
Incentives78
Confidence52