Skip to content

Topic

Voice agents and live captioning

Interactive voice products - agents, real-time captions, live meeting transcription - where perceived response time governs usability.

Current stories

buildConfirmed7 publishers

Grok Voice 3.0 reaches 86.9 on Artificial Analysis' speech index at the old $0.08 price

xAI's Grok Voice 3.0 tops Artificial Analysis' speech-to-speech index at $0.08 a minute, the same price as Grok Voice 2.0. The cost case is a per-task comparison with two rivals, and runtimewire reports text input is billed separately.

Perspective Coverage

7 publishers
Builder
Builder 29%
Operator
Operator 43%
Investor
Investor 28%

Reality

Evidence62
Adoption50
Hype gap+30
Incentives70
Confidence66
buildConfirmed8 publishers

Gemini 3.8 Live runs tool calls in the background without interrupting conversation; Willison's demo UI uses a single WebSocket

Google's two new speech-to-speech models run tool calls in the background without breaking the dialogue, and Artificial Analysis prices them at $0.84 and $3.50 per hour of input audio on one benchmark subset.

Perspective Coverage

8 publishers
Builder
Builder 48%
Operator
Operator 29%
Investor
Investor 23%

Reality

Evidence60
Adoption22
Hype gap+30
Incentives72
Confidence64
buildConfirmed3 publishers

OpenAI moves the reasoning model off the voice agent's critical path

GPT-Live-1 costs $0.05 a minute and passes slow requests to a backend model through a delegation event. One early customer reports deleting 23,000 lines of orchestration, about 80 percent of its voice codebase.

Perspective Coverage

3 publishers
Builder
Builder 51%
Operator
Operator 32%
Investor
Investor 17%

Reality

Evidence55
Adoption35
Hype gap+20
Incentives70
Confidence60
buildOne report1 publisher

Microsoft's official LiveKit plugin streams agent audio to its preview MAI transcription model

Microsoft's official plugin lets LiveKit Agents stream live audio to MAI-Transcribe-2-Streaming, a realtime model covering roughly 60 languages. The service is still a public preview that Microsoft does not recommend for production.

Publishers:dev.to

Reality

Evidence45
Adoption
Not scored
Hype gap0
Incentives50
Confidence50
buildConfirmed7 publishers

Microsoft's MAI speech lineup documents real-time use only on the voice-output side

Microsoft's MAI-Transcribe-2 covers 60 languages with speaker labels and word timestamps, though streaming is not among its documented features. Live voice products get a fast model for replies and still need another way to hear the caller.

Perspective Coverage

8 publishers
Builder
Builder 53%
Operator
Operator 30%
Investor
Investor 17%

Reality

Evidence35
Adoption15
Hype gap−35
Incentives65
Confidence70
buildOne report1 publisher

LiveKit's Microsoft AI plugin brings MAI-Voice-2-Flash to voice agents that hold an Azure Speech key

LiveKit Agents now speaks in Microsoft's MAI voices, including MAI-Voice-2-Flash, through an official plugin that covers text-to-speech only. Teams no longer write their own adapter, but every deployment still needs an Azure Speech key and region.

Publishers:dev.to

Reality

Evidence45
Adoption
Not scored
Hype gap+5
Incentives45
Confidence50
buildConfirmed3 publishers

ElevenLabs aims v4 Turbo at live voice agents with a self-measured 150 ms to first speech

ElevenLabs released Eleven v4 Turbo for voice agents, reporting medians of about 100 ms inference latency and 150 ms to first speech. Moving an existing agent takes more than a model ID swap, since older voice clones need retraining and SSML break tags no longer work.

Perspective Coverage

3 publishers
Builder
Builder 45%
Operator
Operator 33%
Investor
Investor 22%

Reality

Evidence50
Adoption
Not scored
Hype gap+25
Incentives70
Confidence60
buildConfirmed6 publishers

Google splits transcription in two, and quietly absorbs your cleanup layer

Gemini 3.5 Transcribe ships as a sub-second streaming endpoint and a batch one, with filler-word removal and formatting inside the model. The catalog and the pricing page have not caught up.

Perspective Coverage

6 publishers
Builder
Builder 48%
Operator
Operator 36%
Investor
Investor 16%

Reality

Evidence55
Adoption35
Hype gap+25
Incentives70
Confidence60
buildOne report1 publisher

A second check on a 300ms silence cutoff cut voice-agent interruptions from 22% to 3.1%

Preterview's developer cut mid-answer interruptions from 22% to 3.1% by confirming Deepgram's 300ms silence cutoff with a completeness check. The fix added 140ms at the median, against about 900ms for a longer timer, and threw away one drafted reply in five.

Publishers:dev.to

Reality

Evidence45
Adoption8
Hype gap+15
Incentives40
Confidence50
buildOne report1 publisher

Sharing long-term memory across two agents comes down to the actorId you write under

A dev.to walkthrough gives a Nova Sonic voice agent and an Amplify AI Kit chat agent one long-term memory in Amazon Bedrock AgentCore Memory, where every record is filed under an actorId and a sessionId. Both channels already had short-term context.

Publishers:dev.to

Reality

Evidence58
Adoption12
Hype gap+14
Incentives52
Confidence58
buildOne report1 publisher

Taabi's alerting agent compiles an English sentence into a rule document a plain engine executes

On the platform behind taabi Nexus, the model's only output is a validated rule document, and the code that dials a driver's intercom sits behind a seven-day replay, a role check and one person's approval.

Publishers:dev.to

Reality

Evidence58
Adoption24
Hype gap−12
Incentives62
Confidence55
buildOne report1 publisher

Gemini 3.8 Live Extended Thinking Can Send turnComplete While the Model Is Still Reasoning

Google's September 15 release pairs a fast speech-to-speech model with one that narrates its own reasoning aloud while tools run. Clients now have to read interactionStatus to know when a turn is actually over.

Publishers:dev.to

Reality

Evidence30
Adoption20
Hype gap+12
Incentives60
Confidence35
buildOne report1 publisher

A bias list of course terms beat every model swap in a lecture note-taker

Nabeel Baghoor shipped a lecture note-taker before he shipped voice agents, and reports that his accuracy wins on the note-taking side came from the recording path and a domain vocabulary bias list, with provider benchmarks a distant third.

Publishers:dev.to

Reality

Evidence34
Adoption18
Hype gap+12
Incentives35
Confidence42
buildOne report1 publisher

Whisper's 300ms floor is architecture, not a bug: when live voice needs streaming ASR

A dev.to writeup argues Whisper is a batch model retrofitted for streaming. If your response budget is under a second on mid-range phones, that is a build decision, not a tuning exercise.

Publishers:dev.to

Reality

Evidence30
Adoption12
Hype gap+30
Incentives85
Confidence55