Meta folds diarization and endpointing into the transcript stream for $0.18 an hour
Speaker turns and end-of-speech markers now ride in the same token sequence as the words, which buys a cheaper pipeline and a tighter coupling than a three-vendor speech stack. The accuracy claim behind it is English-only.
The Engineer · Build desk

What happened
- Meta launched Muse Voice Transcribe on September 1, billing transcription, endpoint detection and speaker diarization from one model at $0.18 per processed audio hour.
- The rate is listed as $3 per 1,000 minutes through the Meta Model API, with streaming and non-streaming processing priced the same and diarization included rather than sold as an add-on.
- On Artificial Analysis's AA-WER Streaming benchmark, which covers English speech only, Muse reports a 3.1% word error rate against Cartesia Ink-2 at 3.4% and Gemini 3.5 Transcribe Live at 4%.
- Muse also leads on speaker recognition at a 17.5% error rate across several standard benchmarks, a band where The New Stack says every comparable model still struggles.
- A Meta spokesperson told The New Stack that the weights for this model will not be released, unlike the Muse Glimmer models.
Why it matters
- What it costs cost Speech specialists now have to defend their invoices on accuracy in the customer's own languages and on deployment control rather than on rate cards, and the pressure lands hardest on single-purpose diarization and endpointing vendors that have no transcription revenue to cross-subsidise.
- What it limits constraint Because speaker turns and end-of-speech markers are emitted inside the same token sequence as the words, there is no seam at which to substitute a better diarizer; you adopt the whole chain or you keep building it yourself.
- Who's exposed exposure With no open weights on offer, a team that collapses its speech stack onto this model runs its entire listening path on someone else's endpoint, so a price change or a deprecation notice arrives with no in-house fallback.
- What doesn't add up contradiction VentureBeat's read of the launch places the price near the low end while noting specialists beat Meta on individual measures, and Soniox's posted hour is cheaper still, so a migration argued on being the cheapest option is built on the wrong claim.
Next story · Invest · 4d ago
Meta's Muse Wonder, at $20 to $200 a month, is framed as a test of its superintelligence teamConfirmed25 publishers
The unit of purchase here is a token stream. Audio arrives in 80 ms chunks, 12.5 per second, each compressed into one soft token [7]. At every chunk the model picks one of two actions: emit a text token, or emit a "next audio" placeholder that the runtime swaps for the following chunk [8]. When the audio stops, an "empty audio" token tells the model nothing more is coming, and it flushes whatever text it is still holding [9]. Speaker turns ride that same sequence. A `<|start_of_turn|>` token marks a possible change, a token such as `<|speaker_A|>` assigns the turn, and separate tokens mark start and end of speech, all trained alongside transcription rather than handed to a downstream speaker classifier [12].
That gives you something to budget with. 12.5 chunks a second across an hour is 45,000 soft tokens [22], and $0.18 for that hour works out at $4 per million audio tokens [23]. Streaming and batch carry the same rate, and diarization is not a separate line [4].
The reward design is the part worth copying. Meta multiplies the word-error-rate reward by the delay reward instead of adding them [11]. Addition lets a model buy accuracy with unlimited stalling, because a strong WER term covers a weak delay term. Multiplication makes a near-zero score on either factor collapse the whole product. That is what produces adaptive delay, where the model spends more audio on an ambiguous word and commits early on an easy one [10]. What the launch material does not give you is a millisecond figure; the only published timing value is the 80 ms chunk period [26]. Barge-in budgets are a distribution here, not a constant, and you will have to measure it yourself.
For the accuracy number to describe your workload, your audio has to be English, streamed, and close enough to whatever mix Artificial Analysis assembled, because that benchmark covers English only [13]. Meta says 25 of more than 70 trained languages were extensively validated for this release [1], so anything outside those 25 is your eval problem. The margin over the next model on the list is 0.3 points [25], in a field where OpenAI, Google, xAI and Alibaba all shipped streaming models within weeks of each other, according to The New Stack [21].
The bundled feature is also the weak one. Speaker error at 17.5% is roughly 5.6 times the word error rate [24]. If your interface prints a name next to a quote, 17.5% is what the user meets.
On price, the bundle undercuts the $0.24 Speechmatics lists for Standard real-time transcription by 25% [19][27], while Soniox posts about $0.12 an hour with diarization, language identification and formatting included, a third under Meta [18][28]. The posted floor belongs to Soniox. What moved is the default assembly: one vendor billing one rate for work that used to need three integrations. Speechmatics will label 50 speakers by default and 100 on request, five times Meta's stated 20-plus [19][29], and if a hundred people are talking at once, speaker labels are not your first problem. Amazon Transcribe documents 30 [20]. Meta is not releasing these weights, a spokesperson told The New Stack [15], so a consolidated pipeline is a hosted dependency with no local build behind it.
What to watch
- Whether Artificial Analysis publishes a non-English AA-WER Streaming run, since the current 3.1% figure covers English only.
- Whether Soniox and Speechmatics reprice or instead defend on speaker counts, language coverage and deployment control.
- Whether the $0.18 rate survives once Meta's own glasses and Mac app drive volume, given there are no open weights to fall back on.
Clarity's read
What the record supports and how the coverage leans. The claims behind it follow.
Reality
- Evidence55
- Adoption24
- Hype gap+34
- Incentives72
- Confidence60
Claim ledger
Ranked by verification strength, evidence, and original report placement.
- [1]
Meta's technical launch post says Muse was trained across more than 70 languages, with 25 extensively validated for the first release.
- [2]
Meta says Muse supports audio longer than an hour, multilingual code-switching, and more than 20 speakers without a separate diarization pipeline.
- [3]
Meta launched Muse Voice Transcribe on September 1, pricing a real-time speech model with transcription, endpoint detection and speaker diarization at $0.18 per processed audio hour.
- [4]
Meta lists Muse Voice Transcribe at $3 per 1,000 minutes through the Meta Model API; streaming and non-streaming processing carry the same rate, and speaker diarization is included rather than billed as an add-on.
- [5]
At the public rate, 1,000 hours of processed audio would cost $180.
- [6]
Meta built Muse Voice Transcribe inside Meta Superintelligence Labs, the AI organization formed after Meta invested $14.3 billion in Scale AI and recruited its founder, Alexandr Wang.
- [7]
Audio comes in as 80-millisecond chunks, 12.5 per second, each compressed into a single soft token.
- [8]
At every chunk the model either emits a text token or a special "next audio" placeholder, which the system then replaces with the next chunk of audio.
- [9]
When the audio stops, an "empty audio" token signals to the model that no more audio is coming, and it flushes any text it is still holding.
- [10]
Meta calls the mechanism "adaptive delay": because the model controls how much audio it hears before committing to a word, it controls its own latency, with difficult words getting more context and easy words transcribed almost immediately.
- [11]
The tradeoff is learned during the model's reinforcement learning phase, where the word error rate reward and the delay reward are multiplied rather than added.
- [12]
Diarization and endpointing are part of the same output sequence: a <|start_of_turn|> token marks a possible speaker change, a token such as <|speaker_A|> assigns the turn, and separate tokens identify the start and end of speech, with those tasks trained together with transcription instead of sending completed text into a separate speaker-classification stage.
- [13]
On Artificial Analysis's AA-WER Streaming speech-to-text accuracy benchmark, Muse's word error rate is 3.1%, ahead of Cartesia Ink-2 (3.4%), ElevenLabs Scribe v2 Real-time (3.6%), GPT Live Transcribe (3.9%) and Gemini 3.5 Transcribe Live (4%); the benchmark applies only to English speech.
- [14]
On recognizing distinct speakers, all models still struggle more than most users would like, and Muse Voice Transcribe leads with a 17.5% error rate across several standard benchmarks.
- [15]
Unlike its Muse Glimmer models, Meta will not make the open weights of Muse Voice Transcribe available, a Meta spokesperson told The New Stack.
- [16]
Muse Voice Transcribe is available via the Meta Model API, Meta AI for Mac, and Muse Code.
- [17]
A VentureBeat review found that the price puts Muse near the low end of the real-time market, although specialized providers beat Meta on individual measures.
- [18]
Soniox lists real-time transcription at roughly $0.12 an hour and includes diarization, language identification and formatting, documenting support for as many as 15 speakers in a session.
- [19]
Speechmatics says its real-time service identifies as many as 50 speakers by default and can be configured for 100, with Standard real-time transcription listed at $0.24 an hour.
- [20]
Amazon Transcribe documents a maximum of 30 unique speakers and supports speaker partitioning in streaming sessions.
- [21]
The New Stack reports that OpenAI, Google, xAI and Alibaba all shipped streaming speech models within weeks of each other, and says a 0.3-point benchmark lead will not hold long in that field.
- [22]
One hour of audio at 12.5 chunks per second is 45,000 soft tokens.
- [23]
At $0.18 per audio hour, Muse's soft-token input works out to $4.00 per million tokens.
- [24]
Muse's 17.5% speaker error rate is about 5.6 times its 3.1% word error rate.
- [25]
Muse's word error rate is 0.3 points below the next model on the AA-WER Streaming list, Cartesia Ink-2.
- [26]
None of the supplied reports states a measured latency figure for adaptive delay; the only published timing value is the 80 ms chunk period.
- [27]
Meta's $0.18 hour is 25% below the $0.24 Speechmatics lists for Standard real-time transcription.
- [28]
Soniox's roughly $0.12 hour is about 33% below Meta's $0.18.
- [29]
Speechmatics' configurable ceiling of 100 speakers is five times Meta's stated 20-plus.
Sources
2 independent publishers whose own reporting we read for this story.
- runtimewire.comMeta launches Muse Voice Transcribe with diarization at $0.18 an hour
1 article · September 2, 2026
- thenewstack.ioMeta just beat OpenAI and Google at real-time transcription
2 articles · September 1, 2026
Topics and entities
Topics
- Speaker diarization
- Streaming latency tradeoffs
- Real-time speech recognition
- Speech API competition
- Inference Pricing and Token Economics
Entities
- OpenAI
- Meta Superintelligence Labs
- Alibaba
- Artificial Analysis
- Scale AI
- Muse Spark
- Mark Zuckerberg
- Muse Voice Transcribe
- OpenAI GPT Live Transcribe
- VentureBeat
- Gemini 3.5 Transcribe Live
- Meta
- Alexandr Wang
- Amazon Transcribe
- ElevenLabs Scribe v2 Realtime
- Muse Glimmer
- xAI
- AA-WER Streaming