Skip to content

Benchmark

FLEURS

Google's multilingual speech benchmark dataset spanning dozens of languages, used to evaluate automatic speech recognition and translation systems.

Known aliases

  • FLEURS Armenian test split
  • google/fleurs

Current stories

buildOne report1 publisher

Cactus Compute fits a 16.9MB speech model into the CPU runtime it built for tool calling

Cactus Compute released Whistle, an open 16.9MB speech-to-text model that runs on a CPU in the same Needle engine as its tool-calling language models. The accuracy and speed figures are the company's own, so they need rerunning on real devices and audio.

Publishers:runtimewire.com

Reality

Evidence40
Adoption
Not scored
Hype gap+10
Incentives60
Confidence45
buildConfirmed6 publishers

Google splits transcription in two, and quietly absorbs your cleanup layer

Gemini 3.5 Transcribe ships as a sub-second streaming endpoint and a batch one, with filler-word removal and formatting inside the model. The catalog and the pricing page have not caught up.

Perspective Coverage

6 publishers
Builder
Builder 48%
Operator
Operator 36%
Investor
Investor 16%

Reality

Evidence55
Adoption35
Hype gap+25
Incentives70
Confidence60
buildOne report1 publisher

Two lines of decoder config decide whether Thonburian Whisper transcribes Thai or translates it

Mahidol's Biomedical and Data Lab publishes Thai Whisper fine-tunes that are free to use commercially, with 6.59 and 7.42 WER on Common Voice 13. Both were scored with the Deepcut tokenizer, and that shared segmentation is the reason the two numbers sit on one scale.

Publishers:dev.to

Reality

Evidence45
Adoption20
Hype gap0
Incentives30
Confidence55
investOne report1 publisher

Microsoft's 10-cent transcription hour undercuts its own prior pricing, requiring rivals at the old rate to find 3.6 times the volume

The early-bird rate on MAI-Transcribe-2 sits 72% below the line's April price, which saves a 100,000-hour buyer $26,000 a year and takes 26 cents out of every 36 a standalone vendor charged for the same hour.

Publishers:pivotnews.ai

Reality

Evidence44
Adoption21
Hype gap+33
Incentives74
Confidence45
leadershipOne report1 publisher

Meta prices streaming transcription at a fifth of Google Cloud's standard rate

Muse Voice Transcribe's benchmark lead rests on three-tenths of a point across about eight hours of English audio, which is thinner evidence than the $0.18 hourly rate sitting underneath it.

Publishers:implicator.ai

Reality

Evidence58
Adoption28
Hype gap+24
Incentives68
Confidence60
buildOne report1 publisher

Armenian ASR leaderboard: closed models take the top eight, then lose the domains that matter

ArmBench-ASR v0.1 ranks nearly 30 systems on 20.7 hours of Armenian audio. The headline order flips on read speech, and every model degrades badly on movie dialogue.

Publishers:runtimewire.com

Reality

Evidence57
Adoption22
Hype gap+12
Incentives58
Confidence54