Skip to content

Topic

Embedding models

Models that convert text into vectors so similar meanings sit close together, used as first-stage retrievers in search and retrieval-augmented generation.

Current stories

buildOne report1 publisher

EmbeddingGemma 2 maps five modalities into one 768-dimension vector space

Google DeepMind released EmbeddingGemma 2, a 740M-parameter open model that runs on a phone and embeds text, code, images, video and audio in one space. Teams running a separate embedder per modality can consolidate on it if Google's reported benchmark numbers hold on their own data.

Publishers:dev.to

Reality

Evidence50
Adoption20
Hype gap+25
Incentives60
Confidence55
buildConfirmed13 publishers

Google's EmbeddingGemma 2 fits multimodal search into 567MB of phone RAM

Google released EmbeddingGemma 2, an Apache 2.0 model that maps text, code, images, video and audio into one embedding space with 740M parameters. Phone apps get offline cross-media search from one set of weights, within limits set by a shared 8K-token window and lossy vector truncation.

Perspective Coverage

17 publishers
Builder
Builder 59%
Operator
Operator 29%
Investor
Investor 12%

Reality

Evidence55
Adoption22
Hype gap+20
Incentives70
Confidence62
buildConfirmed2 publishers

Cohere says Embed 5 Fast keeps 98.4% of Pro's retrieval score when querying a Pro index

Cohere's Embed 5 lets teams index with Pro at $0.12 per million text tokens and query with Fast at $0.08 against the same vectors. The quality and throughput figures behind that split come from Cohere's own tests, run on datasets and parsing pipelines a buyer may not share.

Reality

Evidence45
Adoption
Not scored
Hype gap+20
Incentives75
Confidence55
buildOne report1 publisher

Choosing the embedding model first locks the vec0 table to a fixed 768-dimension schema

A dev.to walkthrough replaces a managed vector store and a hosted embedding API with sqlite-vec and a local model on port 11434. Its schema declares float[768], so changing model dimension means re-embedding everything.

Publishers:dev.to

Reality

Evidence42
Adoption
Not scored
Hype gap+25
Incentives22
Confidence48
buildOne report1 publisher

Toast 1 claims MTEB parity with OpenAI. The cost math in the pitch is off by 1000x.

Mixedbread's embedding model is reported to edge text-embedding-3-large by half a point. The savings case rests on an arithmetic slip and pricing that does not exist yet.

Publishers:dev.to

Reality

Evidence16
Adoption8
Hype gap+68
Incentives72
Confidence62
buildOne report1 publisher

Q2D-Web scores your retriever against labels only Perplexity can see

Perplexity pairs about 190 million web pages with 69,721 agent-written queries, which is closer to production than most retrieval tests get, and keeps the corpus, queries and labels private so it stays the only party able to run it.

Publishers:runtimewire.com

Reality

Evidence50
Adoption15
Hype gap+15
Incentives88
Confidence55