Skip to content

Topic

Retrieval-Augmented Generation

Ingestion, chunking, retrieval, and grounding pipelines that feed retrieved document context to an LLM.

Current stories

buildOne report1 publisher

NoteBank lets Gated DeltaNet re-read its own saved snippets and reach 70.3% at 1M tokens

KAUST's NoteBank lifts Gated DeltaNet's mean accuracy on six 1M-token RULER tasks from 1.7% to 70.3% with no added training. The paper's fix for state forgetting is a small archive of verbatim snippets replayed before each question.

Publishers:dev.to

Reality

Evidence40
Adoption
Not scored
Hype gap+10
Incentives
Not scored
Confidence55
buildOne report1 publisher

OpenSearch Serverless NextGen can sleep after ten idle minutes and takes 10 to 30 seconds to wake

OpenSearch Serverless NextGen, S3 Vectors and DynamoDB vector indexing now all scale to zero on AWS, where OpenSearch's old floor was about $200 a month. A developer who deployed all three from one CDK project says it is hard to look past NextGen.

Publishers:dev.to

Reality

Evidence40
Adoption
Not scored
Hype gap+10
Incentives
Not scored
Confidence50
buildOne report1 publisher

Orca's 90% query cost cut is measured against a prompt holding 900-plus Sonar models

Orca Security cut query cost 90%, input tokens 93% and latency 75% in Discovery AI, its natural-language agent for Sonar queries on Amazon Bedrock. The baseline was a one-prompt proof of concept, so the savings transfer only to teams that start from one.

Publishers:aws.amazon.com

Reality

Evidence40
Adoption35
Hype gap+30
Incentives70
Confidence60
buildOne report1 publisher

Google DeepMind's EmbeddingGemma 2 embeds four modalities with 740M Apache-licensed parameters

Google DeepMind's EmbeddingGemma 2 maps text, images, video and audio into one vector space using 740M Apache-licensed parameters. It is built to run on phones and laptops, so the case for a hosted embedding API now depends on whether its quality holds up on a buyer's own data.

Publishers:huggingface.co

Reality

Evidence45
Adoption
Not scored
Hype gap+15
Incentives60
Confidence50
buildOne report1 publisher

EmbeddingGemma 2 maps five modalities into one 768-dimension vector space

Google DeepMind released EmbeddingGemma 2, a 740M-parameter open model that runs on a phone and embeds text, code, images, video and audio in one space. Teams running a separate embedder per modality can consolidate on it if Google's reported benchmark numbers hold on their own data.

Publishers:dev.to

Reality

Evidence50
Adoption20
Hype gap+25
Incentives60
Confidence55
buildOne report1 publisher

MLPerf Inference v6.1 starts timing a four-model RAG pipeline end to end

MLCommons' MLPerf Inference v6.1 adds tests that time a whole RAG pipeline and a 1,007-turn coding-agent replay. Those scores help a buyer size hardware only where the buyer's own pipeline spends its time the way the four-model reference does.

Publishers:dev.to

Reality

Evidence45
Adoption35
Hype gap+25
Incentives
Not scored
Confidence45
buildOne report1 publisher

S3 Vectors pre-filtering reaches existing indexes only after they move to ENHANCED mode

AWS says metadata pre-filtering in S3 Vectors returns up to 5x more matching vectors on highly selective filters, at no additional cost. Existing indexes keep CLASSIC search until updated, so multi-tenant RAG stores get the gain only after an index-mode switch.

Publishers:aws.amazon.com

Reality

Evidence45
Adoption
Not scored
Hype gap+25
Incentives70
Confidence55
buildConfirmed2 publishers

Cloudflare routes agent web search through AI Gateway with three crawler-vetted providers

Cloudflare now sells web search from Ceramic.ai, Exa and Linkup through AI Gateway at partner list prices, billed from gateway credits with no markup. Teams already on the gateway skip a separate search vendor account, though their agents still have to issue each search call.

Reality

Evidence55
Adoption
Not scored
Hype gap+10
Incentives70
Confidence60
buildOne report1 publisher

ChatGPT's EU search-engine designation moves audit evidence to the retrieval layer

ChatGPT is now a Very Large Online Search Engine under the EU's DSA, designated by the European Commission on Aug 31 with 159.1 million monthly EU users. Qtim CEO Anton Fokin argues that anyone shipping a web-search feature needs logs that can rebuild each answer from its sources.

Publishers:dev.to

Reality

Evidence45
Adoption
Not scored
Hype gap+20
Incentives65
Confidence40
buildOne report1 publisher

Plain RAG and GraphRAG missed all 31 counting and superlative questions on a TigerGraph benchmark

Plain RAG and GraphRAG got none of 31 counting and superlative questions right on a 100-question TigerGraph hackathon benchmark, an entrant reports. A COUNT from the graph, set beside the evidence actually read, shows when an answer is incomplete.

Publishers:dev.to

Reality

Evidence45
Adoption
Not scored
Hype gap+25
Incentives55
Confidence50
buildOne report1 publisher

Every QueryFusionRetriever fusion mode in llama_index writes into the retriever's cached scores

llama_index's QueryFusionRetriever writes into retriever-owned score wrappers in all four fusion modes, two more than the first patch fixed. Over a caching retriever, later queries read corrupted cached scores, and so far only an issue covers reciprocal_rerank.

Publishers:dev.to

Reality

Evidence60
Adoption
Not scored
Hype gap+5
Incentives25
Confidence55
buildConfirmed3 publishers

Ai2's open AstaBrief 8B writes cited research reports 3.5 times faster than Asta's Claude mode

Ai2 open-sourced AstaBrief 8B, which writes cited research reports in 51.1 seconds against 178.5 for Asta's Claude-powered mode. Labs that cannot send unpublished research questions to a hosted model can now run a cited-report generator on their own servers.

Perspective Coverage

3 publishers
Builder
Builder 55%
Operator
Operator 33%
Investor
Investor 12%

Reality

Evidence55
Adoption18
Hype gap+22
Incentives55
Confidence60
buildOne report1 publisher

Plain-language questions push SEPA rulebook answers out of a top-5 vector search

One developer's test on 484 SEPA rulebook passages found that plain-English questions push several answers out of a top-5 vector search. Because the test measures each answer's rank directly, the failure shows up in retrieval, before the language model writes anything.

Publishers:dev.to

Reality

Evidence55
Adoption
Not scored
Hype gap0
Incentives
Not scored
Confidence45
buildOne report1 publisher

Teams leaving OpenAI's retired Assistants API must rebuild thread history by hand

OpenAI retired the Assistants API on August 26, 2026, without an automatic tool to move old Threads into the Conversation objects that replace them. Teams that relied on managed threads now write that migration and set how much history each turn sends.

Publishers:dev.to

Reality

Evidence30
Adoption
Not scored
Hype gap+20
Incentives
Not scored
Confidence35
buildOne report1 publisher

A citation graph lets a legal RAG agent reach the penalty for breaking Section 26

A developer's GraphRAG build turns Thailand's 96-section PDPA into a 190-node graph so an agent can walk from Section 26 to the fines that cite it. The published part argues the vector-search gap from vocabulary and reports no measured recall figures.

Publishers:dev.to

Reality

Evidence40
Adoption
Not scored
Hype gap+15
Incentives25
Confidence45
buildOne report1 publisher

Crutches built from measured failures lift a local Qwen 3B from 33% to 52% on post-cutoff facts

Qwen2.5-3B, wired to a local Wikipedia index, scored 52% on 150 post-cutoff questions it answers none of unaided, up from 33%, in a dev.to author's tests. Each fix targets a measured 3B failure, so a zero-shot 7B gained only 9 points from them, and the two readers' confidence intervals overlap.

Publishers:dev.to

Reality

Evidence35
Adoption
Not scored
Hype gap+25
Incentives
Not scored
Confidence40
buildOne report1 publisher

Notion's ZeroEntropy deal ends the reranker maker's run as a standalone API vendor

Notion bought ZeroEntropy after its reranker cut latency in Notion's reranking step by 85%, by Notion's count. The hosted product is being sunset with an open-weight release, so teams that built on ZeroEntropy's API now have to decide where the model runs.

Publishers:runtimewire.com

Reality

Evidence40
Adoption40
Hype gap+15
Incentives60
Confidence45

Earlier coverage

  1. Cohere says Embed 5 Fast keeps 98.4% of Pro's retrieval score when querying a Pro index

    Build · September 30, 2026 · Confirmed2 publishers

  2. DynamoDB Now Does Vector Search, So Your Sync Pipeline Needs a Business Case

    Build · August 18, 2026 · Confirmed2 publishers

  3. A dedicated vector database adds a sync job to every write

    Build · September 22, 2026 · One report1 publisher

  4. One error code explains why RAG pipelines keep a keyword index

    Build · September 18, 2026 · One report1 publisher