Skip to content

Topic

Subword Tokenization

Subword tokenization splits text into common character sequences shorter than words, using methods like Byte Pair Encoding, to build NLP vocabularies.

Current stories

investConfirmed3 publishers

Deutsche Bank puts Bitcoin and Ether custody first and stablecoin conversion later

Deutsche Bank says its first crypto custody service is weeks from launch in Germany, starting with Bitcoin and Ether. The bank's product page lists five tokens, so the gap between a supported asset and a usable service is what clients will meet first.

Perspective Coverage

3 publishers
Builder
Builder 12%
Operator
Operator 37%
Investor
Investor 51%

Reality

Evidence55
Adoption
Not scored
Hype gap+20
Incentives45
Confidence65
buildOne report1 publisher

Brandeis's CPU profile puts 88% of a warm bert-base-uncased encoding pass in normalization

Simon Brandeis reports that text normalization took 88% of a warm English encoding pass with bert-base-uncased, against 8% for WordPiece. His faster normalizer was still a pull request at publication, so the token-parity check falls to whoever adopts it.

Publishers:dev.to

Reality

Evidence62
Adoption5
Hype gap−5
Incentives
Not scored
Confidence60
investOne report1 publisher

IMF warns tokenized collateral could accelerate forced liquidations in a stress

The IMF counted $65.1 billion of tokenized real-world assets at July 31 in its October 2026 Global Financial Stability Report. It rates systemic risk limited because the market is small, and lists legal certainty and safe settlement among four obstacles to broader adoption.

Publishers:news.bitcoin.com

Reality

Evidence58
Adoption35
Hype gap+20
Incentives
Not scored
Confidence60
investOne report1 publisher

Clarity Act's Senate stall hands US crypto rulemaking to the SEC and CFTC

With the Clarity Act stalled in the Senate, the SEC and CFTC are writing US crypto rules, but only one of their three measures since September 17 is in force. Executives expect faster deals from that route while lawyers warn its rules stay open to political and legal reversal.

Publishers:coindesk.com

Reality

Evidence55
Adoption
Not scored
Hype gap+20
Incentives60
Confidence50
buildConfirmed22 publishers

Prompt length sets what Anthropic's Haiku 5.5 price cut is worth to each workload

Anthropic launched Claude Haiku 5.5 at an average price about 75% below Haiku 4.5. The saving varies widely with prompt length, so teams moving classification, support or query traffic need to price their own requests before they switch models.

Perspective Coverage

22 publishers
Builder
Builder 47%
Operator
Operator 36%
Investor
Investor 17%

Reality

Evidence66
Adoption30
Hype gap+25
Incentives70
Confidence65
investConfirmed5 publishers

MetaMask keeps the corporate shell that engaged Goldman and JPMorgan for the listing

Consensys is splitting by the end of 2026. The faster-growing wallet business keeps the existing legal entity that lined up JPMorgan and Goldman. Linea, Besu and Teku move to a newly formed company under a new chief executive.

Perspective Coverage

5 publishers
Builder
Builder 23%
Operator
Operator 35%
Investor
Investor 42%

Reality

Evidence70
Adoption55
Hype gap+20
Incentives60
Confidence68
investConfirmed4 publishers

IMF puts tokenized repo at $300 billion to $350 billion a day

Tokenized repurchase agreements average $300 billion to $350 billion a day, the IMF said in its October 8 Global Financial Stability Report. Against the $13 trillion a day some analyses cite for US repo, that comes to 2 to 3 percent of the flow, on venues the fund calls fragmented and short of legal clarity.

Perspective Coverage

4 publishers
Builder
Builder 25%
Operator
Operator 34%
Investor
Investor 41%

Reality

Evidence60
Adoption30
Hype gap+10
Incentives40
Confidence62
investOne report1 publisher

XRP Ledger fees ran $528 in one day against a $1.34 billion stablecoin base

XRP Ledger held $1.338 billion in tracked stablecoins on Oct. 7 while its chain fees for the day came to $528, DefiLlama data show. Because fees and reserves scale with transactions and accounts, how much XRP that base needs depends on the inventory that bridges and liquidity pools keep between trades.

Publishers:cryptoslate.com

Reality

Evidence58
Adoption42
Hype gap−5
Incentives45
Confidence60
investConfirmed5 publishers

Soda Labs raises $3 million from one backer to hide bank balances on public blockchains

Soda Labs raised a $3 million seed round, all from Luxembourg's NextBlock, to move its privacy layer for banks and payment firms from pilots into production. The cash covers 12 to 18 months to show a bank will settle on Ethereum or Base once amounts and counterparties are hidden.

Perspective Coverage

5 publishers
Builder
Builder 35%
Operator
Operator 27%
Investor
Investor 38%

Reality

Evidence45
Adoption30
Hype gap+35
Incentives70
Confidence60
scienceOne report1 publisher

Retrofit turns subword language models into byte-level ones with under 1% of a pretraining budget

Minixhofer and colleagues converted subword language models to read raw bytes using 49.1 billion training tokens, under 1% of a typical pretraining budget. Byte-level models have long trailed subword systems, and starting from a trained model is how this work closes most of that gap.

Publishers:nature.com

Reality

Evidence60
Adoption5
Hype gap+15
Incentives
Not scored
Confidence55
buildConfirmed6 publishers

Aleph Alpha's open Kolibri model routes each token through 3.46B of its 78.1B parameters

Aleph Alpha released Kolibri, an Apache 2.0 German-English model that activates 3.46B of its 78.1B parameters per token. Each token costs about as much compute as a small model, yet a team hosting it in Europe still has to fit every expert in memory.

Perspective Coverage

6 publishers
Builder
Builder 47%
Operator
Operator 37%
Investor
Investor 16%

Reality

Evidence72
Adoption
Not scored
Hype gap+15
Incentives65
Confidence70
investOne report1 publisher

Schnabel ties all three of her on-chain settlement models to central-bank reserves

ECB board member Isabel Schnabel set out three ways to put central-bank money on-chain, two of which leave the reserves off the ledger. Her slides stop short of picking a model, so builders of tokenized-securities venues have to plan for three different cash legs.

Reality

Evidence55
Adoption20
Hype gap0
Incentives60
Confidence50
buildOne report1 publisher

Claude Opus 5 cuts Russian text into nearly three times as many tokens as English

Habr user donseo's test of 11 tokenizers found Claude Opus 5 turns Russian into 2.96 times the tokens of the same English text. Anthropic bills $5 per million input tokens in either language, so Russian on Opus 5 costs nearly three times as much to send.

Publishers:dev.to

Reality

Evidence55
Adoption
Not scored
Hype gap+10
Incentives
Not scored
Confidence50
investOne report1 publisher

Morgan Stanley opens a lab for stablecoins, tokenization and DeFi

Morgan Stanley, with $9.3 trillion of client assets, has opened a lab to test stablecoins, tokenization and DeFi, according to Crypto Briefing. Its bid to hold and trade crypto itself rests on the national trust bank charter it filed for in February.

Reality

Evidence35
Adoption
Not scored
Hype gap+35
Incentives
Not scored
Confidence40
investConfirmed3 publishers

Four more weeks at this pace takes Bitmine to 5% of Ethereum's supply

Bitmine holds 5,983,940 ETH, 4.9% of supply, and the 121,060 tokens still missing cost about $325m at its own reference price, a bill its cash balance covers twice over. Tom Lee expects institutions in the fourth quarter.

Perspective Coverage

3 publishers
Builder
Builder 7%
Operator
Operator 17%
Investor
Investor 76%

Reality

Evidence62
Adoption45
Hype gap+22
Incentives80
Confidence65
investConfirmed3 publishers

TRM sizes this year's AI agent payments on x402 at $4 million at the outside

BlackRock's new paper argues stablecoins are the rail built for sub-cent machine payments, and TRM Labs, examining $52.7 million of Coinbase x402 settlements, could attribute between 0.6% and 7.5% of the value to AI agents.

Perspective Coverage

3 publishers
Builder
Builder 29%
Operator
Operator 23%
Investor
Investor 48%

Reality

Evidence55
Adoption12
Hype gap+40
Incentives60
Confidence55
buildOne report1 publisher

A 24,000-character CJK tool result reached Claude Code's context as 49,964 tokens

Claude Code screens MCP output for character length before it counts tokens, so a dev.to test measured a result at roughly twice the documented 25,000-token cap sitting in the conversation untouched. The docs describe the same guard in two units.

Publishers:dev.to

Reality

Evidence74
Adoption
Not scored
Hype gap−5
Incentives35
Confidence62

Earlier coverage

  1. Britain hands the Bank of England an innovation duty that stability still outranks

    Invest · August 28, 2026 · Confirmed4 publishers