boils down to this: How text turns into numbers the model can "eat" (BPE tokenization) The sole mission of a language model: predict the next token How the Transformer uses Attention so tokens can pass messages to each other In training, the NLL loss pushes the probability of
September 28, 2026 at 5:41 PM
boils down to this: How text turns into numbers the model can "eat" (BPE tokenization) The sole mission of a language model: predict the next token How the Transformer uses Attention so tokens can pass messages to each other In training, the NLL loss pushes the probability of
🚨Leave Netflix tonight. Watch this 2 h 34 min Stanford class. It's the clearest, most complete, and brutally honest explanation out there on how ChatGPT and Claude are really built. From Tokenization and BPE to the Transformer architecture, the training pipeline, and the
September 28, 2026 at 5:41 PM
🚨Leave Netflix tonight. Watch this 2 h 34 min Stanford class. It's the clearest, most complete, and brutally honest explanation out there on how ChatGPT and Claude are really built. From Tokenization and BPE to the Transformer architecture, the training pipeline, and the
Well and it doesn’t help you are holding it like a dude..
Total
BPE (BigPotatoEnergy)
…. And I don’t know why I cant look away.
Total
BPE (BigPotatoEnergy)
…. And I don’t know why I cant look away.
September 24, 2026 at 11:56 PM
Well and it doesn’t help you are holding it like a dude..
Total
BPE (BigPotatoEnergy)
…. And I don’t know why I cant look away.
Total
BPE (BigPotatoEnergy)
…. And I don’t know why I cant look away.
Meine Rede: Das Problem ist seit Jahrzehnten und länger die perfide (!) systematische Individualisierung belastender Lebensumstände: Menschen werden psychisch pathologisiert, um politische Missstände nicht ändern zu müssen und um sie profitabel ausschlachten zu können.
bpe-online.de/die-verbrech...
bpe-online.de/die-verbrech...
September 24, 2026 at 4:54 PM
Meine Rede: Das Problem ist seit Jahrzehnten und länger die perfide (!) systematische Individualisierung belastender Lebensumstände: Menschen werden psychisch pathologisiert, um politische Missstände nicht ändern zu müssen und um sie profitabel ausschlachten zu können.
bpe-online.de/die-verbrech...
bpe-online.de/die-verbrech...
if you have stylized enough text and you fit a BPE tokenizer you can just pick tokens at random and it sort of sounds like real text
September 24, 2026 at 1:39 AM
if you have stylized enough text and you fit a BPE tokenizer you can just pick tokens at random and it sort of sounds like real text
jev's tokenizer seems to be Qwen3.5's splitter over a trimmed-o200k BPE!
i'll write it up more in detail tomorrow but if you need token counting, take a look at omp/main.
i'll write it up more in detail tomorrow but if you need token counting, take a look at omp/main.
September 23, 2026 at 9:16 PM
jev's tokenizer seems to be Qwen3.5's splitter over a trimmed-o200k BPE!
i'll write it up more in detail tomorrow but if you need token counting, take a look at omp/main.
i'll write it up more in detail tomorrow but if you need token counting, take a look at omp/main.
CDS-BART combines SentencePiece BPE tokenization with BART's denoising seq2seq architecture, pre-trained on 60 million CDSs from nine NCBI RefSeq taxonomic groups to handle sequences up to ~4 kb.
September 23, 2026 at 10:02 AM
CDS-BART combines SentencePiece BPE tokenization with BART's denoising seq2seq architecture, pre-trained on 60 million CDSs from nine NCBI RefSeq taxonomic groups to handle sequences up to ~4 kb.
Hugging Face Tokenizers v1 RC drops 3-30x faster BPE encoding with zero API changes. SIMD ops, smarter caching, and zero-alloc merge loops make this a free performance win for anyone doing LLM inference. https://huggingface.co/blog/tokenizers-v1
September 22, 2026 at 6:06 AM
Hugging Face Tokenizers v1 RC drops 3-30x faster BPE encoding with zero API changes. SIMD ops, smarter caching, and zero-alloc merge loops make this a free performance win for anyone doing LLM inference. https://huggingface.co/blog/tokenizers-v1
> "they just don't have that dog in them"
computer, use tiktoken to BPE tokenize & embed this Pomeranian
computer, use tiktoken to BPE tokenize & embed this Pomeranian
September 21, 2026 at 10:34 PM
> "they just don't have that dog in them"
computer, use tiktoken to BPE tokenize & embed this Pomeranian
computer, use tiktoken to BPE tokenize & embed this Pomeranian
New here. I write Trust, but Trace: what it takes to make ML systems trustworthy in production. Right now, a 12-part series for engineers moving into ML, reading real source instead of formulas. Part 1: a model doesn't read text.
cchinchilla.dev/posts/fcw-tokens-models-dont-read-text
cchinchilla.dev/posts/fcw-tokens-models-dont-read-text
A model doesn't read text: what a tokenizer decides for you
The tokenizer ships inside the model, not in front of it. Reading tiktoken's BPE for what it fixes before any weight exists: vocabulary, cost, context limit.
cchinchilla.dev
September 20, 2026 at 7:04 PM
New here. I write Trust, but Trace: what it takes to make ML systems trustworthy in production. Right now, a 12-part series for engineers moving into ML, reading real source instead of formulas. Part 1: a model doesn't read text.
cchinchilla.dev/posts/fcw-tokens-models-dont-read-text
cchinchilla.dev/posts/fcw-tokens-models-dont-read-text
What do you mean Sara Bareilles sang a bit of BPE from girls5eva at the radio city concerts and not mine!?!!?!? 😭💔 girls5eva has appeared in my top 100 Spotify wrapped every year since 2021, i would have loved to hear some live
September 20, 2026 at 12:06 PM
What do you mean Sara Bareilles sang a bit of BPE from girls5eva at the radio city concerts and not mine!?!!?!? 😭💔 girls5eva has appeared in my top 100 Spotify wrapped every year since 2021, i would have loved to hear some live
Elzbieta Dawidek (University of Lower Silesia DSW Ideis)
The Limits of BPE Tokenization in Polish: Segmentation-Flexional Forms, Grammatical Anchoring, and First-Person Stability in Inflectional Language Models
https://arxiv.org/abs/2609.17553
The Limits of BPE Tokenization in Polish: Segmentation-Flexional Forms, Grammatical Anchoring, and First-Person Stability in Inflectional Language Models
https://arxiv.org/abs/2609.17553
September 20, 2026 at 8:17 AM
Elzbieta Dawidek (University of Lower Silesia DSW Ideis)
The Limits of BPE Tokenization in Polish: Segmentation-Flexional Forms, Grammatical Anchoring, and First-Person Stability in Inflectional Language Models
https://arxiv.org/abs/2609.17553
The Limits of BPE Tokenization in Polish: Segmentation-Flexional Forms, Grammatical Anchoring, and First-Person Stability in Inflectional Language Models
https://arxiv.org/abs/2609.17553
In Demmin beim #AfD-Wahlkampfabschluss ist heute wieder das rechte Vorfeld angereist. Erkennt ihr ihn? Das ist Robin von der ausländerfeindlichen Stürzenberger-Truppe #BPE, die über den Islam "aufklären". Hier erklärt er, warum der ÖRR abgeschafft werden muss. Ernsthaft. #Antifa
September 19, 2026 at 6:36 PM
In Demmin beim #AfD-Wahlkampfabschluss ist heute wieder das rechte Vorfeld angereist. Erkennt ihr ihn? Das ist Robin von der ausländerfeindlichen Stürzenberger-Truppe #BPE, die über den Islam "aufklären". Hier erklärt er, warum der ÖRR abgeschafft werden muss. Ernsthaft. #Antifa
3/ BPE/tokeniser result: compression vs likelihood matters less than the search path; greedy bottom-up merging seems to carry BPE's gains. X: https://x.com/tpimentelms/status/2100587239067525410 Paper: https://arxiv.org/abs/2609.19145
September 19, 2026 at 1:21 AM
3/ BPE/tokeniser result: compression vs likelihood matters less than the search path; greedy bottom-up merging seems to carry BPE's gains. X: https://x.com/tpimentelms/status/2100587239067525410 Paper: https://arxiv.org/abs/2609.19145
BPE — Catholic leaders praise historic vote in Bangsamoro region's political development #Conference #BPE #News
Philippines bishops commend first Bangsamoro parliamentary elections
Following the completion of the first-ever Bangsamoro Parliamentary Elections (BPE), the Catholic Bishops’ Conference of the Philippines (CBCP) expressed commendation for the event. The elections, hel… · Photo : dying regime · CC BY · Flickr
news.netasgard.com
September 18, 2026 at 7:58 AM
BPE — Catholic leaders praise historic vote in Bangsamoro region's political development #Conference #BPE #News
14/ Why is BPE good? New tokeniser study disentangles objective vs search and finds bottom-up merging matters more than the compression objective. X: https://x.com/tpimentelms/status/2100587239067525410 Paper: https://arxiv.org/abs/2609.19145
September 18, 2026 at 1:41 AM
14/ Why is BPE good? New tokeniser study disentangles objective vs search and finds bottom-up merging matters more than the compression objective. X: https://x.com/tpimentelms/status/2100587239067525410 Paper: https://arxiv.org/abs/2609.19145