"Clotiversary" - It's hard to believe today is just that - one year since being hospitalized with bilateral pulmonary embolism (BPE). (BPE is blood clots in both lungs.) Thanks to the love of my family and friends, I was able to overcome this moment in my life. ALWAYS LISTEN TO YOUR BODY! HUGS! 💕
September 3, 2025 at 9:15 PM
"Clotiversary" - It's hard to believe today is just that - one year since being hospitalized with bilateral pulmonary embolism (BPE). (BPE is blood clots in both lungs.) Thanks to the love of my family and friends, I was able to overcome this moment in my life. ALWAYS LISTEN TO YOUR BODY! HUGS! 💕
Happy birthday!! Pierro turned 11 a few weeks ago and also still has Big Puppy Energy (BPE) 🥰
December 30, 2025 at 8:41 PM
Happy birthday!! Pierro turned 11 a few weeks ago and also still has Big Puppy Energy (BPE) 🥰
We created SuperBPE🚀, a *superword* tokenizer that includes tokens spanning multiple words.
When pretraining at 8B scale, SuperBPE models consistently outperform the BPE baseline on 30 downstream tasks (+8% MMLU), while also being 27% more efficient at inference time.🧵
When pretraining at 8B scale, SuperBPE models consistently outperform the BPE baseline on 30 downstream tasks (+8% MMLU), while also being 27% more efficient at inference time.🧵
March 21, 2025 at 4:48 PM
We created SuperBPE🚀, a *superword* tokenizer that includes tokens spanning multiple words.
When pretraining at 8B scale, SuperBPE models consistently outperform the BPE baseline on 30 downstream tasks (+8% MMLU), while also being 27% more efficient at inference time.🧵
When pretraining at 8B scale, SuperBPE models consistently outperform the BPE baseline on 30 downstream tasks (+8% MMLU), while also being 27% more efficient at inference time.🧵
i'm gonna be famous when i make the first whale BPE tokenizer
New paper out in Proceedings of the Royal Society B: we apply linguistic tools to sperm whale vowels.
The result: sperm whale vowels do not just look like human vowels. They also behave like them.
We found several parallels. Like in Latin, whales have short and long vowels.
The result: sperm whale vowels do not just look like human vowels. They also behave like them.
We found several parallels. Like in Latin, whales have short and long vowels.
April 15, 2026 at 6:53 AM
i'm gonna be famous when i make the first whale BPE tokenizer
Implementing Byte Pair Encoding (BPE) Tokenizer From Scratch by piyush
What is BPE?
• BPE is a subword tokenization algorithm
• It breaks text into frequently occurring character patterns
• Used in modern NLP models (GPT, BERT, etc.)
github.com/piyushdev04/...
What is BPE?
• BPE is a subword tokenization algorithm
• It breaks text into frequently occurring character patterns
• Used in modern NLP models (GPT, BERT, etc.)
github.com/piyushdev04/...
January 12, 2026 at 2:08 AM
Implementing Byte Pair Encoding (BPE) Tokenizer From Scratch by piyush
What is BPE?
• BPE is a subword tokenization algorithm
• It breaks text into frequently occurring character patterns
• Used in modern NLP models (GPT, BERT, etc.)
github.com/piyushdev04/...
What is BPE?
• BPE is a subword tokenization algorithm
• It breaks text into frequently occurring character patterns
• Used in modern NLP models (GPT, BERT, etc.)
github.com/piyushdev04/...
girl who isn’t going to submit this run
-40 bpe into hmc tho, stay tuned for a fatty pb
-40 bpe into hmc tho, stay tuned for a fatty pb
January 16, 2025 at 1:38 AM
girl who isn’t going to submit this run
-40 bpe into hmc tho, stay tuned for a fatty pb
-40 bpe into hmc tho, stay tuned for a fatty pb
A reader recently shared a resource on training tokenizers for new languages which reminded me I originally wrote a BPE Tokenizer for my “LLMs from Scratch” book but never shared it!
If you are looking a weekend project, here you go: sebastianraschka.com/blog/2025/bp...
If you are looking a weekend project, here you go: sebastianraschka.com/blog/2025/bp...
Implementing A Byte Pair Encoding (BPE) Tokenizer From Scratch
This is a standalone notebook implementing the popular byte pair encoding (BPE) tokenization algorithm, which is used in models like GPT-2 to GPT-4, Llama 3, etc., from scratch for educational purpose...
sebastianraschka.com
January 19, 2025 at 3:09 PM
A reader recently shared a resource on training tokenizers for new languages which reminded me I originally wrote a BPE Tokenizer for my “LLMs from Scratch” book but never shared it!
If you are looking a weekend project, here you go: sebastianraschka.com/blog/2025/bp...
If you are looking a weekend project, here you go: sebastianraschka.com/blog/2025/bp...
The governor of Maine has some BPE! Whew! 😜
Trump and Maine Governor Clash Over Transgender Athlete Ban!
February 21, 2025 at 10:25 PM
The governor of Maine has some BPE! Whew! 😜
First 1:10 up and BPE out of carpetless! Big pb coming soon 🙂↕️
January 14, 2025 at 3:43 AM
First 1:10 up and BPE out of carpetless! Big pb coming soon 🙂↕️
May 1, 2025 at 12:03 PM
> "they just don't have that dog in them"
computer, use tiktoken to BPE tokenize & embed this Pomeranian
computer, use tiktoken to BPE tokenize & embed this Pomeranian
September 21, 2026 at 10:34 PM
> "they just don't have that dog in them"
computer, use tiktoken to BPE tokenize & embed this Pomeranian
computer, use tiktoken to BPE tokenize & embed this Pomeranian
Tom Homan has real BPE -- Bass Pro Energy.
June 9, 2025 at 5:19 PM
Tom Homan has real BPE -- Bass Pro Energy.
My paper "Tokenization as Finite-State Transduction" was accepted to Computational Linguistics.
This was my final PhD degree requirement :)
The goal was to unify the major tokenization algorithms under a finite-state automaton framework. For example, by encoding a BPE tokenizer as a transducer.
This was my final PhD degree requirement :)
The goal was to unify the major tokenization algorithms under a finite-state automaton framework. For example, by encoding a BPE tokenizer as a transducer.
August 15, 2025 at 7:25 AM
My paper "Tokenization as Finite-State Transduction" was accepted to Computational Linguistics.
This was my final PhD degree requirement :)
The goal was to unify the major tokenization algorithms under a finite-state automaton framework. For example, by encoding a BPE tokenizer as a transducer.
This was my final PhD degree requirement :)
The goal was to unify the major tokenization algorithms under a finite-state automaton framework. For example, by encoding a BPE tokenizer as a transducer.
Girls5eva singing BPE right now at the DNC
August 19, 2024 at 11:21 PM
Girls5eva singing BPE right now at the DNC
unsure who needs to see this but if you are adding new tokens to a bpe based tokenizer use the tokenizer.AddedToken class, and if you are using a bpe based autoregressive LM, then you'd most likely want to have lstrip=True, special=True, single_word=True!
January 22, 2025 at 3:06 AM
unsure who needs to see this but if you are adding new tokens to a bpe based tokenizer use the tokenizer.AddedToken class, and if you are using a bpe based autoregressive LM, then you'd most likely want to have lstrip=True, special=True, single_word=True!
I keeping thinking about “BPE” or Big Pussy Energy by Girls5Eva. 😂
July 17, 2024 at 3:00 PM
I keeping thinking about “BPE” or Big Pussy Energy by Girls5Eva. 😂
This right here…👆🏾BPE I freaking love it.
January 19, 2025 at 4:37 AM
This right here…👆🏾BPE I freaking love it.
I found a function that initialises the emulator hacks based on the GBA ROM's ID. These are the IDs the emulator recognises for the Pokemon hacks. BPR and BPG are FireRed and LeafGreen, respectively, but AXV, AXP, and BPE are Ruby, Sapphire, and Emerald, respectively. Huh.
February 27, 2026 at 6:20 PM
I found a function that initialises the emulator hacks based on the GBA ROM's ID. These are the IDs the emulator recognises for the Pokemon hacks. BPR and BPG are FireRed and LeafGreen, respectively, but AXV, AXP, and BPE are Ruby, Sapphire, and Emerald, respectively. Huh.
My big question is that when the Koreans send workers to the US & ICE/BPE arrests them, will they be returned to South Korea by submarine?
October 30, 2025 at 12:08 AM
My big question is that when the Koreans send workers to the US & ICE/BPE arrests them, will they be returned to South Korea by submarine?
I know he's said he has no interest, but damn if he doesn't have BPE. Big presidential energy.
July 31, 2026 at 10:34 PM
I know he's said he has no interest, but damn if he doesn't have BPE. Big presidential energy.
“Kids dressed in Halloween costumes walking to a parade do not pose an immediate threat to the safety of a law enforcement officer,” U.S. District Judge Sara Ellis said to BPE chief Gregory Bovino during an Oct. 28 hearing. “They just don’t. And you can’t use riot-control weapons against them.”
The Trump administration is gleefully engaging in acts of cruelty against immigrants, U.S. citizens and entire communities, and they’re doing it because, at the risk of sounding too academic, they’re weak and they suck. Clowns like Greg Bovino aren’t fooling anyone.
www.usatoday.com/story/opinio...
www.usatoday.com/story/opinio...
Judge tells faux-tough-guy Border Patrol chief not to tear-gas trick-or-treaters | Opinion
Full of faux bravado, Trump's Border Patrol turned a children's Halloween parade in Chicago into chaos, tossing tear gas canisters without warning.
www.usatoday.com
October 29, 2025 at 8:51 PM
“Kids dressed in Halloween costumes walking to a parade do not pose an immediate threat to the safety of a law enforcement officer,” U.S. District Judge Sara Ellis said to BPE chief Gregory Bovino during an Oct. 28 hearing. “They just don’t. And you can’t use riot-control weapons against them.”