🧠 TextEncoder is now LLMEncoder -- clearer name, same transformer embeddings
October 1, 2026 at 2:15 PM
🧠 TextEncoder is now LLMEncoder -- clearer name, same transformer embeddings
zenn.dev/sktt_panda/articl...
Base64エンコード/デコードをブラウザで実装する — 日本語で崩れるbtoa/atobをTextEncoderで直す
Base64エンコード/デコードをブラウザで実装する — 日本語で崩れるbtoa/atobをTextEncoderで直す
Base64エンコード/デコードをブラウザで実装する — 日本語で崩れるbtoa/atobをTextEncoderで直す
zenn.dev
September 13, 2026 at 6:07 AM
zenn.dev/sktt_panda/articl...
Base64エンコード/デコードをブラウザで実装する — 日本語で崩れるbtoa/atobをTextEncoderで直す
Base64エンコード/デコードをブラウザで実装する — 日本語で崩れるbtoa/atobをTextEncoderで直す
I really like this project 😍
Two ideas for maybe future additions
1. Show the gzip size next to file size
(TextEncoder + CompressionStream)
2. Allow setting browser targets
Often we/clients have a support minimum e.g. iOS 15. Based on this you could warn/note features that might not work
Two ideas for maybe future additions
1. Show the gzip size next to file size
(TextEncoder + CompressionStream)
2. Allow setting browser targets
Often we/clients have a support minimum e.g. iOS 15. Based on this you could warn/note features that might not work
September 9, 2026 at 3:51 PM
I really like this project 😍
Two ideas for maybe future additions
1. Show the gzip size next to file size
(TextEncoder + CompressionStream)
2. Allow setting browser targets
Often we/clients have a support minimum e.g. iOS 15. Based on this you could warn/note features that might not work
Two ideas for maybe future additions
1. Show the gzip size next to file size
(TextEncoder + CompressionStream)
2. Allow setting browser targets
Often we/clients have a support minimum e.g. iOS 15. Based on this you could warn/note features that might not work
bruh TextEncoder used to support utf16 but at some point they decided it wasn't used enough and removed it 🥴
its so dumb that TextDecoder supports non-utf8 encodings and TextEncoder doesn't
its so dumb that TextDecoder supports non-utf8 encodings and TextEncoder doesn't
November 28, 2024 at 10:40 AM
bruh TextEncoder used to support utf16 but at some point they decided it wasn't used enough and removed it 🥴
its so dumb that TextDecoder supports non-utf8 encodings and TextEncoder doesn't
its so dumb that TextDecoder supports non-utf8 encodings and TextEncoder doesn't
[API Proposal]: TextEncoder.FindFirstCharacterToEncode(ReadOnlySpan) (114423) https://github.com/dotnet/runtime/issues/114423
[API Proposal]: TextEncoder.FindFirstCharacterToEncode(ReadOnlySpan<char>) · Issue #114423 · dotnet/runtime
Background and motivation TextEncoder does not provide a safe version of FindFirstCharacterToEncode for UTF16, it only has an unsafe (accepting an unmanaged pointer) for UTF16 and a safe one for UT...
github.com
April 9, 2025 at 7:23 AM
[API Proposal]: TextEncoder.FindFirstCharacterToEncode(ReadOnlySpan) (114423) https://github.com/dotnet/runtime/issues/114423
all that after realizing that TextEncoder and TextDecoder APIs are what every single library that would like to compete in terms of performance tries to avoid these API at all costs, granting maintenance hell and code bloat for no reason🤦
This needs a fix
github.com/whatwg/encod...
This needs a fix
github.com/whatwg/encod...
TextEncoder and TextDecoder performance concern around all libraries / runtimes · Issue #343 · whatwg/encoding
What is the issue with the Encoding Standard? I've been asked to file a new issue after this comment #333 (comment) and here I am doing that: no runtime on the server prefers standards API to conve...
github.com
March 14, 2025 at 3:15 PM
all that after realizing that TextEncoder and TextDecoder APIs are what every single library that would like to compete in terms of performance tries to avoid these API at all costs, granting maintenance hell and code bloat for no reason🤦
This needs a fix
github.com/whatwg/encod...
This needs a fix
github.com/whatwg/encod...
if you use typed arrays and advanced features via TextEncoder/Decoder be aware it's a real mess in terms of expectations and the kind of buffers these can handle ... also: zero symmetry in there 🥲
summarized in this gist:
gist.github.com/WebReflectio...
summarized in this gist:
gist.github.com/WebReflectio...
TextEncoder & TextDecoder shenanigans
TextEncoder & TextDecoder shenanigans. GitHub Gist: instantly share code, notes, and snippets.
gist.github.com
March 3, 2025 at 1:18 PM
if you use typed arrays and advanced features via TextEncoder/Decoder be aware it's a real mess in terms of expectations and the kind of buffers these can handle ... also: zero symmetry in there 🥲
summarized in this gist:
gist.github.com/WebReflectio...
summarized in this gist:
gist.github.com/WebReflectio...
Very cool technique by @nastystereo.com for POST based CSRF without a content-type header using a Blob object, Interestingly it also seems to work using a Uint8Array
December 2, 2024 at 8:25 PM
Very cool technique by @nastystereo.com for POST based CSRF without a content-type header using a Blob object, Interestingly it also seems to work using a Uint8Array
ECMAScript excitement 😉
Congrats to @jasnell.me on advancing Typed Array Find Within to Stage 1 at TC39 today 🎉
It aims to provide a native indexOf operations for Typed Arrays.
docs.google.com/presentation...
Congrats to @jasnell.me on advancing Typed Array Find Within to Stage 1 at TC39 today 🎉
It aims to provide a native indexOf operations for Typed Arrays.
docs.google.com/presentation...
November 18, 2025 at 8:05 AM
ECMAScript excitement 😉
Congrats to @jasnell.me on advancing Typed Array Find Within to Stage 1 at TC39 today 🎉
It aims to provide a native indexOf operations for Typed Arrays.
docs.google.com/presentation...
Congrats to @jasnell.me on advancing Typed Array Find Within to Stage 1 at TC39 today 🎉
It aims to provide a native indexOf operations for Typed Arrays.
docs.google.com/presentation...
ECMAScript excitement 😉
Congrats to @jasnell.me on advancing Typed Array Concatenation to Stage 1 at TC39 today 🎉
It aims to improve the performance of this concat operation compared to userland libraries.
Congrats to @jasnell.me on advancing Typed Array Concatenation to Stage 1 at TC39 today 🎉
It aims to improve the performance of this concat operation compared to userland libraries.
![const enc = new TextEncoder();
const u8_1 = enc.encode('hello');
const u8_2 = enc.encode('world');
const u8_3 = Uint8Array.concat([u8_1, u8_2]);](https://cdn.bsky.app/img/feed_thumbnail/plain/did:plc:w227epg3attqnssfdkx6ex6a/bafkreih3olwqia2py3t6uuc3qed3cldxqhzqvbk424j43twfsecmvzsrua)
November 18, 2025 at 7:52 AM
ECMAScript excitement 😉
Congrats to @jasnell.me on advancing Typed Array Concatenation to Stage 1 at TC39 today 🎉
It aims to improve the performance of this concat operation compared to userland libraries.
Congrats to @jasnell.me on advancing Typed Array Concatenation to Stage 1 at TC39 today 🎉
It aims to improve the performance of this concat operation compared to userland libraries.
Intl.Segmenter と TextEncoder().encode(msg).length の両方で見なきゃいけないな
March 31, 2024 at 3:31 AM
Intl.Segmenter と TextEncoder().encode(msg).length の両方で見なきゃいけないな
📝 The skrub TextEncoder brings the power of HuggingFace language models to embed text features in tabular machine learning, for all those use cases that involve text-based columns.
May 28, 2025 at 8:43 AM
📝 The skrub TextEncoder brings the power of HuggingFace language models to embed text features in tabular machine learning, for all those use cases that involve text-based columns.
I'm really liking Firefox's custom search shortcuts, I can do things like "caniuse[tab] TextEncoder" and it goes straight to that page, similarly "mdn[tab] TextDecoder loads up the exact docs
#Firefox
#Firefox
May 29, 2025 at 11:47 AM
I'm really liking Firefox's custom search shortcuts, I can do things like "caniuse[tab] TextEncoder" and it goes straight to that page, similarly "mdn[tab] TextDecoder loads up the exact docs
#Firefox
#Firefox
Widely available: Text encoding and decoding
Description: The TextEncoder API transforms a stream of code points into a byte stream with UTF-8 encoding, and TextDecoder does the reverse.
Description: The TextEncoder API transforms a stream of code points into a byte stream with UTF-8 encoding, and TextDecoder does the reverse.
Text encoding and decoding on Webplatform Feature Explorer
The TextEncoder API transforms a stream of code points into a byte stream with UTF-8 encoding, and TextDecoder does the reverse.
web-platform-dx.github.io
August 26, 2025 at 12:40 PM
Widely available: Text encoding and decoding
Description: The TextEncoder API transforms a stream of code points into a byte stream with UTF-8 encoding, and TextDecoder does the reverse.
Description: The TextEncoder API transforms a stream of code points into a byte stream with UTF-8 encoding, and TextDecoder does the reverse.
Oh, yes, new `TextEncoder().encode("🚀").length` vs `"🚀".length` has caused me some issues before, especially with storing S3 object metadata.
January 8, 2025 at 10:56 AM
Oh, yes, new `TextEncoder().encode("🚀").length` vs `"🚀".length` has caused me some issues before, especially with storing S3 object metadata.
You can achieve this using the TextEncoder API. TextEncoder.encode(str) will produce an Uint8Array of the bytes after conversion to UTF-8
November 19, 2024 at 9:28 AM
You can achieve this using the TextEncoder API. TextEncoder.encode(str) will produce an Uint8Array of the bytes after conversion to UTF-8
#skyfeedback
To get the correct byte length from the JavaScript string, SkyFeed must use TextEncoder to convert the JavaScript string to a UTF-8 byte stream and then get the byte length.
developer.mozilla.org/ja/docs/Web/...
To get the correct byte length from the JavaScript string, SkyFeed must use TextEncoder to convert the JavaScript string to a UTF-8 byte stream and then get the byte length.
developer.mozilla.org/ja/docs/Web/...
August 31, 2023 at 3:01 PM
#skyfeedback
To get the correct byte length from the JavaScript string, SkyFeed must use TextEncoder to convert the JavaScript string to a UTF-8 byte stream and then get the byte length.
developer.mozilla.org/ja/docs/Web/...
To get the correct byte length from the JavaScript string, SkyFeed must use TextEncoder to convert the JavaScript string to a UTF-8 byte stream and then get the byte length.
developer.mozilla.org/ja/docs/Web/...
JavaScriptの文字列、UTF-16方式で文字数をカウントしているから、UTF-8でのバイト長の指定が必要なAT Protocolのfacetsを指定するときにミスる危険が大きい。この投稿がズレたのもたぶんその辺の実装が甘々だったからだろう。公式のTypeScriptはその辺しっかりやってるけど、自前でlengthプロパティを参照してやろうとしたら絶対にミスる気がする。TextEncoderの使用を忘れないようにしなきゃ
App Passwordが何なのかを把握した（ https://bluesky-jp.github.io/welcome-bluesky/docs/walks/password ）から、SkyFeedにログインしてみた。入力欄内で自動改行した時にIMEが勝手に入力確定になっちゃうの使いづらいなぁ
August 30, 2023 at 2:58 PM
JavaScriptの文字列、UTF-16方式で文字数をカウントしているから、UTF-8でのバイト長の指定が必要なAT Protocolのfacetsを指定するときにミスる危険が大きい。この投稿がズレたのもたぶんその辺の実装が甘々だったからだろう。公式のTypeScriptはその辺しっかりやってるけど、自前でlengthプロパティを参照してやろうとしたら絶対にミスる気がする。TextEncoderの使用を忘れないようにしなきゃ
Couldn't find TextDecoder out of the box in react-native (TextEncoder worked though). Figured I'd make this package real quick:
www.npmjs.com/package/reac...
www.npmjs.com/package/reac...
react-native-encoding-api
A React Native package for handling text encoding and decoding. Latest version: 1.0.0, last published: 22 minutes ago. Start using react-native-encoding-api in your project by running `npm i react-nat...
www.npmjs.com
May 27, 2025 at 11:07 PM
Couldn't find TextDecoder out of the box in react-native (TextEncoder worked though). Figured I'd make this package real quick:
www.npmjs.com/package/reac...
www.npmjs.com/package/reac...
New big yavascript update :3
github.com/suchipi/yava...
Highlights:
- ES2020 -> ES2023
- Improved top-level await support
- Added TextEncoder/TextDecoder
- Added import attribute support
- exec/Worker improvements on Windows
- Bytecode (de)serializer improvements.
- FreeBSD support added
github.com/suchipi/yava...
Highlights:
- ES2020 -> ES2023
- Improved top-level await support
- Added TextEncoder/TextDecoder
- Added import attribute support
- exec/Worker improvements on Windows
- Bytecode (de)serializer improvements.
- FreeBSD support added
Release v0.16.0 · suchipi/yavascript
This is a big update which has been a long time coming!
New Stuff
The underlying engine has been updated to support most of the ES2023 specification (it was previously ES2020). Notably, several ne...
github.com
June 7, 2026 at 4:56 AM
New big yavascript update :3
github.com/suchipi/yava...
Highlights:
- ES2020 -> ES2023
- Improved top-level await support
- Added TextEncoder/TextDecoder
- Added import attribute support
- exec/Worker improvements on Windows
- Bytecode (de)serializer improvements.
- FreeBSD support added
github.com/suchipi/yava...
Highlights:
- ES2020 -> ES2023
- Improved top-level await support
- Added TextEncoder/TextDecoder
- Added import attribute support
- exec/Worker improvements on Windows
- Bytecode (de)serializer improvements.
- FreeBSD support added