if the term "gzipped" is commonly used for data compressed with gzip then i propose referring to data compressed with zstd as "zestied"
May 19, 2025 at 7:34 PM
if the term "gzipped" is commonly used for data compressed with gzip then i propose referring to data compressed with zstd as "zestied"
Okay, one more! Kite now supports zstd compression. It fetches the latest dictionary on startup, seamlessly handles dictionary updates, and it works without any new dependencies, instead relying on the OTP 28 `:zstd` module
tangled.org/jola.dev/kite
tangled.org/jola.dev/kite
jola.dev/kite
An Elixir atproto Jetstream V2 subscriber library
tangled.org
September 21, 2026 at 2:24 PM
Okay, one more! Kite now supports zstd compression. It fetches the latest dictionary on startup, seamlessly handles dictionary updates, and it works without any new dependencies, instead relying on the OTP 28 `:zstd` module
tangled.org/jola.dev/kite
tangled.org/jola.dev/kite
we have to do zstd compression over the wire
September 25, 2026 at 5:16 AM
we have to do zstd compression over the wire
but also,,,
gzip, all of y’all?
it’s 2026, Accept zstd already!
(lightrail included oops)
gzip, all of y’all?
it’s 2026, Accept zstd already!
(lightrail included oops)
ever wonder who's doing sync1.1 backfill retries on repos that haven't been available to export? (but now areeeeee muah ha ha)
July 29, 2026 at 2:54 AM
but also,,,
gzip, all of y’all?
it’s 2026, Accept zstd already!
(lightrail included oops)
gzip, all of y’all?
it’s 2026, Accept zstd already!
(lightrail included oops)
64K zstd-q3-compressed content defined chunks should be enough for everyone – Bill Gates, probably
September 24, 2026 at 9:26 AM
64K zstd-q3-compressed content defined chunks should be enough for everyone – Bill Gates, probably
klauspost/compress zstd in golang (with assembly in the Go style) now comes within 25% of Yann Collet's official C zstd implementation for decode speed/sec on arm64!
September 10, 2026 at 7:45 PM
klauspost/compress zstd in golang (with assembly in the Go style) now comes within 25% of Yann Collet's official C zstd implementation for decode speed/sec on arm64!
Mildly impressive a 150gb mariadb database can compress to 12gb with zstd (using level 9). Really great for backups.
January 5, 2025 at 10:36 PM
Mildly impressive a 150gb mariadb database can compress to 12gb with zstd (using level 9). Really great for backups.
sorry to whoever asked for a zstd-encoded compliment, I timed out reading what zstd is
April 21, 2026 at 12:05 PM
sorry to whoever asked for a zstd-encoded compliment, I timed out reading what zstd is
Zstd Improvement For Linux 7.4 To Avoid Redundant Initialization - https://www.phoronix.com/news/Zstd-Linux-7.4-Avoid-Redundant
Zstd Improvement For Linux 7.4 To Avoid Redundant Initialization
In addition to Usama Arif's recent Linux patches for addressing a major inefficiency within the Linux kernel's Zstd compression code, he also has a separate patch series destined for Linux 7.4 to further enhance the Zstd compression/decompression performance by avoiding redundant initialization...
www.phoronix.com
September 13, 2026 at 2:14 PM
Zstd Improvement For Linux 7.4 To Avoid Redundant Initialization - https://www.phoronix.com/news/Zstd-Linux-7.4-Avoid-Redundant
about to do a very boring demo! (which might be very interesting to a certain kind of person, several of whom i think will be there!)
April 29, 2026 at 8:44 PM
about to do a very boring demo! (which might be very interesting to a certain kind of person, several of whom i think will be there!)
Fable autonomously found and fixed a 4 year old bug in klauspost/zstd! github.com/klauspost/co...
zstd: Re-enable unsafe decodeSync memory copies (#1168) by lizthegrey · Pull Request #1171 · klauspost/compress
Closes #1168 by taking option 2 (root-cause + re-enable with regression coverage).
Background
(*sequenceDecs).decodeSyncSimple has had const useSafe = true hardcoded since #644 (2022-07-17), so the...
github.com
July 18, 2026 at 3:23 PM
Fable autonomously found and fixed a 4 year old bug in klauspost/zstd! github.com/klauspost/co...
yes, but by default zstd uses a 64 kib window to construct its dictionaries, and 1 mib frames.
September 24, 2026 at 12:40 AM
yes, but by default zstd uses a 64 kib window to construct its dictionaries, and 1 mib frames.
hey what if we made a ARM926EJ-S running at just over 200MHz do zstd compression. what if we
May 26, 2026 at 6:26 AM
hey what if we made a ARM926EJ-S running at just over 200MHz do zstd compression. what if we
higher compression above zstd-6 is enough but cpu over -6 holding me back from reaching 3k repos/sec exported over gigabit
tyranny of zstd
tyranny of zstd
August 12, 2026 at 4:39 PM
higher compression above zstd-6 is enough but cpu over -6 holding me back from reaching 3k repos/sec exported over gigabit
tyranny of zstd
tyranny of zstd
Zstd 1.5.7 Pushing Compression Performance Even Further - https://www.phoronix.com/news/Zstd-Zstandard-1.5.7
Zstd 1.5.7 Pushing Compression Performance Even Further
Zstandard 1.5.7 was released a short time ago as the newest update to this widely-used compression algorithm backed by Meta. Zstd 1.5.7 packs more than 500 commits, including new performance optimizations and other enhancements...
www.phoronix.com
February 20, 2025 at 5:13 AM
Zstd 1.5.7 Pushing Compression Performance Even Further - https://www.phoronix.com/news/Zstd-Zstandard-1.5.7
okay here's another example of WIS vs INT. for months I've been on the warpath trying to reduce the amount of CPU I spend doing zstd decompression.
turns out, *compression* settings influence decode, and cranking *up* effort/window/frame size can actually give smaller, faster outputs to decompress.
turns out, *compression* settings influence decode, and cranking *up* effort/window/frame size can actually give smaller, faster outputs to decompress.
WIS and INT are not the same thing. no one promised artificial general wisdom, only intelligence ;)
September 24, 2026 at 12:34 AM
okay here's another example of WIS vs INT. for months I've been on the warpath trying to reduce the amount of CPU I spend doing zstd decompression.
turns out, *compression* settings influence decode, and cranking *up* effort/window/frame size can actually give smaller, faster outputs to decompress.
turns out, *compression* settings influence decode, and cranking *up* effort/window/frame size can actually give smaller, faster outputs to decompress.
make that
> compresses just over 2x better than CAR
and
> over 6x smaller than uncompressed CAR
if you go long with zstd-22
> compresses just over 2x better than CAR
and
> over 6x smaller than uncompressed CAR
if you go long with zstd-22
April 30, 2026 at 9:42 PM
make that
> compresses just over 2x better than CAR
and
> over 6x smaller than uncompressed CAR
if you go long with zstd-22
> compresses just over 2x better than CAR
and
> over 6x smaller than uncompressed CAR
if you go long with zstd-22
And Klaus Post's compress module has hooks, docs, and an example for how to produce and consume them with Go's archive/zip!
pkg.go.dev/github.com/k...
pkg.go.dev/github.com/k...
zstd package - github.com/klauspost/compress/zstd - Go Packages
pkg.go.dev
September 9, 2025 at 2:32 PM
And Klaus Post's compress module has hooks, docs, and an example for how to produce and consume them with Go's archive/zip!
pkg.go.dev/github.com/k...
pkg.go.dev/github.com/k...
Steam is working on adding zstd compression for game chunks (every game file is split into 1MB), it currently uses LZMA.
Wonder how much of an overall improvement it will be.
Wonder how much of an overall improvement it will be.
February 17, 2025 at 5:55 PM
Steam is working on adding zstd compression for game chunks (every game file is split into 1MB), it currently uses LZMA.
Wonder how much of an overall improvement it will be.
Wonder how much of an overall improvement it will be.
Linux Kernel's Zstd Code Gets A Co-Maintainer - https://www.phoronix.com/news/Linux-Zstd-Co-Maintainer
Linux Kernel's Zstd Code Gets A Co-Maintainer
Hopefully leading to more timely updates to the Zstd compression code within the Linux kernel is a decision to add on a co-maintainer of the in-kernel Zstandard code...
www.phoronix.com
March 18, 2025 at 1:18 PM
Linux Kernel's Zstd Code Gets A Co-Maintainer - https://www.phoronix.com/news/Linux-Zstd-Co-Maintainer
LibreOffice Begins Landing Zstd Integration - https://www.phoronix.com/news/LibreOffice-Landing-Zstd
LibreOffice Begins Landing Zstd Integration
LibreOffice supports Zip compression for ODT and DOCX files, among other compression uses. There's now work beginning to be merged for supporting Zstandard (Zstd) compression moving forward...
www.phoronix.com
May 1, 2025 at 12:40 PM
LibreOffice Begins Landing Zstd Integration - https://www.phoronix.com/news/LibreOffice-Landing-Zstd
*compresses you with zstd*
March 11, 2026 at 10:15 AM
*compresses you with zstd*
Patches Provide For Much Faster In-Kernel Zstd Due To Embarrassingly Bad Inefficiency - https://www.phoronix.com/news/In-Kernel-Zstd-BMI2-Probing
Patches Provide For Much Faster In-Kernel Zstd Due To Embarrassingly Bad Inefficiency
Patches sent out to the Linux kernel mailing list today can provide much more efficient Zstd compression and decompression by addressing a very unfortunate oversight in the existing code...
www.phoronix.com
August 26, 2026 at 8:03 PM
Patches Provide For Much Faster In-Kernel Zstd Due To Embarrassingly Bad Inefficiency - https://www.phoronix.com/news/In-Kernel-Zstd-BMI2-Probing
New v1.18.4 release of #golang compression library adds zstd compression to gzhttp middleware. Also zstd can now have some options modified on reset. See more at: github.com/klauspost/co...
February 9, 2026 at 8:38 AM
New v1.18.4 release of #golang compression library adds zstd compression to gzhttp middleware. Also zstd can now have some options modified on reset. See more at: github.com/klauspost/co...