MORE: DOJ says the batch of 1 million documents it recently unearthed appear to be largely duplicative "but nonetheless still need to undergo a process of processing and deduplication." storage.courtlistener.com/recap/gov.us...
January 6, 2026 at 3:18 AM
MORE: DOJ says the batch of 1 million documents it recently unearthed appear to be largely duplicative "but nonetheless still need to undergo a process of processing and deduplication." storage.courtlistener.com/recap/gov.us...
SemHash - fast semantic deduplication tool. minishlab.github.io/semhash-blog...
semhash: deduplication and dataset multitool
We’re super excited to announce the release of semhash, our semantic deduplication and dataset multitool (other features coming soon).
minishlab.github.io
January 16, 2025 at 7:21 AM
SemHash - fast semantic deduplication tool. minishlab.github.io/semhash-blog...
lexical atom bank partial deduplication
at long last we have created Seinfeldvision from the classic 30 Rock episode “please do not create Seinfeldvision, it’s creepy”
incredible progress in the field of AI
September 23, 2026 at 9:21 AM
lexical atom bank partial deduplication
Lexical Atom Bank Deduplication
BECOME UNCOOKABLE
September 26, 2026 at 5:53 PM
Lexical Atom Bank Deduplication
Lexical Atom Bank Deduplication
You're not gonna believe this
September 24, 2026 at 5:41 AM
Lexical Atom Bank Deduplication
Lexical Atom Bank Deduplication
what else is like this
Only the liker gets immortalised
September 26, 2026 at 2:42 PM
Lexical Atom Bank Deduplication
Kopia is a Cross-platform open source backup tool for Windows, macOS & Linux with fast, incremental backups, client-side end-to-end encryption, compression and data deduplication. CLI and GUI included for backups and restore.
github.com/kopia/kopia
github.com/kopia/kopia
GitHub - kopia/kopia: Cross-platform backup tool for Windows, macOS & Linux with fast, incremental backups, client-side end-to-end encryption, compression and data deduplication. CLI and GUI included.
Cross-platform backup tool for Windows, macOS & Linux with fast, incremental backups, client-side end-to-end encryption, compression and data deduplication. CLI and GUI included. - kopia/kopia
github.com
July 30, 2025 at 4:14 AM
Kopia is a Cross-platform open source backup tool for Windows, macOS & Linux with fast, incremental backups, client-side end-to-end encryption, compression and data deduplication. CLI and GUI included for backups and restore.
github.com/kopia/kopia
github.com/kopia/kopia
lexical atom bank partial deduplication
i’m getting evaluated for signs of DID: Damn Impressive Dick
September 26, 2026 at 7:10 AM
lexical atom bank partial deduplication
Helldivers 2 shaving ~130 GB off the PC install simply through deduplication and better asset management made me lol for days
December 25, 2025 at 9:10 AM
Helldivers 2 shaving ~130 GB off the PC install simply through deduplication and better asset management made me lol for days
Lexical Atom Bank Deduplication
September 24, 2026 at 6:10 PM
Lexical Atom Bank Deduplication
Added the label a while ago because I'd forget about the deduplication and compression and think I was missing data.
December 13, 2025 at 3:13 AM
Added the label a while ago because I'd forget about the deduplication and compression and think I was missing data.
fuzzy lexical molecule deduplication when
September 23, 2026 at 5:25 PM
fuzzy lexical molecule deduplication when
Lexical Atom Bank Deduplication
what else is like this
tried to trap a stray cat at my work today but the trap didn’t go off so the cat just thinks we gave it a free home
September 27, 2026 at 2:33 AM
Lexical Atom Bank Deduplication
Lexical Atom Bank Deduplication
what else is like this
tried to trap a stray cat at my work today but the trap didn’t go off so the cat just thinks we gave it a free home
September 26, 2026 at 5:36 PM
Lexical Atom Bank Deduplication
Lexical Atom Bank Deduplication
September 26, 2026 at 2:42 PM
Lexical Atom Bank Deduplication
..... that is not what deduplication is
February 9, 2025 at 11:10 PM
..... that is not what deduplication is
Elon was taught the term deduplication in the past 72 hours, and now he's making it everyone's problem.
February 11, 2025 at 2:00 AM
Elon was taught the term deduplication in the past 72 hours, and now he's making it everyone's problem.
Lexical Atom Bank Deduplication
some will say this is AI
September 25, 2026 at 9:13 PM
Lexical Atom Bank Deduplication
Lexical Atom Bank Deduplication
September 25, 2026 at 2:58 AM
Lexical Atom Bank Deduplication
Lexical Atom Bank Deduplication
September 24, 2026 at 6:03 PM
Lexical Atom Bank Deduplication
Lexical Atom Bank Deduplication
September 11, 2026 at 1:52 PM
Lexical Atom Bank Deduplication
Oh look, someone taught Elmo what deduplication is and now he's a database expert.
February 9, 2025 at 4:01 PM
Oh look, someone taught Elmo what deduplication is and now he's a database expert.
Lexical Atom Bank Deduplication
what else is like this
mixture of experts? that’s cool but I’m more into mixture of dilettantes
September 23, 2026 at 9:36 PM
Lexical Atom Bank Deduplication
Lexical Atom Bank Deduplication
you can prompt you favorite model to do this, just feed them some of that philosopher's work
September 26, 2026 at 7:13 PM
Lexical Atom Bank Deduplication
Lexical Atom Bank Deduplication
September 27, 2026 at 2:59 AM
Lexical Atom Bank Deduplication