#deduplication
hope you enjoy seeing that viral post over and over and over and over because deduplication isn't a thing. oh, and being able to tell if something's relatively novel and sharable with low repost counts? also gone. half your timeline will be that meme before you're sick of it
November 19, 2026 at 9:50 PM
they silently removed the deduplication feature from tickets which basically means i need to do a bunch of stupid manual ticket trimming for duplicates aghhh
November 16, 2026 at 10:36 PM
Meta Pixel vs Conversions API: do you need both?

Meta Pixel vs Conversions API: the difference, how event deduplication works and why…

https://ads.adace.website/en/blog/tracking/meta-pixel-vs-conversions-api?utm_source=bluesky&utm_medium=crosspost

#analytics #tracking #webdev
Meta Pixel vs Conversions API: do you need both?
Meta Pixel vs Conversions API: the difference, how event deduplication works and why Meta recommends using both. Includes a comparison table.
ads.adace.website
November 20, 2026 at 9:22 AM
the consolidation and deduplication continues as I resume my quest to find out how much free space I really have
November 15, 2026 at 3:08 PM
Build a replay-safe Cypress Cloud webhook receiver with raw-body HMAC checks, version routing, deduplication, queues, and fast acknowledgments. #cypress
Treat Test Completion as an Event: Replay-Safe Cypress Webhooks
hackernoon.com
November 20, 2026 at 1:43 AM
use malachite for it!

malachite.croft.click has deduplication!
Malachite
Import your music listening history into Teal on ATProto — Last.fm, Spotify, Apple Music, YouTube Music, or ListenBrainz. Free, open-source, runs in your browser.
malachite.croft.click
November 19, 2026 at 12:36 PM
@jacky.wtf proposes "data unions": treat the data clients build around as an AppView-like aggregate. He opened an OpenLibrary PR. Weigh in:
https://www.jacky.wtf/essays/2026/data-union/
https://discourse.atmosphere.community/t/data-synchroncity-deduplication-and-the-case-for-a-union/1475
Data unions are the way forward for the Atmosphere - Jacky Alciné
ATProto allows us to democratize data. Now we need a democracy for the data.
www.jacky.wtf
November 20, 2026 at 8:19 PM
spring transactional outbox handles the tricky bits of reliable event publishing to kafka/rabbitmq by guaranteeing exactly-once delivery across postgres, mysql, and oracle with built-in deduplication and dlq support.

https://dbtools.dev/tools/spring-transactional-outbox

#database #devtools
Spring Transactional Outbox
Spring Boot library implementing the Transactional Outbox pattern for reliable event publishing to Kafka and RabbitMQ across PostgreSQL, MySQL, and Oracle. Features include adaptive polling, per-event configuration, dead letter queue support, and built-in deduplication to ensure
dbtools.dev
November 20, 2026 at 6:00 AM
I'll settle for colo, economies of scale in security, deduplication, and power conditioning
November 17, 2026 at 8:58 PM
Restic dedupes via content-defined chunking (Rabin fingerprint), so only changed blobs hit S3. Forget enforces keep-daily/weekly retention. https://www.valtersit.com/vault/restic-incremental-snapshots-to-s3-with-deduplication-and-re-a99999/
Restic Incremental Snapshots to S3 with Deduplication and Retention Policy
www.valtersit.com
November 18, 2026 at 4:40 AM
Ingesting terabytes of media into your DAM? 📦 Dropzone CLI streams parallel local uploads with edge deduplication and automatic cognitive indexing.

picsha.ai/docs/ingest-pipeline
November 19, 2026 at 4:03 PM
Yeah, that's something I want to look into but I haven't implemented deduplication yet, it makes sense to avoid showing the same vulnerability twice
November 15, 2026 at 4:52 PM
📦 freyr/message-broker v0.14.2

Standalone messaging library: transactional outbox, deduplication, per-transport producers and consumers (AMQP) with retries, DLQ and replay

🔗 https://github.com/freyr/message-broker
November 20, 2026 at 9:59 AM
📦 freyr/message-broker v0.13.2

Standalone messaging library: transactional outbox, deduplication, per-transport producers and consumers (AMQP) with retries, DLQ and replay

🔗 https://github.com/freyr/message-broker
November 20, 2026 at 7:00 AM
Image 3 is 6.2 Astra post-fixes Tibo mentioned. Better? Absolutely. Much more concise. Sadly, it still focuses way too much on second-order problems that are a small % of the cause. "XFS over a compression and deduplication layer on a virtual disk." - so close, but still a miss.
November 18, 2026 at 10:03 AM
📦 freyr/message-broker v0.13.1

Standalone messaging library: transactional outbox, deduplication, per-transport producers and consumers (AMQP) with retries, DLQ and replay

🔗 https://github.com/freyr/message-broker
November 19, 2026 at 11:11 PM
Image 3 is 6.2 Astra post-fixes Tibo mentioned. Better? Absolutely. Much more concise. Sadly, it still focuses way too much on second-order problems that are a small % of the cause. XFS over a compression and deduplication layer on a virtual disk." - so close, but still a miss.
November 18, 2026 at 9:59 AM
📦 freyr/message-broker v0.10.1

Standalone messaging library: transactional outbox, deduplication, per-transport producers and consumers (AMQP) with retries, DLQ and replay

🔗 https://github.com/freyr/message-broker
November 19, 2026 at 12:19 PM
📦 freyr/message-broker v0.12.1

Standalone messaging library: transactional outbox, deduplication, per-transport producers and consumers (AMQP) with retries, DLQ and replay

🔗 https://github.com/freyr/message-broker
November 19, 2026 at 4:00 PM
📦 freyr/message-broker v0.10.0

Standalone messaging library: transactional outbox, deduplication, per-transport producers and consumers (AMQP) with retries, DLQ and replay

🔗 https://github.com/freyr/message-broker
November 19, 2026 at 11:13 AM
Durable Tool Scheduler integration for LangGraph adds scheduling, worker recovery & activity history. When workers crash, another picks up pending tasks without resending requests. ⚠️ At-least-once execution requires deduplication. #LangGraph www.isaacl.dev/hef
LangGraph With Durable Task Scheduler: Durable Tools and Worker Recovery
How Azure Durable Task Scheduler adds durable tool execution and worker recovery to LangGraph agents.
www.isaacl.dev
November 18, 2026 at 11:00 PM
Growing manufacturing data demands efficient storage.

Affordable NAS storage supports better capacity utilization with:

▪ Data Deduplication
▪ Compression
▪ Thin Provisioning
▪ Hybrid Storage

Optimize capacity. Scale with demand.

bit.ly/4fYoxAS

#NASStorage #ManufacturingIT
November 20, 2026 at 4:17 AM
ZAR is a Rust-based archive format with a native Python API that enables fast parallel Zstandard compression, commit history, deduplication, partial restores, and recovery checks.
Save What Matters
Curate Feeds | Make Collections | Customize Email Briefs
briefly.co
November 19, 2026 at 9:32 AM
ZAR is a Rust-based archive format with a native Python API that enables fast parallel Zstandard compression, commit history, deduplication, partial restores, and recovery checks.
Save What Matters
Curate Feeds | Make Collections | Customize Email Briefs
briefly.co
November 19, 2026 at 9:32 AM