#deduplication
they silently removed the deduplication feature from tickets which basically means i need to do a bunch of stupid manual ticket trimming for duplicates aghhh
November 16, 2026 at 10:36 PM
the consolidation and deduplication continues as I resume my quest to find out how much free space I really have
November 15, 2026 at 3:08 PM
I'll settle for colo, economies of scale in security, deduplication, and power conditioning
November 17, 2026 at 8:58 PM
Yeah, that's something I want to look into but I haven't implemented deduplication yet, it makes sense to avoid showing the same vulnerability twice
November 15, 2026 at 4:52 PM
Restic dedupes via content-defined chunking (Rabin fingerprint), so only changed blobs hit S3. Forget enforces keep-daily/weekly retention. https://www.valtersit.com/vault/restic-incremental-snapshots-to-s3-with-deduplication-and-re-a99999/
Restic Incremental Snapshots to S3 with Deduplication and Retention Policy
www.valtersit.com
November 18, 2026 at 4:40 AM
Linux is so fucking funny, man. like, if you run Windows, you never get the chance to say anything like "oh, gimme a sec while I update my CUPS so I can print that document and then run Bees to ensure file deduplication"

I fucking love this OS 😆
November 14, 2026 at 3:58 AM
Image 3 is 6.2 Astra post-fixes Tibo mentioned. Better? Absolutely. Much more concise. Sadly, it still focuses way too much on second-order problems that are a small % of the cause. "XFS over a compression and deduplication layer on a virtual disk." - so close, but still a miss.
November 18, 2026 at 10:03 AM
This is true, but I would argue we can maybe spin this into an argument *for* a European Military: The guns vs. butter problem is already happening with the increased defense spending by member states. Deduplication of effort, unified procurement etc. could save money by comparison.
November 14, 2026 at 1:31 PM
Image 3 is 6.2 Astra post-fixes Tibo mentioned. Better? Absolutely. Much more concise. Sadly, it still focuses way too much on second-order problems that are a small % of the cause. XFS over a compression and deduplication layer on a virtual disk." - so close, but still a miss.
November 18, 2026 at 9:59 AM
CSS Deduplication and File Size: What’s Left After Compression:

Analyzing 1,882 style sheets from 123 sites for the performance impact of automated declaration deduplication, after Gzip and Brotli compression.

meiert.com/blog/css-ded...

#webdev #css #performance #compression #maintainability
CSS Deduplication and File Size: What’s Left After Compression · Jens Oliver Meiert
Analyzing 1,882 style sheets from 123 sites for the performance impact of automated declaration deduplication, after Gzip and Brotli compression.
meiert.com
November 12, 2026 at 6:33 PM
Durable Tool Scheduler integration for LangGraph adds scheduling, worker recovery & activity history. When workers crash, another picks up pending tasks without resending requests. ⚠️ At-least-once execution requires deduplication. #LangGraph www.isaacl.dev/hef
LangGraph With Durable Task Scheduler: Durable Tools and Worker Recovery
How Azure Durable Task Scheduler adds durable tool execution and worker recovery to LangGraph agents.
www.isaacl.dev
November 18, 2026 at 11:00 PM
ZAR is a Rust-based archive format with a native Python API that enables fast parallel Zstandard compression, commit history, deduplication, partial restores, and recovery checks.
Save What Matters
Curate Feeds | Make Collections | Customize Email Briefs
briefly.co
November 19, 2026 at 9:32 AM
ZAR is a Rust-based archive format with a native Python API that enables fast parallel Zstandard compression, commit history, deduplication, partial restores, and recovery checks.
Save What Matters
Curate Feeds | Make Collections | Customize Email Briefs
briefly.co
November 19, 2026 at 9:32 AM
FIFO deduplication won't save you from replay attacks. Learn why idempotency keys in durable storage are essential for rate-limited job queues…

https://dev.to/finnianfox8297/draining-rate-limited-job-pools-fifo-deduplication-and-idempotency-in-5-minutes-2dc5

#SRE #reliability
November 14, 2026 at 9:00 AM
📦 maxkhim/laravel-storage-dedupler 1.0.9

Laravel package for deduplication files in storage and analyze potential disk space savings

🔗 https://github.com/maxkhim/laravel-storage-dedupler
November 15, 2026 at 11:13 PM
Weekly Digest Recovery Using FIFO Queue Webhook Deduplication and Idempotency Keys

🤖 IA: It's not clickbait ✅
👥 Users: It's not clickbait ✅

#queue #webhook #idempotency

👇👇👇
Weekly Digest Recovery Using FIFO Queue Webhook Deduplication and Idempotency Keys
The article discusses a technical approach to handling duplicate delivery of weekly digests using FIFO queues, webhook deduplication, and idempotency keys. It emphasizes the importance of treating duplicate events as traffic filtering rather than correctness issues. The author explains that before sending a digest, the system should atomically claim the event ID in durable storage, acknowledging the message only after the send is recorded. The article provides detailed code examples in Go for implementing this approach, including a consumer-side handler that uses a unique event ID to prevent duplicate sends. The author also compares different queue systems like Infrai, AWS SQS FIFO, Google Cloud Tasks, Cloudflare Queues, and Temporal, highlighting their strengths and limitations for various use cases. The key insight is that FIFO queues reduce noise but durable idempotency determines correctness, especially for weekly digest delivery where duplicate sends can impact customer experience. The article concludes with recommendations for instrumentation, alerting thresholds, and vendor migration strategies, emphasizing that the logical event key and recovery record should be owned by the application rather than the queue provider.
en.killbait.com
November 16, 2026 at 8:45 PM
🚀Blender Tessera 0.04 dev update!

• Full PBR multi-map shading + bake options
• Restored viewport selection outline
• Live RAM/VRAM telemetry & memory guard
• .nc2 (Tessera cache) building & deduplication

more info: www.patreon.com/cebstudios/p...

#b3d #Blender
November 12, 2026 at 7:16 AM
Deduplicating webhooks doesn’t stop an older event from overwriting newer data.

Yananai A. Chiwuta shows how revision-aware updates in PostgreSQL can prevent stale data from being applied.

Read: https://bit.ly/48i4Lh6

#PostgreSQL #DataEngineering #OpenSource
Why Webhook Deduplication Isn't Enough
Let’s say you’re processing events from an API into your CRM. An event comes in and tells you that a particular contact is a Director at a company. So you update the job title on their contact record ...
bit.ly
November 18, 2026 at 3:24 PM
ApiVault Labs (our tool): SEC filing watchlists. First watch seeds a baseline. Keep eventId for deduplication. Metadata and links, not report text.
https://apify.com/apivault_labs/sec-filing-watchlist?utm_source=bluesky&utm_campaign=underused-sec-20261115
November 15, 2026 at 2:04 AM
10,000 one-row INSERTs, each its own commit, one pgbench client:

synchronous_commit = on: 28,101 tps
off: 64,478 tps

Off can lose the last few commits in a crash, but corrupts nothing. This was a MacBook, where fsync is cheap. A server disk may show a bigger gap. I didn't test one.

#PostgreSQL
Thirteen small measurements on PostgreSQL 18
Partial and BRIN indexes, INCLUDE, deduplication, index-only scans before VACUUM, an unindexed foreign key, COPY against INSERT, synchronous_commit, a full-table UPDATE, top-N sorts, work_mem and parallel workers. One run, one laptop, all the numbers.
explainmeasured.com
November 15, 2026 at 12:40 PM
Screenplay Studio — 2026-06-19

'refactor: type safety, deduplication, memory leaks, accessibility across 63 files.' Sixty-three files in one commit. The commit message reads like a confession. Sometimes the best feature is deleting the thing that made your tab use 2GB. 🧹
November 15, 2026 at 9:35 AM
🚨 EUVD-2026-122391
📊 3.3/10
🏢 Microsoft

📝 Improper authorization in Data Deduplication allows an authorized attacker to bypass a security feature locally.

🔗 https://euvd.enisa.europa.eu/vulnerability/EUVD-2026-122391

#cybersecurity #infosec #cve #euvd
November 13, 2026 at 1:01 PM
When the Meta Pixel and the Conversions API both report a purchase, Meta keeps only one if both carry the same event name and event_id. Miss the shared ID and a single sale counts twice, so ROAS reads high. Events Manager shows deduplication per event under its overview.
November 14, 2026 at 12:59 PM
UPDATE every row of a 2M-row table, no indexes:

before: 202.5 MB
after: 404.7 MB
after VACUUM: 404.7 MB
after a second full UPDATE: still 404.7 MB

Every update writes a new row version. VACUUM didn't shrink the file, but the second pass reused the space it freed.

#PostgreSQL
Thirteen small measurements on PostgreSQL 18
Partial and BRIN indexes, INCLUDE, deduplication, index-only scans before VACUUM, an unindexed foreign key, COPY against INSERT, synchronous_commit, a full-table UPDATE, top-N sorts, work_mem and parallel workers. One run, one laptop, all the numbers.
explainmeasured.com
November 18, 2026 at 12:13 PM