#GDN
biggest part: Memory & retrieval are separating

Sliding window — most recent window

Gated DeltaNet — tiny lossy summary equally weighting all tokens

Qwen Sparse Attention — use a tiny “model” to predict what full attention would’ve done
November 16, 2026 at 3:09 AM
I got caught by 12 my homie was recording me n i wasn't paying attention so I got a ticket fuck them pigs on GDN 🔱
November 18, 2026 at 7:49 AM
It makes Christmas feel so much more special when it's available for >15% of the year, & shops (in London, at least) kick off Xmas the nanosecond Halloween is over. On Saturday a band was belting out A Fairytale of NY in a Cov Gdn pub. In the actual US Thanksgiving acts as a kind of seasonal groyne.
It's mid-November & we've already counted more than FIFTY Xmas sandwiches. We've picked out the show-stoppers, but have also put everything onto a map & spreadsheet so you can filter by preference & area... www.allthefood.ie/single-post/where-to-get-a-christmas-sandwich-in-dublin-the-best-of-2026
November 17, 2026 at 11:29 PM
Chuffed to have won national investigation of the year in the Media Freedom Awards for stories about Peter Mandelson failing his vetting and the FCDO overruling the decision. Big team effort w/ Gdn head of investigations Paul Lewis and ace pol ed @pippacrerar.bsky.social - and thanks to our sources.
Winners announced for Media Freedom Awards 2026 – Society of Editors
Society of Editors. Protecting the freedom of the news media
www.societyofeditors.org
November 11, 2026 at 11:19 PM
📍 🤦‍♀️ AzureFang stole from 🦸‍♂️AzureHerald
#11534 — 2 EDGAR ST CNR WAKEFIELD GDN, AINSLIE, ACT
2026-11-17T06:02:19Z

Cold blooded theft by 🤦‍♀️ AzureFang!

Make sure to check out payphonetag.com and join in on the fun! #PayphoneTag #Australia
November 17, 2026 at 6:21 AM
For anyone who likes wasting time and fine-tuning their 'it's hideous' vs 'I like it?' aesthetic needle: an auction of items from a London boutique hotel. 4394 items, to be exact.

proauction.atgportals.net/auctions/982...
November 16, 2026 at 4:22 PM
Stiff easterly, cold, grey - lots of promise! More than 200 Redwings departed the Obs gdn at dawn, looks to be quite a few new CCs & Gcrests; SEOwl at the Bill Quarry.
November 9, 2026 at 8:10 AM
2 Million People Israel Bombed Out of Their Homes Don't Have Access to Basic Supplies Due to Ongoing Siege. The World Must Act. #SGE decoder.survivorsguidetoearth.com/card/gdn-202...
The Guardian, decoded | The Propaganda Decoder
2 Million People Israel Bombed Out of Their Homes Don't Have Access to Basic Supplies Due to Ongoing Siege. The World Must Act.
decoder.survivorsguidetoearth.com
November 16, 2026 at 11:46 AM
Bout to light this candle
Light this J
Turn all the lights out
Get under these covers
Let the RnB Spotify list slap
And listen to this rain beat on the window
Gdn People's ✊🏾✊🏾✊🏾
November 13, 2026 at 2:10 AM
📍 🌝 LunarWarden stole from 🥹PlasmaTracker
#11534 — 2 EDGAR ST CNR WAKEFIELD GDN, AINSLIE, ACT
2026-11-12T12:33:27Z

🥹PlasmaTracker just got robbed!

Make sure to check out payphonetag.com and join in on the fun! #PayphoneTag #Australia
November 12, 2026 at 1:13 PM
2 Million People Israel Bombed Out of Their Homes Don't Have Access to Basic Supplies Due to Ongoing Siege. The World Must Act. #SGE decoder.survivorsguidetoearth.com/card/gdn-202...
The Guardian, decoded | The Propaganda Decoder
2 Million People Israel Bombed Out of Their Homes Don't Have Access to Basic Supplies Due to Ongoing Siege. The World Must Act.
decoder.survivorsguidetoearth.com
November 13, 2026 at 1:48 PM
📍 🥹 PlasmaTracker stole from 🤦‍♀️AzureFang
#11534 — 2 EDGAR ST CNR WAKEFIELD GDN, AINSLIE, ACT
2026-11-11T05:33:01Z

🚨 ON FIRE! 🥹 PlasmaTracker is on a rampage with 5 steals in the last 2 hours!

Make sure to check out payphonetag.com and join in on the fun! #PayphoneTag #Australia
November 11, 2026 at 5:48 AM
📍 🤦‍♀️ AzureFang stole from 🌝LunarWarden
#11534 — 2 EDGAR ST CNR WAKEFIELD GDN, AINSLIE, ACT
2026-11-10T19:14:58Z

🚨 ON FIRE! 🤦‍♀️ AzureFang is on a rampage with 5 steals in the last 2 hours!

Make sure to check out payphonetag.com and join in on the fun! #PayphoneTag #Australia
November 10, 2026 at 7:50 PM
I had to go through 3 sets of biometric gates at GdN last month. Faaaackkin ridiculous 🤬
I'd cheerfully dropkick every Brexiteer off the White Cliffs, starting with Niggle Dommage.
November 7, 2026 at 8:39 AM
Softmaxアテンションの一部 → 線形アテンション が増えてるが 量子化は難しい
↓↓↓
線形アテンションの再帰状態を学習不要で8bit量子化する手法
➀窓ごとに一度だけ量子化して誤差蓄積を抑える
②外れ値を補償トークンとして保持した後、残りの成分を平滑化してから量子化
arxiv.org/abs/2609.38166
LeapQuant: Efficient Linear Attention with Accurate Recurrent State Quantization
Recent LLMs increasingly adopt hybrid designs that replace standard attention with linear attention, such as Gated DeltaNet (GDN) and Kimi Delta Attention (KDA). Although they compress the context int...
arxiv.org
November 12, 2026 at 6:53 AM
17/11 on 6th Nov for final GMS of the season, nfy Mottled Umber*.

Also D/back, 3 Lge Wainscot, 3 LBAM, 2 Red-green carpets*, D/S Pug, Feathered Thorn*, 2 Nov moths, Y/L Quaker, Gdn Mompha & Oak Rustic*.

#teammoth #norfolkmoths
November 7, 2026 at 2:16 PM
Empty model card, no benchmarks, an 8K window on a long-context pitch. Yet an Apache-2.0 Llama hybrid mixing MLA and GDN layers, SFT-tuned and Ascend-native, is a rare find. Hard to see an infra lead picking this over Qwen3-Next until a benchmark or a chat template ships.
Hybrid Attention on Ascend: Meet the HyLo-Llama
Modelers.cn has quietly dropped a fascinating new checkpoint in its ecosystem. If you're looking to push the boundaries of efficiency rather than just raw parameter size, the…
aichina.news
November 9, 2026 at 4:26 PM
The card is bare — no evals, no parameter count, no dataset notes. Still, 4 MLA layers interleaved with 12 GDN ones, Apache-2.0, is a proper hybrid-attention experiment in the Qwen3-Next mould. Hard to see it beating full attention in production until throughput numbers land.
Hybrid Attention Breakthrough: A New Experimental Llama Variant Hits Modelers.cn
The Huawei Ascend AI ecosystem continues to expand with the release of amd/HyLo-Llama-4MLA12GDN-8K-SFT via Modelers.cn. This is an intriguing, open-licensed model that represents a departure from the…
aichina.news
November 9, 2026 at 3:28 PM
No benchmarks, no parameter count, no NPU guidance — the card is bare. Still, the name implies six MLA layers bolted onto twenty-two GDN ones, a Llama-derived hybrid under Apache-2.0. Hard to see it running on stock Llama tooling until someone ships the kernels.
HyLo-Llama Lands on Modelers.cn: 64K Context, Apache-2.0, and a Sparse but Tempting Hybrid
Modelers.cn — the Huawei/Ascend AI ecosystem platform — has added amd/HyLo-Llama-6MLA22GDN-64K-SFT, a text-generation model that is likely to intrigue developers who keep an eye on long-context…
aichina.news
November 9, 2026 at 2:32 PM
📍 🌝 LunarWarden stole from 🤦‍♀️AzureFang
#11534 — 2 EDGAR ST CNR WAKEFIELD GDN, AINSLIE, ACT
2026-11-07T02:54:06Z

Unlucky 🤦‍♀️AzureFang, get 'em back!

Make sure to check out payphonetag.com and join in on the fun! #PayphoneTag #Australia
November 7, 2026 at 3:10 AM