#RDNA3
Radeon 780M 上的 llama.cpp 後端效能分析:rdna-boosts vs Vulkan vs PolyStrata
https://lemmy.mistyreverie.org/post/47059
ROCm針對消費級硬體幾乎沒有最佳化,更不用說APU了,幾乎都得靠開源社群來改善。
Radeon 780M 上的 llama.cpp 後端效能分析:rdna-boosts vs Vulkan vs PolyStrata
使用 Claude 進行測試與撰寫分析 ## 摘要 在 Radeon 780M(gfx1103)上跑 gemma-4-26B-A4B,rdna-boosts(ROCm)的 prefill 最快:比 b12343 Vulkan 快 5% 到 13%,比 PolyStrata 快 29% 到 45%,prompt 越長差距越大。 Decode 三者幾乎一樣,都在 31 t/s(短對話)和 25 t/s(15K context)上下,因為瓶頸是記憶體頻寬,不是後端。 rdna-boosts 的 README 沒有列出 gfx1103,但這次實測可以編譯和執行,輸出正常。 ## 測試環境 三個後端都在同一台機器、同一個模型檔上測。GMKtec NucBox K8 Plus 項目 | 內容 ---|--- CPU / GPU | AMD Ryzen 7 8845HS(8 核 16 線程),內顯 Radeon 780M(gfx1103,RDNA3) 記憶體 | 53 GiB,內顯與 CPU 共用 系統 | Linux 7.0.0-43-generic 功耗 | ryzenadj 預設 54W、溫度上限 93°C;另有一輪 25W / 80°C 對照 模型 | gemma-4-26B-A4B-it-qat-UD-Q4_K_XL.gguf(13.26 GiB,MoE,約 4B 活躍參數) rdna-boosts | llama.cpp a691b2345 + 17 個 patch(v17-a691b2345-r271),ROCm 7.16,`GPU_TARGETS=gfx1103`、`GGML_HIP_RCCL=OFF` Vulkan | 上游預編譯版 llama-b12343,Mesa RADV(PHOENIX) PolyStrata | 0.1.45(commit e4ea22a3),hip 後端,搭配 MTP draft 模型 ## 測試方法 rdna-boosts 和 Vulkan 用同一組 `llama-bench` 參數測;PolyStrata 的數字取自它自己的 benchmark 報告。 * **llama-bench** :`-ngl 99 -fa 1 -p 4096,16384,32768 -n 128 -r 2`,另加 `-p 0 -n 64 -d 15000` 測 15K context 下的 decode。只計引擎本身的時間。 * **PolyStrata** :`tools/strata_bench.py --long` 透過 HTTP 測一個執行中的 server,每項 3 次取中位數。報告在 `~/PolyStrata/bench/results/2026-11-13-community-unknown-gemma-4-26b-a4b-qat-ud-q4-k-xl`。 * **溫度監控** :每 2 秒讀 k10temp,超過 90°C 就中止測試。實際最高溫度:rdna-boosts 76°C、Vulkan 81°C,都沒有被中斷。 * **對應關係** :PolyStrata 的「4K/16K/32K prompt, fresh」對應 `pp4096/16384/32768`;「短對話 decode」對應 `tg128`;「agent session decode」(最後一輪約 15K tokens)對應 `tg64 @ d15000`。 ## 結果 三個長度下 rdna-boosts 的 prefill 都最快,32K 時比 Vulkan 快 13%、比 PolyStrata 快 45%。 Decode 三者幾乎一樣(單位 t/s): 測試 | rdna-boosts(ROCm) | b12343 Vulkan | PolyStrata(HIP,含 MTP) ---|---|---|--- 短對話 decode(`tg128`) | 30.9 | 31.1 | 28.4(範圍 25.5–35.9) 約 15K context 時的 decode(`tg64 @ d15000`) | 24.6 | 24.8 | 24.5 ## 分析 ### Prefill:prompt 越長,rdna-boosts 領先越多 從 4K 到 32K,rdna-boosts 的 prefill 速度下降 31%,Vulkan 下降 36%,PolyStrata 下降 38%。rdna-boosts 對長 context 的衰減最小,所以領先幅度從 4K 的 5% 拉大到 32K 的 13%(對 Vulkan)。 prompt 越長,attention 佔 prefill 的比例越高。rdna-boosts 有一部分 patch 就是針對 RDNA 的 flash-attention(WMMA、BF16 KV),這和「長 prompt 差距較大」的現象一致。不過這次沒有逐個關掉 patch 測試,無法確定是哪個改動貢獻最多。 ### Decode:瓶頸在記憶體頻寬 三個後端的 decode 差距都在 2% 以內,PolyStrata 的短對話例外(見限制)。每產生一個 token,都要從記憶體讀一次活躍的權重和 KV cache;內顯和 CPU 共用同一組 DDR5,讀取速度就是上限,後端再怎麼優化也突破不了。 要讓 decode 更快,得減少每個 token 要讀的量,或一次產生多個 token(如 MTP 推測解碼),而不是換後端。 ### 功耗:影響 prefill,不影響 decode rdna-boosts 在 25W 和 54W 各測一次:4K prefill 從 470.5 升到 571.4 t/s(+21%),decode 從 29.5 升到 30.9 t/s(+5%)。內顯和 CPU 共用同一個功耗上限,prefill 是算力密集,所以對功耗敏感。 54W 下測試溫度最高 76–81°C,沒有碰到晶片的 93°C 上限;但用 `-j4` 編譯 rdna-boosts 會超過 90°C。 ## 限制與未測項目 * **測量方式不同** :PolyStrata 透過 HTTP 測 server,包含排程與傳輸開銷;`llama-bench` 只算引擎時間。PolyStrata 落後的幅度裡,有一部分可能來自這個差異,無法從現有數據拆開。 * **MTP 只有 PolyStrata 開了** :它的短對話 decode 中位數 28.4 t/s、範圍 25.5–35.9,隨 draft 命中率變動。rdna-boosts 和 Vulkan 都沒開 MTP。rdna-boosts 支援 MTP decode,但這次沒測。 * **只測一個模型** :結果只代表 gemma-4-26B-A4B(MoE)。dense 模型或其他量化格式可能不同。 * **PolyStrata 的功耗設定沒有記錄** :它的報告寫「power limits: not recorded」。依時間推斷是在 54W 下測的,但沒有證實。 * **沒有正確性比對** :這次只確認 rdna-boosts 在 Qwen3.5-4B 上的輸出合理,沒有跟其他後端比較 perplexity 或同 seed 輸出。 * **Vulkan 版本較新** :b12343 比 rdna-boosts 的 fork point(a691b2345,約等於 b12205)晚約 138 個 commit,兩者的上游程式碼不完全相同,差距不全是 patch 造成的。 ## 結論與建議 常處理長 prompt 就用 rdna-boosts;一般聊天用 Vulkan 就夠,省去編譯和 ROCm。 使用情境 | 建議 | 理由 ---|---|--- Agent、讀長文件(16K 以上 prompt) | rdna-boosts | 32K prefill 比 Vulkan 快 13%,一次 32K prompt 少等約 11 秒 一般聊天 | Vulkan(b12343) | decode 一樣快,只要裝 `libvulkan1` 和 `mesa-vulkan-drivers` 想要 decode 更快 | 先測 MTP | 換後端幾乎沒有幫助,只有推測解碼有機會 ### 在 gfx1103 上編譯 rdna-boosts 的注意事項 * gfx1103 不在 README 的支援列表,但 patch 的 RDNA3 判斷有包含 `__gfx1103__`,可以直接用 `-DGPU_TARGETS=gfx1103` 編譯。 * 單卡不需要 RCCL,設 `-DGGML_HIP_RCCL=OFF`。 * 編譯時 CPU 會過熱:先用 ryzenadj 把功耗降到 25W、溫度上限 80°C,再用 `-j4`,最高溫度 79°C。編完記得調回 54W。 ### 下一步 * [ ] 用 `llama-server` + MTP draft 模型,跑同一套 `strata_bench.py`,讓三方的測法完全一致 * [ ] 用相同 fork point 編一份沒有 patch 的 ROCm 版,分出 patch 本身的貢獻
lemmy.mistyreverie.org
November 13, 2026 at 6:04 AM
Poking around a pair of old/new RDNA3 vbios to see if I can't figure out what AMD-SN-6023 fixes ahead of time. There's a new UEFI graphics driver & display controller firmware (that pads the last 4kb with 0's), some seemingly unrelated memory timing updates (both sk & hynix) and power mgmt changes
November 6, 2026 at 6:36 AM
There are still affordable deals available if you consider going the RAM route and not GPU. Here's 48GB RAM for ~$700 USD, perfect for a headless Ollama server.

www.gmktec.com/products/amd...
GMKtec NucBox M6 Ultra Mini PC AMD Ryzen™ 5 7640HS - GMKtec
GMKtec NucBox M6 Ultra Mini PC powered by AMD Ryzen™ 5 7640HS processor (6 cores / 12 threads, up to 5.0GHz) with Radeon™ 760M RDNA3 graphics. Supports DDR5 memory up to 128GB and dual PCIe 4.0 NVMe S...
www.gmktec.com
November 2, 2026 at 2:06 PM
NEW VIDEO

FSR4 INT8 Lite has finally arrived to the XBOX ALLY X!

QSSR (FP16) Comes to PS5!

FSR4 INT8 (Full Fat) is available to RDNA3+ GPUs

What is up with all of these FSR4 implementations? Here's a quick 13 minute explainer video below:

youtu.be/gpeyIXm1B1I
October 26, 2026 at 1:02 PM
new psu in, looks like its been stable so far! guessing rdna3 power fluctuations ended up doing my old PSU in.
October 24, 2026 at 10:48 AM
간략화 버전:
RX6000(RDNA3)과 스트릭스/고르곤 헤일로(RDNA35)에 정식 적용.

PS5(RDNA2)는 옛날에 적용되었고, MS가 이에 질세라 “우리도 이제부터 적용하겠다!!”며 내뱉음.

그 여파로 ASUS의 XBOX ROG Ally, Ally X에도. FSR이 적용되었는데, Ally X는 ryzen Z2E=890M이라 890M은 받았고, ROG Ally는 Z2 A인데 이건. RDNA2 8CU라는 기함할 스펙이지만 역시 받았음.

RDNA2 8CU를 가진 또다른 기기는 바로 스팀덱. 또팀덱 또 부활!할지도 모름,
October 21, 2026 at 12:14 PM
'big rdna3' has random power regressions and other driver bugs all the time (latest seemingly crashes with video decode??), maybe forcing a minimum power state or alternately capping it out + trying a variety of older drivers may help
October 21, 2026 at 5:44 PM
I cannot be arsed to put that version back even with the FSR4 RDNA3 APU announcement. This is your only warning. Do NOT ask
reposting this because AMD= Asinine Marketing Department

as an ROG Ally user and literally this drawing was done there even with the fact that it's a literal B580, go fuck yourself

#intelarc #amphibia #anneboonchuy
October 20, 2026 at 10:09 PM
nope. boots but hard resets the machine under sustained load.
on 2 separate motherboards it fails to POST if it's in the primary pcie slot. but this might also just be a known x299-rdna3 platform incompatibility.
just want to 2 use it at all. ruled out power delivery. maybe bad ram, bad cpu or mobo?
Oh my god it boots I think it really was just the PSU this whole time like a loose PCIe power cable or something
The box I was using this GPU on is still very unstable and I am now suspecting a PSU fault, which might mean there is hope for the GPU yet. But, debugging all this is a massive pain in the ass, and even if PSU is root cause it might have shorted the GPU and killed it regardless. 😭
October 18, 2026 at 1:17 PM
New in TinyBVH 1.9.1, dev branch:
github.com/jbikker/tiny...
Initial RDNA3/4 hardware ray tracing support!
By Alessandro Salo, Utrecht University. The OpenCL kernel uses intrinsics for ray/tri & ray/aabb intersection, as well as stack management. For primary rays it matches native DXR performance.
GitHub - jbikker/tinybvh: Header-only dependency-free BVH construction and traversal library.
Header-only dependency-free BVH construction and traversal library. - jbikker/tinybvh
github.com
October 7, 2026 at 6:18 AM
i wonder if the work to get fsr4 officially supported on rdna3/2 helped make pssr on base ps5 possible as well
First PSSR came to PS5 Pro. Now Quick Spectral Super Resolution (QSSR) is coming to PS5.

Details on new upscaling tech, coming first to Marvel’s Wolverine and Ghost of Yōtei: play.st/4hjL9yo
October 1, 2026 at 4:24 PM
Basically confirmed since PS5 Pro runs on a custom RDNA3 and they ported fsr4.1 months later to that same gpu line
October 1, 2026 at 4:54 PM
Recordatorio de que Moore ha muerto.
Vega: 14nm
RDNA1: 7nm
RDNA2: 6nm
RDNA3: 5nm
RDNA4: 4nm
Va en parte por el decir de que todo lo que están comprando los centros de datos va a quedar obsoleto en 1/2 años. No. Están instalando 2nm. Sólo queda arquitectura, empaquetado, e interconectividad.
October 1, 2026 at 8:51 AM
Modder runs official NVIDIA DLSS on Navi 32 Radeon RX 7000 GPUs using ZLUDA
Modder runs official NVIDIA DLSS on Navi 32 Radeon RX 7000 GPUs using ZLUDA - VideoCardz.com
A new d4r project runs NVIDIA's official DLSS Super Resolution library on AMD RDNA3 GPUs through ZLUDA. Navi 32 cards get custom RDNA3 kernels for DLSS 4 and DLSS 4.5, while DLSS 5 Neural Rendering is not supported.
videocardz.com
September 28, 2026 at 7:55 PM
Mfw RDNA4 más lento que RDNA3 en VR porque no hay gama alta.
September 25, 2026 at 6:52 PM
📰 Reddit r/LocalLLaMA
vulkan: int8 coopmat1 matmul implementation for AMD RDNA3 and RDNA4 (… · ggml-org/llama.cpp@70c4e15

https://www.reddit.com/r/LocalLLaMA/comments/1wp1vex/vulkan_int8_coopmat1_matmul_implementatio
n_#IA/#AII#MLAI #ML
September 24, 2026 at 7:01 PM
"RDNA3 is gonna be great, guys! NV should be worried."

*RDNA3 isn't great, at all*

"Oh, turns out RDNA3 was bugged. RDNA4 will correct that. But RDNA5 will be great, guys!"
September 16, 2026 at 6:03 PM
Optiscaler is actually neat as fuck because even though I'm on RDNA3 and I "have" FSR4.1 there's A LOT of games that are still HARD LOCKED to FSR3 which is just fucking abysmal and so fucking bad...
September 12, 2026 at 7:23 AM
Sixunited Unveils AMD Ryzen AI Max+ Laptop Design

#AMD #Zen5 #RDNA3
Sixunited Unveils AMD Ryzen AI Max+ Laptop Design
The AXN88B-160M-YD reference design features the Ryzen AI Max+ Pro 495 processor, 120W TDP, and support for up to 192GB of LPDDR5X memory.
hardwarebrief.com
September 11, 2026 at 4:04 PM
While nVidia didn't support it on desktop until 2025 with 50xx series, AMD RDNA3 did in 2022. Perfectly possible that Nintendo requested it for their custom chip, since it's not just Ampere stuff under the hood.
September 10, 2026 at 5:37 AM
danielblnc/DLSS-NR-on-AMD — AMD GPUでのDLSS 5動作を実現!

・ラッパーでなくHIPカーネルを用いて推論ランタイムを独自再実装
・RDNA3/4(RX 7000/9000シリーズ)でDLSS 5 Neural Renderingが動作
・低レイヤーのGPGPU最適化を学びたいグラフィックスエンジニア必見の注目OSS

#GPGPU #AMD
DLSS-NR-on-AMD
Run DLSS 5 Neural Rendering on your AMD GPU. Magic!
github.com
September 8, 2026 at 1:35 AM
PC PORTABLES AMD RYZEN OU VEGA GPU INTEGRE RDNA3 OU RDNA5 64GB DDR5, UTILISABLES COMME TELEPHONES 5G AVEC LECTEUR DE CARTES BEUES ET CARTES VITALES: LE COMPUTAPLEX 2028.AD
September 5, 2026 at 8:43 PM
@scmp.com PC PORTABLES AMD RYZEN OU VEGA GPU INTEGRE RDNA3 OU RDNA5 64GB DDR5, UTILISABLES COMME TELEPHONES 5G AVEC LECTEUR DE CARTES BEUES ET CARTES VITALES: LE COMPUTAPLEX 2028.AD
September 5, 2026 at 9:01 PM
@ilo.org PC PORTABLES AMD RYZEN OU VEGA GPU INTEGRE RDNA3 OU RDNA5 64GB DDR5, UTILISABLES COMME TELEPHONES 5G AVEC LECTEUR DE CARTES BEUES ET CARTES VITALES: LE COMPUTAPLEX 2028.AD
www.cdiscount.com/informatique...
September 5, 2026 at 9:04 PM
PC PORTABLES AMD RYZEN OU VEGA GPU INTEGRE RDNA3 OU RDNA5 64GB DDR5, UTILISABLES COME TELEPHONES 5G AVEC LECTEUR DE CARTES BEUES ET CARTES VITALES: LE COMPUTAPLEX 2028.AD
www.cdiscount.com/informatique...
Cdiscount.com
Cdiscount : Meuble, Déco, High Tech, Bricolage, Jardin, Sport | Livraison gratuite à partir de 10€ | Paiement sécurisé | 4x possible | Retour simple et rapide | E-commerçant français, des produits et ...
www.cdiscount.com
September 5, 2026 at 8:42 PM