#AMDGPUs
ROCm 10.2.0 just dropped new power‑budget tools, letting you push MI300X and Radeon GPUs harder with vLLM, PyTorch and AITER kernels. Curious how multi‑GPU comms get a boost? Dive in! #ROCm1020 #AMDGPUs #vLLM

🔗 aidailypost.com/news/rocm-10...
November 19, 2026 at 1:21 AM
and yes i'm aware it's a Nvidia guide but has anyone closely experimented for AMDGPUs
January 19, 2025 at 5:05 PM
Fixing AMDGPU’s VRAM management for low-end GPUs

It may sound unbelievable to some, but not everyone has a datacenter beast with 128GB of VRAM shoved in their desktop PCs. Around the world people tell the tale...

🔗 https://www.madshrimps.be/news/fixing-amdgpus-vram-management-for-low-end-gpus/
April 11, 2026 at 3:29 AM
An important part of Nvidia's survival is how consistently good their "Magic Tech" is (CUDA, NVENC, RTC) This is something consumers and contractors want

AMDGPUs have done well, but only created competition, they havn't gotten it's "Ryzen" mainstream adoption after 6+ yrs of dominating performance.
October 4, 2025 at 11:04 PM
i mean amdgpu sometimes still amdgpus but it's at worst something like an after 3-5 days thing, compared to windows consistently getting completely nonsensical bugchecks about 30 minutes into sleep every time

fuck microsoft for pushing s0ix bs just after oems finally sorta figured out how to s3
April 30, 2024 at 10:20 PM
Custom Flags for Ollama in Docker Needed with Rocm 6.2?
_I made a post about this before, but lost access to that account due to accidental restart._ _I am trying to run ollama in docker. There is an image ollama/ollama:rocm for amdgpus, but it won't work with my iGPU 780M of AMD Ryzen CPU._ _There's ways around this for the non-docker version using terminal commands. Can this be applied to docker somehow? (I also tried to ask about this on the docker community forum to see if there was a way to apply the commands inside the docker but they seemed a bit condescending, said it had nothing to do with docker, and wouldn't help. I also lost access to my account there due to the restart and now they say I am spam and won't let me create an account due to a "server error." I'm not spam.)_ _I am also not sure if this changed with 6.2 of rocm. Is there any way to apply this guide to the docker version of ollama so that I can use ollama in a docker without it being so slow?_ _This is what I tried in terminal:_ HSA_OVERRIDE_GFX_VERSION="11.0.0" sudo docker run ollama/ollama:rocm [sudo] password for user: Couldn't find '/root/.ollama/id_ed25519'. Generating new private key. Your new public key is: ssh-(key) 2024/10/12 19:08:40 routes.go:1153: INFO server config env="mapCUDA_VISIBLE_DEVICES: GPU_DEVICE_ORDINAL: HIP_VISIBLE_DEVICES: HSA_OVERRIDE_GFX_VERSION: HTTPS_PROXY: HTTP_PROXY: NO_PROXY: OLLAMA_DEBUG:false OLLAMA_FLASH_ATTENTION:false OLLAMA_GPU_OVERHEAD:0 OLLAMA_HOST:http://0.0.0.0:11434 OLLAMA_INTEL_GPU:false OLLAMA_KEEP_ALIVE:5m0s OLLAMA_LLM_LIBRARY: OLLAMA_LOAD_TIMEOUT:5m0s OLLAMA_MAX_LOADED_MODELS:0 OLLAMA_MAX_QUEUE:512 OLLAMA_MODELS:/root/.ollama/models OLLAMA_NOHISTORY:false OLLAMA_NOPRUNE:false OLLAMA_NUM_PARALLEL:0 OLLAMA_ORIGINS:http://localhost https://localhost http://localhost:* https://localhost:* http://127.0.0.1 https://127.0.0.1 http://127.0.0.1:* https://127.0.0.1:* http://0.0.0.0 https://0.0.0.0 [http://0.0.0.0:* [https://0.0.0.0:* app://* file://* tauri://*] OLLAMA_SCHED_SPREAD:false OLLAMA_TMPDIR: ROCR_VISIBLE_DEVICES: http_proxy: https_proxy: no_proxy:]" time=2024-10-12T19:08:40.037Z level=INFO source=images.go:753 msg="total blobs: 0" time=2024-10-12T19:08:40.037Z level=INFO source=images.go:760 msg="total unused blobs removed: 0" time=2024-10-12T19:08:40.037Z level=INFO source=routes.go:1200 msg="Listening on [::]:11434 (version 0.3.12)" time=2024-10-12T19:08:40.038Z level=INFO source=common.go:49 msg="Dynamic LLM libraries" runners="[rocm_v60102 cpu cpu_avx cpu_avx2]" time=2024-10-12T19:08:40.038Z level=INFO source=gpu.go:199 msg="looking for compatible GPUs" time=2024-10-12T19:08:40.039Z level=WARN source=amd_linux.go:60 msg="ollama recommends running the https://www.amd.com/en/support/linux-drivers" error="amdgpu version file missing: /sys/module/amdgpu/version stat /sys/module/amdgpu/version: no such file or directory" time=2024-10-12T19:08:40.039Z level=WARN source=amd_linux.go:202 msg="amdgpu too old gfx000" gpu=0 time=2024-10-12T19:08:40.039Z level=INFO source=amd_linux.go:361 msg="no compatible amdgpu devices detected" time=2024-10-12T19:08:40.039Z level=ERROR source=amd_linux.go:364 msg="amdgpu devices detected but permission problems block access" error="kfd driver not loaded. If running in a container, remember to include '--device /dev/kfd --device /dev/dri'" time=2024-10-12T19:08:40.039Z level=INFO source=gpu.go:347 msg="no compatible GPUs were discovered" _The github information says:_ Ollama could run the iGPU 780M of AMD Ryzen CPU at Linux base on ROCm. There only has a little extra settings than Radeon dGPU like RX7000 series. ## Keys for usage * Ryzen 7000s/8000s CPU with iGPU 780M * amdgpu driver and rocm6.0 * Linux OS is required (Windows and WSL2 are not supported) * BIOS must be set to enable the iGPU and dedicate > 1GB RAM to VRAM * HSA_OVERRIDE_GFX_VERSION="11.0.0" is set (extral setting for AMD iGPU-780M) ## Prerequisites 1. Set UMA for iGPU in BIOS. (at least >1GB, recommend to >8GB for Llama3:8b q4_0 model size is 4.7GB) 2. Install GPU Driver and ROCm Refer to * AMD ROCm™ documentation — ROCm Documentation * AMD ROCm™ Quick start installion 3. Install Ollama _curl -fsSLhttps://ollama.com/install.sh | sh_ ## Steps The iGPU is not detected by Ollama at default. We need extra steps to enable it. 1. Stop the ollama.service sudo systemctl stop ollama.service Then find out the pid of ollama.service by 'ps -elf | grep ollama' and then 'kill -p [pid]' 2. for iGPU 780 w/ ROCm ( not work in WSL, need run in Linux) HSA_OVERRIDE_GFX_VERSION="11.0.0" ollama serve & 3. Run ollama ollama run tinyllama Use rocm-smi to watch the utilization of iGPU When run ollama with ROCm. Another way to replace the step-2 above is to config the ollama.service for iGPU with ROCm as default. sudo systemctl edit ollama.service Add the contents into the /etc/systemd/system/ollama.service.d/override.conf [Service] Environment="HSA_OVERRIDE_GFX_VERSION=11.0.0" Then Reboot the Linux or just restart the ollama.srevice by, sudo systemctl restart ollama.service
community.amd.com
October 12, 2024 at 7:13 PM
The 3 Best Trillion-Dollar Stocks to Buy Now. (Hint: Nvidia Isn’t One of Them.)

There may be changes in the artificial intelligence chip space. NVIDIA (NVDA +1.51%, Artificial Intelligence (AI) is to top the investment hierarchy from 2023. However, there may be a significant change. Until a few…
The 3 Best Trillion-Dollar Stocks to Buy Now. (Hint: Nvidia Isn’t One of Them.)
There may be changes in the artificial intelligence chip space. NVIDIA (NVDA +1.51%, Artificial Intelligence (AI) is to top the investment hierarchy from 2023. However, there may be a significant change. Until a few days ago, it appeared that AI hyperscalers had only a few options to choose from when equipping their data centers with parallel processors. Nvidia's graphics processing units (GPUs) have been the most popular choice by far, and amdGPUs have also captured a share of the market. Another option that the largest data center operators adopted was to partner with…
cnznews.com
December 1, 2025 at 8:45 PM