Fuse PyTorch ops into single tiled kernels kept in registers for peak performance. See examples, docs, and code:
https://bit.ly/3VigiKf
Fuse PyTorch ops into single tiled kernels kept in registers for peak performance. See examples, docs, and code:
https://bit.ly/3VigiKf
Some example Rust kernels, including a flash-attn2 port to Rust and cuda-oxide:
github.com/huggingface/...
#rust #cuda #gpu #kernels
⭐ 3,867 (+32)
🗒 Rust
NVIDIA's CUDA platform for Rust. Host runtime crates plus Tile (cutile-rs) and SIMT (cuda-oxide) kernel programming models in idiomatic Rust.
핵심 요약
• Jane Street와 NVIDIA 엔지니어들이 NVIDIA 기술 블로그 글에서 Mamba-2 순전파를 cuTile Python 커널 3개(chunk_cumsum, fwd_pass_state, compute_out)로 구현한 과정을 수식과 코드로 설명했습니다.
• NVIDIA B300 GPU 1장에서 mamba_ssm의 Triton 커널과 비교했을 때 1.14~1.82배 빨랐고, 상…
핵심 요약
• Jane Street와 NVIDIA 엔지니어들이 NVIDIA 기술 블로그 글에서 Mamba-2 순전파를 cuTile Python 커널 3개(chunk_cumsum, fwd_pass_state, compute_out)로 구현한 과정을 수식과 코드로 설명했습니다.
• NVIDIA B300 GPU 1장에서 mamba_ssm의 Triton 커널과 비교했을 때 1.14~1.82배 빨랐고, 상…
🚀 Preview:
projects.localizethedocs.org/cutile-rs-bo...
🌐 Crowdin:
localizethedocs.crowdin.com/cutile-rs-bo...
🐙 GitHub:
github.com/localizethed...
#Crowdin #GitHub #Sphinx #Rust #GPU #CUDA #NVIDIA
🚀 Preview:
projects.localizethedocs.org/cutile-rs-bo...
🌐 Crowdin:
localizethedocs.crowdin.com/cutile-rs-bo...
🐙 GitHub:
github.com/localizethed...
#Crowdin #GitHub #Sphinx #Rust #GPU #CUDA #NVIDIA
🔗 aidailypost.com/news/nvidia-...
🔗 aidailypost.com/news/nvidia-...
NVIDIAのCUDA Tile(cuTile)を活用してMamba-2のフォワードパスを高速化するカスタムカーネルの実装手法と最適化を解説。
#CUDA #Mamba-2 #GPU #DeepLearning #NVIDIA
NVIDIAのCUDA Tile(cuTile)を活用してMamba-2のフォワードパスを高速化するカスタムカーネルの実装手法と最適化を解説。
#CUDA #Mamba-2 #GPU #DeepLearning #NVIDIA
👉 eurorust.eu/talks/fearle...
#RustLang
👉 eurorust.eu/talks/fearle...
#RustLang
Compile Rust directly to PTX with cuda-oxide & cutile-rs. No more runtime data races! But heavy compilation demands true bare-metal power.
Read the deep dive on CUDA Rust & GPU servers:👇
www.migservers.com/blogs/nvidia...
#NVIDIA #CUDA #AI
Compile Rust directly to PTX with cuda-oxide & cutile-rs. No more runtime data races! But heavy compilation demands true bare-metal power.
Read the deep dive on CUDA Rust & GPU servers:👇
www.migservers.com/blogs/nvidia...
#NVIDIA #CUDA #AI
We want the talk from whoever has run one against real work. CFP closes 31 October.
cfp.rustnationuk.com
#RustLang #Rust
We want the talk from whoever has run one against real work. CFP closes 31 October.
cfp.rustnationuk.com
#RustLang #Rust
Two Sanderlings and a Red Knot (I think) borbing on the beach for the #BirdOfTheDay
#borb #birds 🌿
NVIDIA presentó CUDA Rust, con dos caminos: cuda-oxide, que compila Rust directo a PTX y está en alfa temprana, y cutile-rs, que ya está publicado y lo usan el motor de Hugging Face y mistral.rs.
▶ https://youtu.be/lvo5QRdHI0o
#ramyxtec #notiweek #gpu
NVIDIA presentó CUDA Rust, con dos caminos: cuda-oxide, que compila Rust directo a PTX y está en alfa temprana, y cutile-rs, que ya está publicado y lo usan el motor de Hugging Face y mistral.rs.
▶ https://youtu.be/lvo5QRdHI0o
#ramyxtec #notiweek #gpu
The Vera Rubin NVL72 boosts system performance, enhancing tokens-per-dollar and revenue potential. New Rust models like cuTile improve GPU kernel safety. Large-scale AI demands dynamic electricity…
Read more on Kimbodo:
The Vera Rubin NVL72 boosts system performance, enhancing tokens-per-dollar and revenue potential. New Rust models like cuTile improve GPU kernel safety. Large-scale AI demands dynamic electricity…
Read more on Kimbodo:
New TileContext API: Write #GPU kernels from #Java in tiles, not threads, via #NVIDIA #cuTile model.
Now, cuTile methods can be mixed with cuBLAS functions in one TaskGraph, optimizing data transfers.
👉 github.com/beehive-lab/TornadoVM/releases/tag/v7.0.0
#opensource #AI
New TileContext API: Write #GPU kernels from #Java in tiles, not threads, via #NVIDIA #cuTile model.
Now, cuTile methods can be mixed with cuBLAS functions in one TaskGraph, optimizing data transfers.
👉 github.com/beehive-lab/TornadoVM/releases/tag/v7.0.0
#opensource #AI
cibered.com/programacion...
#Rust #CUDARust #CUDA #GPU #Programacion #Nvidia #CiberED
cibered.com/programacion...
#Rust #CUDARust #CUDA #GPU #Programacion #Nvidia #CiberED
s3nnet.de/nvidia-stell...
#Linux #LinuxNews #LinuxDE #LinuxNewsDE #EULE #EULEde #NVIDIA #CUDA #Rust #GPU
s3nnet.de/nvidia-stell...
#Linux #LinuxNews #LinuxDE #LinuxNewsDE #EULE #EULEde #NVIDIA #CUDA #Rust #GPU
エンジニアへの影響:既存のCUDAカーネルをRustへ移行し性能比99.5%を実現可能に
https://developer.nvidia.com/blog/translating-cuda-tile-operations-from-python-to-rust-using-agentic-ai/
エンジニアへの影響:既存のCUDAカーネルをRustへ移行し性能比99.5%を実現可能に
https://developer.nvidia.com/blog/translating-cuda-tile-operations-from-python-to-rust-using-agentic-ai/
linuxiac.com/nvidia-intro...
#NVIDIA #CUDA #Linux
linuxiac.com/nvidia-intro...
#NVIDIA #CUDA #Linux
#Linux
#Linux