The tiers, measured.
on-die SRAM: >100 TB/s
L2: ~12 TB/s
HBM3 3.35 -> HBM4 22 TB/s
NVLink4 900 GB/s -> NVLink6 3.6 TB/s per GPU
PCIe Gen5: 128 GB/s
DDR5: 38 GB/s per channel
800G port: ~100 GB/s
Same bytes. Six orders of magnitude.
The tiers, measured.
on-die SRAM: >100 TB/s
L2: ~12 TB/s
HBM3 3.35 -> HBM4 22 TB/s
NVLink4 900 GB/s -> NVLink6 3.6 TB/s per GPU
PCIe Gen5: 128 GB/s
DDR5: 38 GB/s per channel
800G port: ~100 GB/s
Same bytes. Six orders of magnitude.
#Trainium3 #AWS
open.substack.com/pub/chippub/...
#Trainium3 #AWS
open.substack.com/pub/chippub/...
🔗 aidailypost.com/news/nvlink-...
🔗 aidailypost.com/news/nvlink-...
▼詳細はこちら
▼詳細はこちら
#NVLink6 #AINetworking #DataCenter #NVIDIA #GPUFabric
#NVLink6 #AINetworking #DataCenter #NVIDIA #GPUFabric