filister@lemmy.world to Linux@lemmy.ml · 1 year agoZLUDA v4 Released For Initial CUDA Support On Non-NVIDIA GPUs - Phoronixwww.phoronix.comexternal-linkmessage-square6fedilinkarrow-up142arrow-down10 cross-posted to: linux@lemmy.world
arrow-up142arrow-down1external-linkZLUDA v4 Released For Initial CUDA Support On Non-NVIDIA GPUs - Phoronixwww.phoronix.comfilister@lemmy.world to Linux@lemmy.ml · 1 year agomessage-square6fedilink cross-posted to: linux@lemmy.world
minus-squarefilister@lemmy.worldOPlinkfedilinkarrow-up13·1 year agoI am really looking forward to having a viable alternative to NVIDIA. I would love buying Intel or AMD and being able to enable CUDA support on the GPU out of the box.
minus-squaregeneva_convenience@lemmy.mllinkfedilinkarrow-up9·1 year agoNVIDIA skimps out on VRAM needed for deep learning. If AMD could compete it would be huge as they often include more for cheaper.
minus-squaregaylord_fartmaster@lemmy.worldlinkfedilinkarrow-up4·1 year agoMe too. I recently switched from an RTX 2080 to a 7900 XTX, which is way more powerful for games, but local LLM performance tanked without CUDA.
I am really looking forward to having a viable alternative to NVIDIA. I would love buying Intel or AMD and being able to enable CUDA support on the GPU out of the box.
NVIDIA skimps out on VRAM needed for deep learning. If AMD could compete it would be huge as they often include more for cheaper.
Me too. I recently switched from an RTX 2080 to a 7900 XTX, which is way more powerful for games, but local LLM performance tanked without CUDA.