minus-squareM34L@alien.topBtoAMD@hardware.watch•Former cryptomining GPUs are now being repurposed to make GeForce RTX 3080 20GB and RX 580 16GB cards - VideoCardz.comlinkfedilinkEnglisharrow-up0·1 year agoIt’s for AI acceleration. In AI training (and with LLMs, inference), the VRAM is basically hard limit of the complexity of the AI model you can run on the GPU. 20GB is enough to train some small LLMs, 10GB is not. linkfedilink
minus-squareM34L@alien.topBtoAMD@hardware.watch•AMD CacheWarp Vulnerability Afflicts Previous Gen EPYC Server CPUs, Patch IssuedlinkfedilinkEnglisharrow-up0·1 year ago “Secure Encrypted Virtualization” “Not for protection” What the fuck is it ? Marketing??? linkfedilink
It’s for AI acceleration. In AI training (and with LLMs, inference), the VRAM is basically hard limit of the complexity of the AI model you can run on the GPU. 20GB is enough to train some small LLMs, 10GB is not.