As method pto run ai using GPU in a vm on linux
Use this to install ROCm on Tumbleweed. Does NOT talk about Pytorch, the tag is for completeness.
NON-passmark comparisons of GPU. Vega 8 is better than Vega 7.
SHOWS EXACTS SPECS OF CPU OR APU INCLUDING GRAPHICS
Compare Distinct graphics cards with AMD APUs. Result: Buy Ryzen 5700G, or AMD Ryzen 5 5600GT as GPU is the same. BUT Ryzen 5700G has 25% better CPU
Database of AMD GPUs. Here we can see that 2500U is Vega 8 mobile , which is GCN 5.0. This is only supported in ROCm up to 4.5.2!!
LM Studio can be installed on Linux with APU or GPU (looks like it needs the AI CPU though??) and run LLM. Install on Laptop and test if it works.
Install PyTorch corresponding to rocm versions from Pytorch prebuild by AMD. Also has post-install validation
Test for PyTorch and ROCm after installing ROCm.
Follow falling prices
A program that changes VRAM / UMA size in BIOS on AMD APU, even if VRAM / UMA does not show in BIOS
Another rocm installation claim on Opensuse. Interesting note: I realize this is a bit old, but you don't really need amdgpu from the repository: it comes for free with the kernel. amdgpu-dkms is only needed if you're stuck on an older kernel version and you can't upgrade for some reason. For example, Tumbleweed users will not need it..
This guy seems to claim ROCM can run on Tumbleweed using Distrobox. But what is distrobox?
This guy claims successful installation of ROCm on Ubuntu - this seems to be workable for Tumbleweed as well. See the comment “nav9 commented on Jul 16, 2023“
