yabs.io

Yet Another Bookmarks Service

Viewing mzimmerm's Bookmarks


[https://github.com/ollama/ollama/issues/2637] - - public:mzimmerm
amd, apu, gfx900, install, pytorch, rocm - 6 | id:1491350 -

Latest (0.1.27) docker image with ROCm works for me on Ryzen 5600G with 8GB VRAM allocation. Prompt processing is 2x faster than with CPU. Generation runs at max speed even if CPU is busy running other processes. I am on Fedora 39. Container setup: HSA_OVERRIDE_GFX_VERSION=9.0.0

With marked bookmarks
| (+) | |

Viewing 801 - 850, 50 links out of 2233 links, page: 17


Export:

JSONXMLRSS