Framework Desktop Gen AI Build April 2026 (Ubuntu 24.04.4 + ROCm + llama.cpp)

Framework Desktop
,
1

Just to be clear, this is not spam, just the steps I took to get my desktop up and running with the stated stack.

After some trial and error, I was able to get Ubuntu 24.04.4 installed with ROCm and llama.cpp running.

Framework_ROCm_GenAI_Setup

Let me know if you run into any issues getting setup with these instructions.

2

You did a lot more than you need here. The firmware in Ubuntu is up to date for Strix halo.

The kernel support is as well with 6.17 HWE or 6.17 OEM.

You can also avoid compiling and get an up to date llama.cpp with a better frontend with lemonade :lemon:

2 Likes