I noticed that the ROCm version that gets installed via dnf is 6.3. But apparently all the good stuff for the Ryzen AI MAX+ 395 is in ROCm 6.4. Has anyone tried to install 6.4 on their Framework Desktop running Fedora 42? I would imagine this requires building from source, but maybe someone knows about pre-built binaries?
(trying to get ROCm 6.4 installed so I can run Pytorch with the ROCm backend)
Wait until Fedora 43 or use Fedora Rawhide if you can’t wait. These are probably the easiest options.
You can’t just install it on Fedora 42 since there are dependency issues with Pytorch and stuff.
I would look at just containerizing everything. You can check out GitHub - kyuz0/amd-strix-halo-toolboxes to start.
This way you can pick and choose ROCm/Vulkan versions without having to muck around with your base OS.
or you can use/test fedora_43 in a toolbox with :
> toolbox create --distro fedora --release f43
> toolbox enter fedora-toolbox-43
# and install rocm6.4 + ... from fedora repos
edited: thanks @Jonathan_Haas yes 43 not 36 
That doesn’t look right.
Toolbox might be worth a try, I’m just not sure that it will work since you can’t install/use kernel stuff or other hardware-adjacent stuff inside a toolbox container.
Haven’t used toolbox before. So I followed their directions there, created and entered the llama-rocm-6.4.3-rocwmma toolbox. I guess I’m surprised that there aren’t any devtools there - no python, no compilers, etc. So you basically have to install everything?
Yes, so you can install only what you need. it make easy to test what you need to create container.
Fedora 42 and 43 share the same kernel (within a few days) so not realy a probleme with that.
And I have already test the rocm-6.4 with it and llama.cpp it work. so yes it work.
oups yes… bad copy/past corrected, thanks.
Good to know. I know some tools like hwinfo don’t work properly inside toolbox, because they see the emulated hardware of the toolbox container and not the real hardware, so I want sure if that would work.
Just an update to tell how I got Pytorch working with ROCm on the Framework Desktop. I found this page helpful: PyTorch on ROCm — ROCm installation (Linux)
Installed this docker image which seemed the most up to date: rocm6.4.3_ubuntu24.04_py3.12_pytorch_release_2.6.0
(see this page: https://hub.docker.com/r/rocm/pytorch/tags )
Then inside of that image I cloned the pytorch examples repo and tried running an example - it failed with some kind of HIP error. After googling around some I determined that the prebuilt pytorch in the image was not built with support the GPU in Ryzen AI Max 395. So then I followed the instructions in the Pytorch on ROCm page above for building Pytorch (clone Pytorch, cd to pytorch, export PYTORCH_ROCM_ARCH=gfx1151, build with .ci/pytorch/build.sh ) then it seemed to work, except there were errors related to torchvision - turns out that I needed to build torchvision from source as well so that it would match torch. Now Pytorch is working using the ROCm backend.
No need to use containers or wait for 43. Just do:
pip install torch torchvision --index-url https://download.pytorch.org/whl/rocm6.4
…after uninstalling the existing torch and torchvision.
After that, ComfyUI stops giving the “found no NVIDIA driver on your system” error.
or for 7.x:
python -m venv rocm
source rocm/bin/activate
pip install --pre torch torchvision torchaudio --index-url https://rocm.nightlies.amd.com/v2/gfx1151/
(note: did not test …)
after install I get
~/tmp$ pip list
Package Version
-------------------------- -------------------------------------
filelock 3.19.1
fsspec 2025.7.0
Jinja2 3.1.6
MarkupSafe 3.0.2
mpmath 1.3.0
networkx 3.5
numpy 2.3.2
pillow 11.3.0
pip 24.3.1
pytorch-triton-rocm 3.5.0+gitb0cf18f2.rocm7.10.0a20251015
rocm 7.10.0a20251015
rocm-sdk-core 7.10.0a20251015
rocm-sdk-libraries-gfx1151 7.10.0a20251015
setuptools 80.9.0
sympy 1.14.0
torch 2.10.0a0+rocm7.10.0a20251015
torchaudio 2.8.0a0+rocm7.10.0a20251015
torchvision 0.25.0a0+rocm7.10.0a20251015
typing_extensions 4.14.1
Can you try to run this command and see if it also crashes on exit?
$ python -c "import torch; print(torch.__version__)"
2.10.0a0+rocm7.10.0a20251015
double free or corruption (!prev)
Aborted (core dumped) python -c "import torch; print(torch.__version__)"
(rocm) zzzzzz@max:~/tmp$ python -c "import torch; print(torch.__version__)"
2.10.0a0+rocm7.10.0a20251015
no crach for me.
OS: fedora 42
(rocm) zzzzz@max:~/tmp$ python --version
Python 3.13.7
zzzzz@max:~$ uname -a
Linux framework 6.16.12-200.fc42.x86_64 #1 SMP PREEMPT_DYNAMIC Sun Oct 12 16:31:16 UTC 2025 x86_64 GNU/Linux
Hmm, interesting. I’m running Fedora 43 Server Beta:
(vllm) eugr@ai:~/vllm$ uname -a
Linux ai 6.17.3-300.fc43.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Oct 15 14:19:22 UTC 2025 x86_64 GNU/Linux
(vllm) eugr@ai:~/vllm$ python --version
Python 3.13.6