ROCm on the new Framework 13

I’m on vanilla Arch so you’ll need to find the equivalent packages for Bazzite since I don’t know the package names.

I installed rocm-hip-sdk and python-conda then created a 3.10 python environment and installed gcc, then modified the install script to download ROCm for pytorch instead of CUDA, waited for it to finish installing and it runs (but not well).

Replace the normal CUDA pytorch download with this one:

python -m pip install torch==2.7.0 torchvision torchaudio==2.7.0 --upgrade --index-url https://download.pytorch.org/whl/rocm6.3

Add this before running the python script to force ROCm to “accept” incompatible GPUs like the iGPU we have:
HSA_OVERRIDE_GFX_VERSION=11.0.2

When it runs, it does utilize 100% of the iGPU however I’m unable to get it to use more VRAM which results in slower speeds.

This was the steps I used when I tried to run some AI stuff on the 7840U but gave up because it was worse than the HX 370.