If you are a beginner like me, you may find those container based solutions helpful. If you are on Fedora42, just follow the explanations on his GitHub and ROCm support should work on your Framework Desktop at least for the text based models. I am currently trying out his container for image/video creation. I did have issues on openSUSE, probably something related to the container support.
5 Likes