@bron looks like support is coming in rocm 7. While there is no official info what’ll be supported, there are files in there for all FW’s current AMD platforms and for the desktop. Looking at pre-release timing, they’ll probably get 7.0 out in a month, and i’ll take another 2-4 weeks to integrate it into the main ai packages, and then like another month to get to 7.1 with all the bugfixes.
RIght now you can try rebuilding code on top of beta which is PITA. I also won’t be surprized if there already are docker images that bundle beta libs. If someone finds them and shares here, that’d be great!
But yeah, AMD fucked up on this one with marketing selling stuff 2-3 quaters before the software is ready. And I doubt we’ll see reasonable NPU support withing half a year; I don’t count “install this obscure stack, windows only” as reasonable support. FW also messed up by proxying; they might be able to exert a small amount of pressure on AMD, but AMD won’t put consumer hw on linux before their MI300s, that’s not where the money is.
Good thing that AMD is catching up and support seems to be coming, and they aren’t abandoning recent hw.