I did not find the Windows 11 driver pack to completely work on Windows 10. Here was my experience, including a link to the AMD driver download that fixed everything:
I too suggest a clean install, but if it’s worth it to you, you can always try using your SSD as-is. I think worst case you’ll have some extra or conflicting drivers that might cause performance issues which may or may not be easy to clean up, but I’m not sure, there may be other pitfalls moving a drive between very different PC’s. I’ve done it many times, but never long term enough to be confident in it.