Yes, this is a problem with some Framework laptops. They have trouble initiating and/or maintaining USB 3 speed connections. Even Framework’s own 1 TB expansion card has problems with disconnects.
USB 2 seems to work fine, though. One way to test if this is the case for you is to use a USB 2 speed cable to connect your drive to the problematic port. Or with USB-A you can try plugging the cable in halfway until the drive appears. This enables a USB 2 speed connection.
I now use a powered USB-C hub to maintain stable USB 3 connections.
Other references:
http://community.frame.work/t/tracking-usb-a-an-ongoing-problem/
http://community.frame.work/t/samsung-external-ssd-not-recognized/
http://community.frame.work/t/connectivity-problems-with-external-drive-when-connecting-over-usb-c/
http://community.frame.work/t/amd-framework-and-nvme-ssd-enclosure-compatibility-investigation/