I’m also trying to get the motherboard to work with dGPUs.
@Lincoln_Chen did you end up abandoning the use of the PCIe 4.0 x4 slot? I may have misunderstood, but it seemed like you were last using the NVMe M.2 slot(s) instead?
@Hrothmund how has that ADT-Link adapter worked for you?
In my experiments, I’m using the ADT-Link R23A-AMP (x4 to x16) and then a normal GPU riser, but the connection isn’t stable and keeps dropping to PCIe Gen 1.0. Forcing Linux to stick to Gen 1.0 solves the renegotiation issue but I’m still seeing GPU usage spike up (and power draw) for no reason.
@Lincoln_Chen Thanks! To clarify, was this the one that ended up working OK in the end? I’ve ordered a different one but if it doesn’t work I may try this one out of desperation.
I have been very busy the last couple of months, and I haven’t had a chance to finalize the design. I had most of it done, but I had to allocate my time elsewhere for a while. I didn’t even get a chance to assemble my custom framework motherboard build until my Christmas break. I have ordered all of the components, though, and they are sitting in the manufacturer’s warehouse ready for production. I will have a lot more time for the next little while so I should be able to finish it and test it out.
I never got it working properly, so I set it aside for other projects for the time being. I have a lot to learn on the software side anyway - even if it did work, I’m not sure if I’d know how to configure my llama docker container to offload some layers to the dGPU.
At this point I’m waiting for a firmware update that addresses issues with dGPUs, or for more people to report that they got such a setup working, before I revisit it.
After I pre-ordered my FW desktop, I’ve read through this thread many times, and to be honest, I was worried about my homelab plan using a MAX 395 with an RTX 3070. I’m happy to report that I finally received my Framework desktop mainboard, and with the help of a 10cm PCIe 4.0 x4 to x4 riser card (without supplemental power), my setup is working flawlessly. I’m running CachyOS and getting PCIe 4.0 x4 link capability with resizable BAR enabled. I haven’t encountered any boot issues so far.