AMD Framework 13 required multiple boot attempts before actually booting

Hi! I have been using my laptop for a few months and I have a long-lasting issue with booting the device easily. When I click on the power button the LED lights up, but nothing is happening even if I wait for longer (didn’t test more than 20 mins). If I keep holding it until it turns off and turning it back on a few times, then it finally boots and works as usual without any issues. I didn’t have any problems when it’s actually working, left it in sleep mode for a long periods and still everything seemed fine. The other thing I noticed is that the system clock gets out of sync very easily, so I suspected the CMOS battery to be an issue, but there is none in this model.

I have the Framework 13 AMD model running Fedora 40 with custom RAM and SSD.

Not sure if that could be a bootloader issue or hardware one, so if anyone has any more clues I’d gladly hear them.