The startup key timeout is set to 0 seconds by default which doesn’t give much time to use F2 or F12.
Try running this command from terminal to reboot straight to the BIOS:
sudo systemctl reboot --firmware-setup
Then either change the Timeout to something higher or change the boot order (with the 21.04 installer is plugged in): BIOS guide