RTC Battery holder broke off

You would loose all the BIOS settings and the clock. I am not even sure what other issues it could cause down the road, like TPM, firmware and such.