How can FN key work in a modular keyboard with QMK layers?

Yes, I think you are right.