That’s completely normal with dual-booting with Windows, even with other PCs/Laptops. Windows somehow takes “ownership” of the Wifi card and keeps it assigned to itself until you do a cold shutdown/reboot.
You might have to fiddle with Windows settings to fix the issue, disable fast boot, fiddle with the energy options of the Wifi chip. I’m unfortunately not sure about the exact setting that would fix this behaviour.