It might be difficult or creates more problems than it solves to remove the audio input entirely.
At least for the video portion of the camera, Framework changed it specifically to not fully disconnect the camera. Mentioning that it improves how apps behave. Similar or worse app handling issues might present if the audio input was removed entirely.