Its obvious nobody at Zenimax is a console player, so they have no idea how annoying it is to hear CONSTANT talking over the headset.
An easy solution would be to use one if the Gamepad buttons as a push to talk button. Even the digital-pad would work.
This is how the how chat should have been setup in the first place.
Please consider this solution Zenimax.