Why does my headset audio become fuzzy at certain angles only?

Broken wire. It's definitely a broken wire. I cannot tell you how many headphones I've broken that way. Usually I secure the wire near the plug with duct tape because it keeps it flowing smoothly (for a whole), but it's time for a new headset. :/ Hope that helps!