How about we turn this around a bit; what if we didn’t round all sexual misconduct up to violent sexual assault?
Yes statutory sexual violations are a crime, yes having sex with someone who’s too drunk to consent is a crime, but they aren’t the same crime as violent sexual assault in the same way that manslaughter isn’t premeditated murder.
The first thing that comes to mind is Brock Turner. He raped an unconscious woman behind a dumpster. To you does that fall under “violent rape” or “having sex with someone too drunk to consent”? In my view it’s both. The violence is inherent in the act of being violated. People need to err on the side of consent or accept the risk of being called a rapist.