All this does is bury comments regardless of quality
But if downvotes (and upvotes) are well correlated with quality, then what’s the problem? Your complaints are about community culture around downvotes, not about the mechanism itself.
I’d love to see a system where votes can be correlated between users so that the ranking algorithm weights like-minded voters and deemphasizes those voters you disagree with, but that would probably create a pretty significant overhead for the service.
Agreeing with the dominant mentality is rewarded.
And I’m saying that some communities have a “dominant mentality” that’s pretty obviously correct. The only thing worse than a person who says “just because it’s popular doesn’t mean it’s right” is the person who swings the pendulum too far in the other direction of saying “it’s unpopular so it must be right.”