I'm going to be completely honest with you, and Im not going to BS. I notice the same exact thing with people, I am a quiet woman and some people dont trust me, they would stare sometimes, and act as if im their enemy. People of all ages, I just pretty much assume they have no other issues to worry about and no other people who is trying to do them wrong. So they look at you and they dont understand you. They're selfish.
The latest person to do this to me was my neighbor, he was up in the tree cutting it, and when I walked outside his mouth twisted up, he stopped what he was doing, and stared at me. Let me tell you, he looked weird as frick sitting in the tree like that.
You know what you should do? Ignore situations like that when it comes to your classmates and randoms. But when it comes to something like your neighbor, boss, SPEAK UP, It makes you feel loads of better! I remember one time some customer at work lied on me, and then my boss stormed and I pretty much told her in the most honest yet rightfully angry (respectful) way that the customer lied... It felt really good.
To answer your question, I dont hate quiet. I am a quiet person.