Why do people look down on those who are straight edge?

Straight edge means you don't do drugs (in extreme cases no medical drugs and promiscuous ). I could say a million bad things about people who do drugs and have promiscuous but I keep my opinions to myself but every time someone offers me a drink and I tell them I don't do drugs they start making fun of me.