They're used because they're offensive to the society at large. They have shock value and they are meant to indicate that the people saying them are powerful and they don't care about those societal norms. When people outside the group use that language, they aren't using it for the same reasons and shouldn't claim that they words are Ok because some other group uses them. If more "mainstream" people want to play in that sandbox, they need to be prepared to take the dirt and criticism that goes with it. I don't see it as a double-standard so much, myself.
I spent many years in Georgia when I was young - in the 1960s-1970s. There's a big difference between the connotations of "y'all" and "you people" - especially between groups.
FWIW.
Cheers,
Scott.