Am I looked down on because I live in the projects?

like I live in a small city; in an apartment complex in the projects.. you know the ghetto... and I'm best friends with this dude who's parents have money.. and are real good people (both preachers) ... he's a total bad kid though... but when I go to their house.. I'm polite and everything, but for some reason I just feel bad because of where I'm from, and the stuff I've been thru that they only hear of in help the poor brochures, and gang prevention **** you know.. anyway... am I just being weird, or what