This stereotyped thinking leads to nowhere (in my view). External or internal factors influence the mood, which then manifest itself in facial expressions. If those around you all have that bitchy look, then you should worry. :)
Because...
A. ...it is something personal /they hate you
B. ...it is deemed to be inappropriate/insane
C. ...they are clearly worse off and therefore it isn't the right place for you to stay