People at my church give me dirty looks because im kind of an andro/soft butch?

i have my hair cut short, kind of like an emo boys haircut? and usually wear a hoody and jeans. or a t-shirt and jeans. i could be mistaken for a boy until you look at me closely. when i go up to take communion people glare at me and avoid me its SO awkward. I know i cant get them to stop,but how can i stop caring what they think?? and im forced to go to church. :(