I have felt this way for a long time. But just to give you an example, I moved about a year and a half ago (approx.30 miles). Since then, my brother and his wife have been here once, they helped me move in. They have not been back since. And no other member of my family has come to visit. I only have a couple good friends, never even hear from them. Wish I knew why? Yeah, I feel real popular.
As KaylaKai said, Its mostly in your head. My therapist has opened my eyes to how I think is different to how others think. I assume they think the worst, or are being critical, whereas they have no such thoughts. If they do, they aren't the people you want to be around in the first place.
For a long time it use to bother me, because I wanted to be what everyone wanted me to be, which was their normal. Now that I have learned alot about myself, I don't care anymore what, or how people think. I am me, and I am trying to feel better for myself, not to fit into someones mold. My family doesn't understand, and I have lost alot of friends along the way, but the ones who truly know me, and have unconditional love for me, are the ones who have stuck by me, when I was extremely low, and that means everything to me.