I kinda hate my tall friends

So I’m getting more into fitness lately and they said I’m lucky I’m short since I’ll build muscle quicker. Only problem is I don’t wanna have big bulky muscles, they all tell me height doesn’t matter but imo that’s the same as rich people saying money doesn’t matter. I’m the shortest in my family always reminded of it by them and at this point I wanna just give up on women and stay single forever probably just live alone forever in the mountains.