I'm having a slight issue need honest answers?

I want to start by saying I'm sharing personal info and I'd appreciate honest answers. Let me explain my appearance (no I'm not being self-centered I'm just giving a brief of myself) I am 5'10 178 pounds, very athletic and in good shape. I wear glasses (versace) and am in sales. I have my own place and my own car. I'm pretty stable in that regard. I do not go out a lot bec I have found it's not the right crowd. I prefer a relationship over random play. I do go out once in a while. I do know a lot of ppl at the gym I go to and in the past 6 months I've talked to 5 girls and got their numbers. Nothing came of any of those situations. In fact in the past few years I haven't really been getting noticed even tho I have grown up a ton, gained way more confidence and am in the best shape of my life. Again, that's not to sound superficial but it's describing my outward appearance. I smile and joke a lot, even though I have lots of inner struggles. I have lots of what I call "low level" friends, people I hang out with once in a while but not close friends. I do have a few close friends. Going back to the females, I don't really get noticed. I have lots of ppl I know on facebook and I'll say happy birthday to ppl and occasionally say what's up. I don't get any effort back. Girls don't "hit on me" or ask me out or initiate convo. I have to do it all. I'd say I'm a 6.5-7 out of 10 being realistic. Outside of work I usually wear polo shirts (like ralph, express or lacoste) and jeans or khaki shorts. I do smile at girls out and about, I don't try to anyways come off as down or lame. I am confident in myself. However I have been rejected a lot. I am realistic in what I look for in a girl. I'm in good shape and I know looks is important but not the only factor. I do however prefer a girl that takes care of herself. It's really not too much to ask for since I eat healthily, rarely drink and I don't smoke. Unfortunately tho, the only girls that have given me any time of day are not what I'm looking for. I know that sounds stuck up but you'd have to be me to know what I mean. Girls that weioght as much as me and are as tall as me are not what I'm looking for. So my question is why am I not getting noticed? I am a nice guy but not like the nice guy that girls see as a friend. I know how to treat a girl, and yet I am confident and have an edge to me as well. Being athletic and in great shape I figured would get me more noticed than someone who doesn't. Sorry if that sounds insensitive but it does take a lot of motivation to spend 10 hours a week in the gym year round and to eat right. I'm always there for my friends if they need help or someone to talk to. So in your opinion having read this (knowing it's a very brief synopsis of my situation) why would you think it seems hard me to find what I am looking for and why I seem to feel invisible. I've done better with not overlooking, or comparing myself to other guys. Those two things will do nothing but create un needed stress.