I am a rather good looking guy, a bit cautious, quiet and shy. I never actually met any single, attractive women, they are all either married or have boyfriends. Occasionally, I get teased and flirted ...
My guess is women are curious about it, though most are too tactful to ask about it. I wouldn't worry about it. I've been a dedicated masturbator since age 12, and I've also had my share of good luck with fairer sex.