This is my take on things in regards to how hair loss affects both men and women. Hair loss can be devastating for both parties, nobody likes to go through physical change which they have no control over. Men and Women can both suffer the negative affects when it comes to losing hair, both can become depressed, worried, insecure, hurt, angry. Male pattern baldness is a common and natural process, hair loss in women of course isn't as common. Perhaps women are a little more sympathetic and supportive to women who are losing hair, my experience throughout losing my hair was jokes from friends and family and I suppose they thought I was less likely to take offense due to the fact that male pattern baldness is somewhat expected in men but it of course can still have a negative impact on your confidence as a person.
I think hair loss can be equally as hard on male and females alike. Insecurity is insecurity no matter what gender it decides to manifest itself in. I work very closely with a woman who has alopecia and she is easily one of the most bubbly and happy women I know, She's also an attractive woman. I also know a guy so sensitive about his hair loss that he wont even discuss it with a fellow hair loss sufferer. At the end of the day hair loss is hard on most people.
As for the OP worried about what men will think of you well I personally would not overlook a relationship with a girl who was suffering from hair loss on the basis that I would feel a connection with said girl due to similar life experiences.