You have to live up to that reputation or else it will all backfire on you.
/me remembers some specific stories.
I don't think you will have a problem. Just make damned sure that you leave the door open while trying to sort out tech support issues in a woman's office. Else you might cause yourself marital problems in addition to the rumors! :-P
Cheers,
Ben