The only anti-female Doctor fan I've ever slightly sympathised with was a guy I saw who was upset because he thought that the Doctor was the only fictional role model boys had who wasn't macho and violent. But to me that's an argument for better fiction in general, not for demanding that the Doctor only ever be male.