It's true that modern fashion was, technically, started by women. In the early 20th century, Gabrielle 'Coco' Chanel shocked Parisian high society with her forward thinking designs and alteration of the traditional silhouette favoured by the bourgeois.
Many women followed suit, such as Elsa Schiaparelli and Madeleine Vionnet, completely changing the face of fashion.
It took gay men a while to identify with this new industry, even longer for society to accept the fact that, men too, could be creative and understand women's clothing.