It's cool how a hat can make one seem tomboyish or feminine depending on the rest of the outfit.
A ruffled blouse tones down a sporty hat and a skinny scarf makes an unisex blazer-and-pants ensemble flirty. I say experiment with the look and see if you can come up with a style that flatters you most.
My favorite look here is the fitted blouse and pants one, worn with pointy-toed flats. The model looks very pulled-together, but effortlessly so.