Good.  Wearing hats, of itself, is not really much of a problem.  Some very great historical figures have taken to wearing such headgear, and found that it lent them an air of dignity and authority.  Winston Churchill, for example, personally survived several direct hits from Nazi doodlebugs, thanks to his armoured bowler.  And then there's John Wayne who, in real life, never went anywhere without his trusty Stetson, as it meant he had somewhere shady to keep his sandwiches.  Even Mother Teresa wore a beret on her days off, and you get much more respected than that. The real problems start when you feel you have to wear a hat.  Be honest now - how long can you go without a hat before you go ape-crazy freaking psycho?
Several weeks
Less than a minute