Depends on the temperature for me, if it's hot, I'm sporting a Goldtip or Truball visor, if it's cool, then a cap works.
For instance, I always wear my visor at Metropolis....bloody hot the timber there.
I'd say you got enough swinging to wear whatever you want Rodney, dare 'em to make fun of you!!!