We have been stopped in airports, questioned in a hotel lobby and given a "thumbs up" from people whose language we can't speak - all because of our hats.