I might be wrong, but in general, I think women leave their hats on. I've read some hat etiquette somewhere in my internet travels. I'm sure someone will have links. Maybe you can take your tip from watching old movies? The childhood memories I have of my grandmother and old, OLD aunts have them wearing their "Sunday-best" hats in church, in restaurants, etc. Hope this helps.