Thank you both for the replies. I do feel a bit better about the brown and grey, because I just picked up a grey suit and a nice pair of brown oxfords that I thought matched well. My wife agreed, but I have been berrated by the young ladies at work for my lack of sense when it comes to colour matching.
I must admit, there is a bit of an ulterior motive behind the thread... shamefully, I haven't a single man's hat other than ball caps. I've been rebuilding more "formal" wardrobe since I got married and have actually been trying to base the beginnings off of Matt Deckard's thread on vintage at work. Since I just went out and bought new suits, shirts and shoes this weekend, I was trying to find one hat to get the most bang for my buck out of. For the time being, of course.
I'm not sure how I missed the putting it all together thread, so thank you for the link. That is my next stop.