Not at all.
Your argument can lead to people turning up to work in bananaphone outfits, because that's what they feel comfortable in.
Dressing appropriately for work has no direct effect on the work I do - I'm exactly as stupid in a suit as out of one - but it sends a signal to my cow-orkers, the customer, and the people in other organisations who are working with me that I'm taking the job seriously, and that I'm taking them seriously.
Of course, all this can be ruined within seconds of opening my mouth, but first impressions count, and they last.
It never hurts to grease the wheels.
And as Andrew points out, a properly tied tie (I favour a half-Windsor knot, myself) need not be in any way uncomfortable.
