You may want to check Home Depot. I bought cable, connectors, jacks, and wallplates from them. The prices were comparable to the electrical supply places around here (Northern Virginia), and the location and hours were much more convenient for me.
I don't believe that they carry patch panels or punchdown blocks. I only needed four runs that all come back to a central location where I have a four-port single-gang wallplate. I believe that they had up to a twelve-port dual-gang wallplate in the store.
The jacks were around $5 apiece, so the four-port configuration is much cheaper than any patch panel.