The first thing that I do on Windows is have it show me all filetypes. But the default is to hide several filetypes, which can lead to confusion exactly like you're seeing.

Cheers,
Ben