For that many files, ext3 could be out of the game.
I haven't heard of directory indexing on ext3; it may make a difference. In years gone by, you wouldn't put even 40,000 files into an ext3 directory. :-)
Otherwise, XFS, JFS or Reiser (v3) are all viable for that many files.