The program is what is limiting you.
Based on maximum *per process* file descriptors.
I have bumped into openLDAP in CentOS v5.x being compiled with 1024 max file descriptors... and having to recompile for much higher.
So really it depends on the supporting program on which the connection is to.