Basically, no matter the debug level, if I start sshd with the -D switch, I can connect to port xx. If not, I can't connect to either xx OR 22.

Time to figure out exactly what the -D switch does.