When it comes to UNIX and VMS, I prefer to type. VMS in particular gives you great typing skills, especially as the DCL prompt doesn't have command completion.
When it comes to my own box, I get very annoyed if I can't point and drool. But I admin my server (when it's working; still awaiting new wireless NIC) in an SSH session, even though I could connect it to my monitor.