Back in 1964 my office/lab was near one of his labs. I was leaving about 10:00 PM one night and there he was slaving away on a DEC PDP-1. In near darkness, he had a rig in front of the CRT display with a chin and forehead rest and a photocell/optics tube near one eye. I asked him what he was up to. He said he was trying to get the machine to figure out where on the screen he was looking. His wife (300 or so lbs. worth) and 3 year old daughter showed up to try to get him to go home. He was still saying "Just few more minutes" when I left. As far as I know, he never made that work. His daughter called him Marvin, which at the time, I thought was peculiar.
A few months later he had group of guys trying to make a DEC PDP-6 with a home-brew robotic arm and vision system play ping pong. I moved on to other pastures so I don't know how far they got, but I'm sure a success would have been publicized.