There used to be a setting in the VNC server to force a certain "locale"...
I wonder if its trying to "auto pickup" you machine from whence you are controlling.
In another life, formerly I've heard of the "German" keyboards being the default.
Of course, I could be wrong here, but its seem very likely.