There used to be a setting in the VNC server to force a certain "locale"...

I wonder if its trying to "auto pickup" you machine from whence you are controlling.

In another life, formerly I've heard of the "German" keyboards being the default.

Of course, I could be wrong here, but its seem very likely.