The garbled area is exactly half as big as it should be. So, some kind of banking in mapping the framebuffer must be going on. Windows reserves two addresses for the FB, 0xfc000000 and 0xfd000000. Any ideas? Know any options related?

Hey! Guess what? The XFree documentation sucks. Time for a commercial server.