Boot into safe mode (whack F8 when the computer starts to get the menu), jump into regedit, and delete the offending key.

Alternatively, if you've got a filename, just rename or delete the offending file.

Third way involves a set of Red Hat CDs and fdisk, but I guess you don't wanna go there just yet :)