I understand that the PS2 has a PS1 chip inside to support PS1 games.
Though in the XBox situation, that would be somewhat self-defeating.
However, the idea of 'fat binaries' is certainly not a new one. When Apple switched to PowerPC, some developers offered binaries with both 68K and PowerPC code inside.