I understand that the PS2 has a PS1 chip inside to support PS1 games.

Though in the XBox situation, that would be somewhat self-defeating.

However, the idea of 'fat binaries' is certainly not a new one. When Apple switched to PowerPC, some developers offered binaries with both 68K and PowerPC code inside.