By digging into the error logs, I found that OOo thinks that Java isn't installed.
Yeah, that would do it.
The problem is that this is on OS X and it doesn't run the setup like the Windows or Linux versions do. I'll try running the setup manually.
More news as it happens...