Leaving this here in case I forget. I could connect to a Bluetooth speaker just fine, but it kept playing audio through the phone. Some googling found this tip: Go into Settings -> Sound -> Advanced and turn on Touch Sounds. This shouldn't affect Bluetooth audio, but it does.