I have had no problems baking pre-packaged beer-battered bread.

Dunno, maybe you need to use beer rather than water. :=)