the most naive definition of "word" - a string of word characters. In my experience people tend to start with that and then go from there.

You're right that the spec did not specify what to do with the non-word characters. But when I hear, "Do this", my first question is, "What other side-effects are OK?" My default assumption tends to be "none" unless I find out otherwise.

Cheers,
Ben