You should
Cavendish is beautiful. You'll find the water a wee bit chilly at this time of year, though... it was still kind of chilly when I was there many Augusts ago.
Also, Brudenell River Provincial Park is supposed to be excellent.
The Maritimes are great... and lots and lots of great music. If you insist on staying in Nova Scotia, drive the Cabot Trail; there's some incredible scenery along that highway.
'Course, if you really want to go far afield, you could always hop on the ferry up to Newfoundland... go and check out Gros Morne... I've never been there, but the photos of the place I've seen are completely amazing.