I find it difficult to criticize someone for making a bunch of money through authoring a book or three (his wife wrote one and he two IIRC).

I don't have issues with millionaires who earn their money through actual work, but they're in the tiny minority of the wealthy. Most of the wealthy contribute nothing and receive vast sums of money primarily through two channels:

(1) Inheritance.
(2) Unearned income.

Unearned income ought to be taxed at least 5 times more heavily than earned income and any millionaire and up should have a wealth tax of 90% on all unearned assets. It is a very strong indictment of our economic system and culture that our tax code actually rewards people for refusing to earn anything and instead "make money from money".