Got it.

I needed to up the DPI to 300 during the initial read into Gimp.
That uses the fonts embedded in the PDF, and anti-aliases very nicely.
I then resample down to 120 DPI so it prints faster.