My allergist expressed it as:

Irritant reaction vs Allergic reaction.

E.g. with enough pollen in the air, almost everyone will develop itchy, watery eyes. Just from the friction of all the junk in the air. People who are allergic will, in addition to that, have their bodies go into overdrive: "Danger! Danger! The air is trying to kill me! All hands on deck!!"

Cheers,
Scott.