My Exim server drops mail with attachments that are deemed unsafe (you can't mail me an .EXE, for example) and SpamAssassin tags (and safely encapsulates) spam BEFORE it gets to my mailbox. If I were so inclined, I'd run ClamAV too.
All this stuff is server side. No user intervention required.