And then they tend to freak a bit when I'm just "there".

To be fair, that could just be your face doing that.