Okay, tried to restart gdm and it locked up hard. Had to power cycle it. Came back up, no swap in use. Before I did that I tried killing Mozilla, swap didn't go down. Will try to watch for when I see it creeping up.