use tcpdump -l to monitor the packets and see if it is one site or many that is smacking you. You might even see that you get no traffic during that interval wich would point to an upstream problem. If it is one site, you have an ip to chase.
thanx,
bill