I assume not as the spiders have been through here already.
E.g. https://www.google.c....org+tuberculosis
Cheers,
Scott.
I assume Google crawling isn't an issue?
I assume not as the spiders have been through here already.
E.g. https://www.google.c....org+tuberculosis Cheers, Scott. |
|
No, that's fine.
I may put some bandwidth limitations on them, but they've been crawling this site for a good year or so.
Regards,
-scott Welcome to Rivendell, Mr. Anderson. |