Tag Archives: crawl-more

Robot crawl

Hi, How to reduce bot from keep crawl more that 3 minute? When this robot crawl with multiple ip, our website going high as we use cloudl… | Read the rest of http://www.webhostingtalk.com/showthread.php?t=1742998&goto=newpost Continue reading

Posted in HostGator, Hosting, php, VodaHost | Tagged , , , , , , , , , | Comments Off on Robot crawl