Search Engine NewsDiscuss too many bots ? in the vBulletin SEO Tips and SEO Questions forums; after installing vbseo a few days back,my forum is getting 6-8000 hits from bots daily.i am still on shared hosting (no plans of upgrading yet). i dont want to upset ...
after installing vbseo a few days back,my forum is getting 6-8000 hits from bots daily.i am still on shared hosting (no plans of upgrading yet). i dont want to upset my host.
should i disallow/limit all non-google bots ?
I would make sure to add the robot.txt file..
but I wouldn't want to stop bots from crawling ;)
I suggest getting a bigger plan if it's becoming an issue