i am still new to drupal.. i have been told by my friend to modify some files to stop these bots.. can anybody pls tell me how to achieve some kind of defence from spam bots from slowing my website. is there any particular module which stops bad robots, spiders and crawlers.??

thanks Drupal :) i created a feature rich website in few hours.

Comments

Abilnet’s picture

smily’s picture

thank You for the quick reply:)

i installed the httpbl module.. it is meant for blocking bad robots from even reaching site while spam checks for spam in posts and comment..is'nt it??

i have already installed akisment for stopping spam in posts & comments. even captcha and recaptcha is installed.

do i still need to install spam module..??

--
Be Happy

Smile :)

Abilnet’s picture

Your hosting provider can also help and I believe some of them already block some spammers on their FireWall level. Sorry I'm not too familiar with the mentioned modules, but basically I'd just test them out to see what happens.

Good luck!

PS. depending on your site, be Very Careful how content produced by members go live (directly or through moderation queue) I lost one important site off from Google index because of spam I was not aware of.

yaph’s picture

Akismet works quite well. Another good way to reduce the number of spam is to enforce comment preview.

Z2222’s picture

Check out the robots.txt files on sites like WebmasterWorld (webmasterworld.com/robots3) and you can get a list of bad bots to block with robots.txt.

That won't block all of them, but it should stop many of the automated tools that people use.

hrishikesh’s picture

First is: you can add some drupal modules.
Second is: if you want it to be done quickly and want to get stats then there is a website http://foolbots.com
simply register and add a html code (in less than 2 minutes)