Big Webmaster » bots http://www.big-webmaster.com Fri, 03 Sep 2010 13:51:34 +0000 en hourly 1 http://wordpress.org/?v=3.0.1 Tasapspider/0.9 http://www.big-webmaster.com/tasapspider09/ http://www.big-webmaster.com/tasapspider09/#comments Wed, 23 Dec 2009 19:52:42 +0000 bigw http://www.big-webmaster.com/?p=379 Just found this “bot” going crazy on a site that is on a dedicated server, took the entire server offline. This bot looks to be new and from China, so be on the lookout.

Other reports are saying it is ignoring the robots.txt file, so might not be good enough to deny it there.

It was coming from 218.28.29.236

Here are more details about that IP, and what ranges you might want to block.

http://whois.domaintools.com/218.28.29.236

I placed the following in my .htaccess file


order allow,deny
deny from 218.28.
deny from 218.29.
allow from all

Please post a comment if you this bot has hit your site.

]]> http://www.big-webmaster.com/tasapspider09/feed/ 7 Spinn3r Bot http://www.big-webmaster.com/spinn3r-bot/ http://www.big-webmaster.com/spinn3r-bot/#comments Fri, 28 Aug 2009 14:30:41 +0000 bigw http://www.big-webmaster.com/?p=281 Spinn3r is a bot that indexes blog posts.

Looks like this in your log files.

Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.2.1; aggregator:Spinn3r (Spinn3r 3.1); http://spinn3r.com/robot) Gecko/20021130

]]> http://www.big-webmaster.com/spinn3r-bot/feed/ 0 YebolBot http://www.big-webmaster.com/yebolbot/ http://www.big-webmaster.com/yebolbot/#comments Mon, 23 Jun 2008 19:19:08 +0000 bigw http://www.big-webmaster.com/?p=13 Anyone know anything about this bot?

YebolBot (compatible; Mozilla/5.0; MSIE 7.0; Windows NT 6.0; rv:1.8.1.11; mailTo:thunder.chang@gmail.com)

]]> http://www.big-webmaster.com/yebolbot/feed/ 4