Big Webmaster » bots

Cuil Shuts Down?

bigw — Tue, 21 Sep 2010 03:36:07 +0000

It appears the one time rising search engine Cuil is offline and not coming back online.

The search engine was released on high hopes to overtake Google. But such an ambitious goal does not come by easily.

Cuil came across to many as overly arrogant immediately claiming they there were better than Google and would soon overtake them… a fool and his search engine are soon parted.

I remember checking them out after the “big” announcement, and maybe visited the site 2 more times since then, but never saw the value.

What are your thoughts on the end of Cuil?

Tasapspider/0.9

bigw — Wed, 23 Dec 2009 19:52:42 +0000

Just found this “bot” going crazy on a site that is on a dedicated server, took the entire server offline. This bot looks to be new and from China, so be on the lookout.

Other reports are saying it is ignoring the robots.txt file, so might not be good enough to deny it there.

It was coming from 218.28.29.236

Here are more details about that IP, and what ranges you might want to block.

http://whois.domaintools.com/218.28.29.236

I placed the following in my .htaccess file

order allow,deny deny from 218.28. deny from 218.29. allow from all

Please post a comment if you this bot has hit your site.

Spinn3r Bot

bigw — Fri, 28 Aug 2009 14:30:41 +0000

Spinn3r is a bot that indexes blog posts.

Looks like this in your log files.

Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.2.1; aggregator:Spinn3r (Spinn3r 3.1); http://spinn3r.com/robot) Gecko/20021130

YebolBot

bigw — Mon, 23 Jun 2008 19:19:08 +0000

Anyone know anything about this bot?

YebolBot (compatible; Mozilla/5.0; MSIE 7.0; Windows NT 6.0; rv:1.8.1.11; mailTo:thunder.chang@gmail.com)