Go Back   Internet Business Forums > Search Engine Optimisation

Reply
 
LinkBack Thread Tools Display Modes
Old 05-10-2004, 07:08 PM   #1 (permalink)
Business Guru
 
Brian Turner's Avatar
 
Join Date: Dec 2003
Location: Near Inverness, Highlands, Scotland
Posts: 7,958
Default Jeteye: Jetbot

There's an interesting bot doing the rounds - I've found it doing a heck of a lot of spidering - deep indexing, too. Seems to be a pretty effective crawler when it comes to actually indexing pages - so it should be interesting indeed to see if it actually amounts to anything on the search side.

The crawler they're using has the user-agent "Jetbot/1.0" and so far they all seem to be coming from the IP range 64.71.144.x.

For more information:
http://www.jeteye.com/jetbot.html
Brian Turner is offline   Reply With Quote
Old 06-10-2004, 10:03 PM   #2 (permalink)
Business Guru
 
Brian Turner's Avatar
 
Join Date: Dec 2003
Location: Near Inverness, Highlands, Scotland
Posts: 7,958
Default Re: Jeteye: Jetbot

Well - there are plenty of Jeteye spiders entering the community index - but they seem to stay there, rather than going deeper into the content.

EDIT: Hm, they are really beginning to annoy me now. They seem to be trapped on the index page.

EDIT 2:
I've now blocked the Jetbot IP range from this site, as all the bots do is gobble up bandwidth without actually indexing new links.
Brian Turner is offline   Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are Off



All times are GMT +1. The time now is 11:05 PM.


Powered by vBulletin® Version 3.8.5
Copyright ©2000 - 2014, Jelsoft Enterprises Ltd.
Search Engine Friendly URLs by vBSEO 3.6.0 ©2011, Crawlability, Inc.