14 Guests

[Cringer]

Well, lets just give the robots.txt file some time. Things have definetly increased since I put it up for some reason, but google has only hit the site 3 times in the last 2 hours from what I see.

10 different robots Hits Bandwidth Last visit 
Unknown robot (identified by 'spider') 1843+131 23.42 MB 10 Apr 2006 - 14:48 
MSNBot 281+13 10.62 MB 10 Apr 2006 - 14:47 
Googlebot 20260+3 1.17 GB 10 Apr 2006 - 13:38 
Inktomi Slurp 400+29 17.51 MB 10 Apr 2006 - 13:34 
Unknown robot (identified by 'crawl') 31+2 152.80 KB 10 Apr 2006 - 12:53 
Unknown robot (identified by hit on 'robots.txt') 0+7 28.09 KB 10 Apr 2006 - 12:12 
Voyager 19 1.11 MB 10 Apr 2006 - 09:19 
AskJeeves 31+2 3.27 MB 10 Apr 2006 - 07:24 
WISENutbot

The key to this I guess is the + sign, the number right after that is how many times that robot has hit the robots.txt page.

Oh, and I did add to the robots.txt one more time. I added the general line to tell all bots to go the fuck away.

[sovstar]

I think you may be jumping to conclusions. Surely we've got a few people following along in Malaysia!

[Suicane]

Inktomi Slurp will pay me $5000 if i fly her here. and marry her. She emailed me.

[Kobeck]

Well, lets just give the robots.txt file some time. Things have definetly increased since I put it up for some reason, but google has only hit the site 3 times in the last 2 hours from what I see.

10 different robots Hits Bandwidth Last visit 
Unknown robot (identified by 'spider') 1843+131 23.42 MB 10 Apr 2006 - 14:48 
MSNBot 281+13 10.62 MB 10 Apr 2006 - 14:47 
Googlebot 20260+3 1.17 GB 10 Apr 2006 - 13:38 
Inktomi Slurp 400+29 17.51 MB 10 Apr 2006 - 13:34 
Unknown robot (identified by 'crawl') 31+2 152.80 KB 10 Apr 2006 - 12:53 
Unknown robot (identified by hit on 'robots.txt') 0+7 28.09 KB 10 Apr 2006 - 12:12 
Voyager 19 1.11 MB 10 Apr 2006 - 09:19 
AskJeeves 31+2 3.27 MB 10 Apr 2006 - 07:24 
WISENutbot

The key to this I guess is the + sign, the number right after that is how many times that robot has hit the robots.txt page.

Oh, and I did add to the robots.txt one more time. I added the general line to tell all bots to go the fuck away.

I think I'm gonna go ask Jeezes what the Imperial Football League is all about ...... hang on



My Saved Results
Imperial Football League
...territory that all led to touchdowns. The Mules went on to wn the game 35-9 for their second win of the season. © 2005 Imperial Football League...
www.imperialfl.us/ · Save
Imperial Football League :: Index
Imperial Football League FOF2004 MP League ... FAQ Search Memberlist Usergroups Register ... Mark all forums read All times are GMT - 5 Hours
www.imperialfl.us/phpbb · Save
More Results from www.imperialfl.us



to my suprise IFL was in fact the first two hits

[Coder]

Found this article on the web

http://www.robotstxt.org/wc/meta-user.html

try entering this meta-tag in the index-page on the front page.

[Matt]

looks like the spammers are back. We've got another new registered member.

[sovstar]

They never really left. There isn't a way to stop people/bots from registering. You can only prevent them from posting and then delete them when you get the chance.

[Matt]

They never really left. There isn't a way to stop people/bots from registering. You can only prevent them from posting and then delete them when you get the chance.

my bad. I thought Cringer set something up so that no new people could register accounts.

[Matt]

you can't stop them, you can only hope to contain them :twisted:

[Suicane]

Found this article on the web

http://www.robotstxt.org/wc/meta-user.html

try entering this meta-tag in the index-page on the front page.

Jeffrey, do you know how to do this?

[sovstar]

Don't think it'd be difficult, but I don't have root access.