Discuss all about Spiders

Discuss Spiders at Setting up your Forum, Whether your running the latest edition of vBulletin 3.5 or just starting off with a InvisionFree forum we'll give you startup help. I've noticed that your "active users" list includes identifying spider bots. Now, .





Post New Thread  Reply
 
LinkBack Thread Tools Thread Tools Feed Icon
  #1  
Old 09-29-2005, 04:58 PM
SteveS
TSL Fixated
 
Post Count Posts: 89
User Location Location: Ipswich UK
Administrative Ability Ability: Beginner
Running IkonBoard IkonBoard

I've noticed that your "active users" list includes identifying spider bots. Now, I know that IF is different software, but I was curious as to whether this is a feature of vB or a code hack that could possibly be translated to IF? I'd love to know

Steve


Last edited by Michael; 09-29-2005 at 05:30 PM.
Reply With Quote
  #2  
Old 09-29-2005, 05:31 PM
Michael's Avatar
Michael
vBulletin Resources
 
Post Count Posts: 1,274
User Location Location: United Kingdom
Administrative Ability Ability: Advanced
Running vBulletin 3.0.X vBulletin 3.0.X

With using vBulletin we are allowed access to individual files. I am sure that a modification like this would be doable within IF. But it would require access to the database, important files, or else your footer would be cramped with search engine bot strings and identification text.


The Staff Lounge - Your vBulletin Resource.
vBulletin, InvisionFree, IPB, phpBB and Forum Resources.
Reply With Quote
  #3  
Old 09-29-2005, 05:40 PM
SteveS
TSL Fixated
 
Post Count Posts: 89
User Location Location: Ipswich UK
Administrative Ability Ability: Beginner
Running IkonBoard IkonBoard

Ah well, guess it's out for now then - just thought I'd ask Drives me to distraction trying to figure out some of those Guest IPs

Thanks for the quick answer, Michael

Reply With Quote
  #4  
Old 09-29-2005, 11:52 PM
Baller
TSL Trainee
 
Post Count Posts: 9

isnt it a robot that watches ur site when it has a certain mount of hits?

Reply With Quote
  #5  
Old 09-30-2005, 11:27 PM
Tycho's Avatar
Tycho
TSL Intermediate
 
Post Count Posts: 40
User Location Location: Washington, USA
Administrative Ability Ability: Intermediate
Running IkonBoard IkonBoard

Something like that. I would love to know the robots also, it would be a very handy code to have... O.o

Reply With Quote
  #6  
Old 10-02-2005, 11:45 AM
Michael's Avatar
Michael
vBulletin Resources
 
Post Count Posts: 1,274
User Location Location: United Kingdom
Administrative Ability Ability: Advanced
Running vBulletin 3.0.X vBulletin 3.0.X

Robots are just little automated programs which search engines send around to those sites submitted to their index; they check text, images, content, links in and out and so forth. To get them displayed on a vBulletin (3.0.x) forum then follow this link; http://www.vbulletin.org/forum/showthread.php?t=75986


The Staff Lounge - Your vBulletin Resource.
vBulletin, InvisionFree, IPB, phpBB and Forum Resources.
Reply With Quote
  #7  
Old 10-03-2005, 12:31 PM
.:Keith:.'s Avatar
.:Keith:.
TheOne
 
Post Count Posts: 233
User Location Location: West Bend, WI
Administrative Ability Ability: Intermediate
Running IkonBoard IkonBoard

How do you get them to visit your boards? I've seen that they increase activity (since they're search engines and all..). Does it happen randomly or what?


http://img.photobucket.com/albums/v4...1/pop11sig.png<-Join TODAY!
Reply With Quote
  #8  
Old 10-03-2005, 12:32 PM
Michael's Avatar
Michael
vBulletin Resources
 
Post Count Posts: 1,274
User Location Location: United Kingdom
Administrative Ability Ability: Advanced
Running vBulletin 3.0.X vBulletin 3.0.X

Quote:
Originally Posted By: .:Keith:.
How do you get them to visit your boards? I've seen that they increase activity (since they're search engines and all..). Does it happen randomly or what?
I'll be posting an Article on submitting your website to search engines soon.
Which should hopefully clear that question up, for example if you wanted to submit your website to Google then follow this URL.

Resolved.


The Staff Lounge - Your vBulletin Resource.
vBulletin, InvisionFree, IPB, phpBB and Forum Resources.
Reply With Quote
  #9  
Old 10-03-2005, 12:33 PM
.:Keith:.'s Avatar
.:Keith:.
TheOne
 
Post Count Posts: 233
User Location Location: West Bend, WI
Administrative Ability Ability: Intermediate
Running IkonBoard IkonBoard

Thanx.


http://img.photobucket.com/albums/v4...1/pop11sig.png<-Join TODAY!
Reply With Quote
  #10  
Old 10-03-2005, 12:33 PM
SteveS
TSL Fixated
 
Post Count Posts: 89
User Location Location: Ipswich UK
Administrative Ability Ability: Beginner
Running IkonBoard IkonBoard

Registering with dmoz.org will help a lot, as will registering with as many other search engines as you can

Steve

Reply With Quote
  #11  
Old 10-03-2005, 12:34 PM
.:Keith:.'s Avatar
.:Keith:.
TheOne
 
Post Count Posts: 233
User Location Location: West Bend, WI
Administrative Ability Ability: Intermediate
Running IkonBoard IkonBoard

dmoz? Never heard of it. Is it some sort of new search engine?


http://img.photobucket.com/albums/v4...1/pop11sig.png<-Join TODAY!
Reply With Quote
  #12  
Old 10-03-2005, 12:36 PM
Michael's Avatar
Michael
vBulletin Resources
 
Post Count Posts: 1,274
User Location Location: United Kingdom
Administrative Ability Ability: Advanced
Running vBulletin 3.0.X vBulletin 3.0.X

Quote:
Originally Posted By: .:Keith:.
dmoz? Never heard of it. Is it some sort of new search engine?
http://dmoz.org/about.html

Quote:
The Open Directory Project is the largest, most comprehensive human-edited directory of the Web. It is constructed and maintained by a vast, global community of volunteer editors.


The Staff Lounge - Your vBulletin Resource.
vBulletin, InvisionFree, IPB, phpBB and Forum Resources.
Reply With Quote
  #13  
Old 10-03-2005, 12:51 PM
SteveS
TSL Fixated
 
Post Count Posts: 89
User Location Location: Ipswich UK
Administrative Ability Ability: Beginner
Running IkonBoard IkonBoard

Like Michael says, and several search engines use it so it's worth being on

Reply With Quote