What are the bots?
What are the bots?
just curious about the "bots that appear in the users online area, like Bing[Bot] and Google[Bot] what do they do?
"Ann Arbor 2373 Calling... Milkshake. Over"
All Aboard Amtrak: Northbound, Southbound, and My Hometown
All Aboard Amtrak: Northbound, Southbound, and My Hometown
-
- Railroadfan...fan
- Posts: 407
- Joined: Sun Oct 16, 2011 11:04 pm
- Location: Brownstown, MI
- Contact:
Re: What are the bots?
I agree. What are they? I do have a theory, though.
The bots are Google and Bing, two of the biggest and most known search engines on the web. My guess is that they are possibly "users" that are always online to display search queries. As in, if someone searches something train related, Google and Bing would show links to this website. It may be like this for all websites, but for some reason only this site shows them.
The bots are Google and Bing, two of the biggest and most known search engines on the web. My guess is that they are possibly "users" that are always online to display search queries. As in, if someone searches something train related, Google and Bing would show links to this website. It may be like this for all websites, but for some reason only this site shows them.
Jake
Railroading YouTube channel: http://www.youtube.com/user/trainster100
Aviation YouTube channel: http://www.youtube.com/user/dtwdelta763
Railroading YouTube channel: http://www.youtube.com/user/trainster100
Aviation YouTube channel: http://www.youtube.com/user/dtwdelta763
- ~Z~
- Sofa King Admin
- Posts: 12994
- Joined: Tue Oct 12, 2004 2:14 pm
- Location: Grand Rapids, MI
- Contact:
Re: What are the bots?
The site recognizes when google, bing, and various other search engines are crawling the site. Basically these search engines keep visiting the site, they check for updated pages, which is basically every time someone posts anything, and the search engines will browse through, updating their own databases. Googleadsense bot stops by a lot too to try to figure out what ads to display on the threads. Our site is crawled many times a day, so google keeps a very up-to-date snapshot of what is on the site so they can direct users at us with fresh information.
Bots crawl most other sites..some sites turn off the crawling ability by altering their robots.txt file in the root directory. I let the bots crawl as it really helps to drive in new users, and we have plenty of bandwidth to let them roam.
Bots crawl most other sites..some sites turn off the crawling ability by altering their robots.txt file in the root directory. I let the bots crawl as it really helps to drive in new users, and we have plenty of bandwidth to let them roam.
Webmaster
Railroad photos on Railroadfan.com
Railroad photos on Railroadfan.com
Re: What are the bots?
ahhhhhhh i always wondered about them and now i know
"Ann Arbor 2373 Calling... Milkshake. Over"
All Aboard Amtrak: Northbound, Southbound, and My Hometown
All Aboard Amtrak: Northbound, Southbound, and My Hometown
- Jetlink
- Not a Railfan
- Posts: 3578
- Joined: Mon Jun 27, 2011 2:41 pm
- Location: 2.5 miles from CH 116.3
Re: What are the bots?
That's how I found your site.~Z~ wrote: I let the bots crawl as it really helps to drive in new users,
interested in trains
Patiently waiting for LansingRailfan to antagonize me in his tagline
Patiently waiting for LansingRailfan to antagonize me in his tagline
-
- Railroadfan...fan
- Posts: 455
- Joined: Fri Sep 23, 2011 4:47 pm
- Location: Cleveland, TN
- Contact:
Re: What are the bots?
I have a really stupid sounding question, forgive me, but what is bandwidth? I have another question for later, but my fingers are sore from typing messages all night! Ha!
Delay In Block Productions: "Railroading a Little Different than Usual."
Visit my YouTube Channel and Subscribe: http://www.YouTube.com/user/DelayInBlock
Like My Page on Facebook: http://www.Facebook.com/DelayInBlockProductions
Visit my YouTube Channel and Subscribe: http://www.YouTube.com/user/DelayInBlock
Like My Page on Facebook: http://www.Facebook.com/DelayInBlockProductions