Robotic forum member
Moderator: Jon O'Neill
- Matt Morrison
- Post-apocalypse
- Posts: 7822
- Joined: Wed Oct 22, 2008 2:27 pm
- Location: London
- Contact:
Robotic forum member
Interesting - just noticed "Google [Bot]" is currently browsing the forum. The git.
- Charlie Reams
- Site Admin
- Posts: 9494
- Joined: Fri Jan 11, 2008 2:33 pm
- Location: Cambridge
- Contact:
Re: Robotic forum member
Yeah, we get spidered quite regularly, and phpBB cleverly recognises them, although for what purpose I'm not sure.
- Phil Reynolds
- Postmaster General
- Posts: 3329
- Joined: Fri Oct 31, 2008 3:43 pm
- Location: Leamington Spa, UK
Re: Robotic forum member
Am I right in thinking that the contents of posts on the board are not indexed by search engines?Charlie Reams wrote:Yeah, we get spidered quite regularly, and phpBB cleverly recognises them, although for what purpose I'm not sure.
- Derek Hazell
- Kiloposter
- Posts: 1535
- Joined: Thu Jan 24, 2008 10:52 am
- Location: Swindon
- Contact:
Re: Robotic forum member
Just seen "Yahoo [Bot]" as wellMatt Morrison wrote:Interesting - just noticed "Google [Bot]" is currently browsing the forum. The git.
Living life in a gyratory circus kind of way.
- Charlie Reams
- Site Admin
- Posts: 9494
- Joined: Fri Jan 11, 2008 2:33 pm
- Location: Cambridge
- Contact:
Re: Robotic forum member
Ah, that's what it's for. Yes, they do index the pages but not the content. Odd...Phil Reynolds wrote: Am I right in thinking that the contents of posts on the board are not indexed by search engines?
- Phil Reynolds
- Postmaster General
- Posts: 3329
- Joined: Fri Oct 31, 2008 3:43 pm
- Location: Leamington Spa, UK
Re: Robotic forum member
Sorry, you'll have to explain this for me a bit more lucidly. In what sense does Google "index the pages"?Charlie Reams wrote:Yes, they do index the pages but not the content.
- Charlie Reams
- Site Admin
- Posts: 9494
- Joined: Fri Jan 11, 2008 2:33 pm
- Location: Cambridge
- Contact:
Re: Robotic forum member
Yeah, I realise that didn't make a lot of sense. To see what I mean, try this search; it comes up with a couple of hundred pages, but if you do something like this you'll be rather surprised to discover it returns no results at all. If you look at Google's cached versions of the pages, they just say stuff like "You are not authorised to read this forum." So you can't use Google to search this place, which annoys me a bit, because in my experience of other sites it's often better than the internal search.Phil Reynolds wrote:Sorry, you'll have to explain this for me a bit more lucidly. In what sense does Google "index the pages"?Charlie Reams wrote:Yes, they do index the pages but not the content.
- Phil Reynolds
- Postmaster General
- Posts: 3329
- Joined: Fri Oct 31, 2008 3:43 pm
- Location: Leamington Spa, UK
Re: Robotic forum member
Hmmm. Personally, I think I prefer it that way; even though this is a publicly readable board, I sometimes post things here that I might not if I thought they were liable to show up in some random Google search. I've often come across pages on other phpBB boards when I've been searching for stuff, so it must be configurable. Maybe you should run a poll to see what the members would prefer.Charlie Reams wrote:So you can't use Google to search this place, which annoys me a bit, because in my experience of other sites it's often better than the internal search.
- Derek Hazell
- Kiloposter
- Posts: 1535
- Joined: Thu Jan 24, 2008 10:52 am
- Location: Swindon
- Contact:
Re: Robotic forum member
Just saw one I've never seen or heard of before "Baidu [Spider]". Apparently it's from a Chinese search engine!
Two more new ones "Majestic-12 [Bot]" and "Exabot [Bot]"!
Also saw "Alexa [Bot]" and "Ask Jeeves [Bot]" recently, and "MSN [Bot]" is quite a regular.
Two more new ones "Majestic-12 [Bot]" and "Exabot [Bot]"!
Also saw "Alexa [Bot]" and "Ask Jeeves [Bot]" recently, and "MSN [Bot]" is quite a regular.
Living life in a gyratory circus kind of way.
- Derek Hazell
- Kiloposter
- Posts: 1535
- Joined: Thu Jan 24, 2008 10:52 am
- Location: Swindon
- Contact:
Re: Robotic forum member
Another new one I have never seen before this morning "Nutch [Bot]".
Another today "Google Adsense [Bot]".
Another today "Google Adsense [Bot]".
Last edited by Derek Hazell on Mon Dec 14, 2009 10:16 pm, edited 1 time in total.
Living life in a gyratory circus kind of way.
-
- Post-apocalypse
- Posts: 13382
- Joined: Mon Jan 21, 2008 10:37 pm
Re: Robotic forum member
I saw "Apterous Rex [Bot]" the other day.