Web Hosting Talk







View Full Version : how to tell if robots have visited?


gg2327
09-13-2007, 05:05 PM
does the goole analytic tool enables you to see what kind of robots have visited your site. i can't seem to find the info?

CretaForce
09-13-2007, 05:46 PM
Does your web host provides awstats or a similar program? If you have cpanel it comes by default.

Zafar Ahmed
09-13-2007, 06:15 PM
Does your web host provides awstats or a similar program? If you have cpanel it comes by default.

yes, but it just tells you Robots, it does not state any specific robot, there are different kind of robots.

gg2327
09-13-2007, 07:49 PM
Does your web host provides awstats or a similar program? If you have cpanel it comes by default.

no webhost is free so not much service but i use google analytics to track pages and but it doesn't seem to see if pages are being accessed by people or robots at the moment?

Wullie
09-13-2007, 07:57 PM
no webhost is free so not much service but i use google analytics to track pages and but it doesn't seem to see if pages are being accessed by people or robots at the moment?

I don't use Google Analytics so I may be off here, but if it's simply a piece of Javascript that you place into your pages, the robots won't be counted (at least not properly) because the majority of robots don't execute Javascript code.

To get the true numbers, you would need to either have access to the raw server logs or a stats program that gets it's data from them.

gg2327
09-13-2007, 09:23 PM
To get the true numbers, you would need to either have access to the raw server logs or a stats program that gets it's data from them.


ahh! i think i remember something about looking in server logs so i guess i can't check form google analytics. no worry. i was just curious and thought i could check from google analytics., it's the server logs. thank you.

The Stealthy One
09-14-2007, 05:16 PM
how to tell if robots have visited?

They tend to leave no fingerprints. But if you hear a lot of clanking everytime you come in your front door, chances are they're leaving out the back.






Sorry, couldn't resist! :P

SEOKing
09-14-2007, 05:55 PM
an easy way to check the last time your page was crawled is by doing the following search on Google:

cache:www.yourdomain.com

Ryan - Limestone
09-14-2007, 06:04 PM
how to tell if robots have visited?
Did anyone else think this was going to be a post about a robot invasion?

:-D

H0stD3m0n
09-14-2007, 06:06 PM
yes, but it just tells you Robots, it does not state any specific robot, there are different kind of robots.

It shows what robots are used, not sure if for all but I've seen the google bot show up on several site stats.

gg2327
09-15-2007, 08:18 PM
Did anyone else think this was going to be a post about a robot invasion?

:-D

now that you mentiones it i'm having a good laugh!:D

gg2327
09-15-2007, 08:24 PM
an easy way to check the last time your page was crawled is by doing the following search on Google:

cache:www.yourdomain.com (http://www.yourdomain.com)

that doesn't seem to work, you type it in the google search box right?
is says my search result does not match any documents.

Ryan - Limestone
09-15-2007, 08:25 PM
I'm just glad someone commented on that. I was starting to think I was the only one who thought that.


Lol

:-D
now that you mentiones it i'm having a good laugh!:D

dbpalan
09-15-2007, 11:06 PM
hahahah KINDA :mad:
I'm just glad someone commented on that. I was starting to think I was the only one who thought that.


Lol

:-D

Mxhub
09-16-2007, 07:12 AM
Robot invasion? LOL.

Anyway, you can check awstats for the spiders crawling on your site.

gg2327
09-16-2007, 08:06 AM
Robot invasion? LOL.

Anyway, you can check awstats for the spiders crawling on your site.


ok i thnk i wll go download awstats then