Web Hosting Talk : Web Hosting Main Forums : SEO / SEM Discussions : how to tell if robots have visited?

[gg2327]

does the goole analytic tool enables you to see what kind of robots have visited your site. i can't seem to find the info?

[CretaForce]

Does your web host provides awstats or a similar program? If you have cpanel it comes by default.

[Zafar Ahmed]

Originally Posted by CretaForce

Does your web host provides awstats or a similar program? If you have cpanel it comes by default.

yes, but it just tells you Robots, it does not state any specific robot, there are different kind of robots.

[gg2327]

Originally Posted by CretaForce

Does your web host provides awstats or a similar program? If you have cpanel it comes by default.

no webhost is free so not much service but i use google analytics to track pages and but it doesn't seem to see if pages are being accessed by people or robots at the moment?

[Wullie]

Originally Posted by gg2327

no webhost is free so not much service but i use google analytics to track pages and but it doesn't seem to see if pages are being accessed by people or robots at the moment?

I don't use Google Analytics so I may be off here, but if it's simply a piece of Javascript that you place into your pages, the robots won't be counted (at least not properly) because the majority of robots don't execute Javascript code.

To get the true numbers, you would need to either have access to the raw server logs or a stats program that gets it's data from them.

[gg2327]

Originally Posted by Wullie

To get the true numbers, you would need to either have access to the raw server logs or a stats program that gets it's data from them.

ahh! i think i remember something about looking in server logs so i guess i can't check form google analytics. no worry. i was just curious and thought i could check from google analytics., it's the server logs. thank you.

[The Stealthy One]

how to tell if robots have visited?

They tend to leave no fingerprints. But if you hear a lot of clanking everytime you come in your front door, chances are they're leaving out the back.






Sorry, couldn't resist!

[SEOKing]

an easy way to check the last time your page was crawled is by doing the following search on Google:

cache:www.yourdomain.com

[Ryan - Limestone]

how to tell if robots have visited?

Did anyone else think this was going to be a post about a robot invasion?

:-D

[H0stD3m0n]

Originally Posted by Zafar Ahmed

yes, but it just tells you Robots, it does not state any specific robot, there are different kind of robots.

It shows what robots are used, not sure if for all but I've seen the google bot show up on several site stats.

[gg2327]

Originally Posted by Ryan - Limestone

Did anyone else think this was going to be a post about a robot invasion?

:-D

now that you mentiones it i'm having a good laugh!

[gg2327]

Originally Posted by SEOKing

an easy way to check the last time your page was crawled is by doing the following search on Google:

cache:www.yourdomain.com

that doesn't seem to work, you type it in the google search box right?
is says my search result does not match any documents.

[Ryan - Limestone]

I'm just glad someone commented on that. I was starting to think I was the only one who thought that.


Lol

:-D

Originally Posted by gg2327

now that you mentiones it i'm having a good laugh!

[dbpalan]

hahahah KINDA

Originally Posted by Ryan - Limestone

I'm just glad someone commented on that. I was starting to think I was the only one who thought that.


Lol

:-D

[Mxhub]

Robot invasion? LOL.

Anyway, you can check awstats for the spiders crawling on your site.