hosted by liquidweb


Go Back   Web Hosting Talk : Web Hosting Main Forums : SEO / SEM Discussions : how to tell if robots have visited?
Reply

Forum Jump

how to tell if robots have visited?

Reply Post New Thread In SEO / SEM  Discussions Subscription
 
Send news tip View All Posts Thread Tools Search this Thread Display Modes
  #1  
Old 09-13-2007, 05:05 PM
gg2327 gg2327 is offline
Junior Guru Wannabe
 
Join Date: Aug 2007
Posts: 94

how to tell if robots have visited?


does the goole analytic tool enables you to see what kind of robots have visited your site. i can't seem to find the info?



Sponsored Links
  #2  
Old 09-13-2007, 05:46 PM
CretaForce CretaForce is offline
Greece
 
Join Date: Jan 2004
Location: Greece
Posts: 2,066
Does your web host provides awstats or a similar program? If you have cpanel it comes by default.

__________________


  #3  
Old 09-13-2007, 06:15 PM
Zafar Ahmed Zafar Ahmed is offline
Web Hosting Master
 
Join Date: Mar 2004
Location: Pakistan
Posts: 2,752
Quote:
Originally Posted by CretaForce View Post
Does your web host provides awstats or a similar program? If you have cpanel it comes by default.
yes, but it just tells you Robots, it does not state any specific robot, there are different kind of robots.

__________________
I'm Zafar Ahmed.
I provide
SEO Services & eMarketing consultancy
I'll be glad to hear from you


Sponsored Links
  #4  
Old 09-13-2007, 07:49 PM
gg2327 gg2327 is offline
Junior Guru Wannabe
 
Join Date: Aug 2007
Posts: 94
Quote:
Originally Posted by CretaForce View Post
Does your web host provides awstats or a similar program? If you have cpanel it comes by default.
no webhost is free so not much service but i use google analytics to track pages and but it doesn't seem to see if pages are being accessed by people or robots at the moment?

  #5  
Old 09-13-2007, 07:57 PM
Wullie Wullie is offline
Web Hosting Master
 
Join Date: Feb 2004
Location: Scotland
Posts: 2,828
Quote:
Originally Posted by gg2327 View Post
no webhost is free so not much service but i use google analytics to track pages and but it doesn't seem to see if pages are being accessed by people or robots at the moment?
I don't use Google Analytics so I may be off here, but if it's simply a piece of Javascript that you place into your pages, the robots won't be counted (at least not properly) because the majority of robots don't execute Javascript code.

To get the true numbers, you would need to either have access to the raw server logs or a stats program that gets it's data from them.

  #6  
Old 09-13-2007, 09:23 PM
gg2327 gg2327 is offline
Junior Guru Wannabe
 
Join Date: Aug 2007
Posts: 94
Quote:
Originally Posted by Wullie View Post
To get the true numbers, you would need to either have access to the raw server logs or a stats program that gets it's data from them.

ahh! i think i remember something about looking in server logs so i guess i can't check form google analytics. no worry. i was just curious and thought i could check from google analytics., it's the server logs. thank you.

  #7  
Old 09-14-2007, 05:16 PM
The Stealthy One The Stealthy One is offline
Web Hosting Master
 
Join Date: Jan 2005
Posts: 3,093
Quote:
how to tell if robots have visited?
They tend to leave no fingerprints. But if you hear a lot of clanking everytime you come in your front door, chances are they're leaving out the back.






Sorry, couldn't resist!

__________________
Daniel B., CEO - x90x.net
Xoomsite.com is now x90x.net

  #8  
Old 09-14-2007, 05:55 PM
SEOKing SEOKing is offline
WHT Addict
 
Join Date: Sep 2005
Posts: 156
an easy way to check the last time your page was crawled is by doing the following search on Google:

cache:www.yourdomain.com

__________________
IPOWERWEB, My Web Hosting Provider for OVER Four Years - IPOWERWEB

  #9  
Old 09-14-2007, 06:04 PM
Ryan - Limestone Ryan - Limestone is offline
Hyper Advanced Awesome-Bot
 
Join Date: Sep 2007
Location: Dallas, TX
Posts: 1,169
Quote:
how to tell if robots have visited?

Did anyone else think this was going to be a post about a robot invasion?

:-D

__________________
Ryan - Limestone Networks - Client Relations Manager
Cloud, Dedicated & Enterprise Hosting - Premium Network - DDoS Protection Available
Resell Dedicated Servers @LimestoneInc - limestonenetworks.com - 877.586.0555

  #10  
Old 09-14-2007, 06:06 PM
H0stD3m0n H0stD3m0n is offline
Junior Guru Wannabe
 
Join Date: Sep 2007
Location: Saint John, NB, Canada
Posts: 91
Quote:
Originally Posted by Zafar Ahmed View Post
yes, but it just tells you Robots, it does not state any specific robot, there are different kind of robots.
It shows what robots are used, not sure if for all but I've seen the google bot show up on several site stats.

__________________
HostDemon.net - Web Hosting & Design Solutions at Sinful Prices!
30 Day Money Back | 24/7 Support | No Overselling | Instant Backups | 99.9% uptime | Adult Websites Allowed
Official Twitter Stream- Check it out and consider following us!

  #11  
Old 09-15-2007, 08:18 PM
gg2327 gg2327 is offline
Junior Guru Wannabe
 
Join Date: Aug 2007
Posts: 94
Quote:
Originally Posted by Ryan - Limestone View Post
Did anyone else think this was going to be a post about a robot invasion?

:-D
now that you mentiones it i'm having a good laugh!

  #12  
Old 09-15-2007, 08:24 PM
gg2327 gg2327 is offline
Junior Guru Wannabe
 
Join Date: Aug 2007
Posts: 94
Quote:
Originally Posted by SEOKing View Post
an easy way to check the last time your page was crawled is by doing the following search on Google:

cache:www.yourdomain.com
that doesn't seem to work, you type it in the google search box right?
is says my search result does not match any documents.

  #13  
Old 09-15-2007, 08:25 PM
Ryan - Limestone Ryan - Limestone is offline
Hyper Advanced Awesome-Bot
 
Join Date: Sep 2007
Location: Dallas, TX
Posts: 1,169
I'm just glad someone commented on that. I was starting to think I was the only one who thought that.


Lol

:-D
Quote:
Originally Posted by gg2327 View Post
now that you mentiones it i'm having a good laugh!

__________________
Ryan - Limestone Networks - Client Relations Manager
Cloud, Dedicated & Enterprise Hosting - Premium Network - DDoS Protection Available
Resell Dedicated Servers @LimestoneInc - limestonenetworks.com - 877.586.0555

  #14  
Old 09-15-2007, 11:06 PM
dbpalan dbpalan is offline
Junior Guru Wannabe
 
Join Date: Feb 2007
Posts: 34
hahahah KINDA
Quote:
Originally Posted by Ryan - Limestone View Post
I'm just glad someone commented on that. I was starting to think I was the only one who thought that.


Lol

:-D

  #15  
Old 09-16-2007, 07:12 AM
Mxhub Mxhub is offline
Web Hosting Master
 
Join Date: May 2001
Posts: 2,163
Robot invasion? LOL.

Anyway, you can check awstats for the spiders crawling on your site.

__________________
Affordable Managed Hosting Solutions for Professional & Business since 2001
Mxhub.com - Global : USA - UK - Canada - Europe - Asia Pacific



Reply

Related posts from TheWhir.com
Title Type Date Posted
Turkey Passes Bill that Gives Telecom Authority More Control over Internet Censorship Web Hosting News 2014-09-10 11:24:49
Tor Network Investigates Attack That May Have Unmasked Anonymous Users Web Hosting News 2014-07-31 13:36:13
HostingCon 2014: The Future of Cloud Services for Managed Service Providers with Ashar Baig, GigaOM Web Hosting News 2014-06-16 10:58:19
Veterans Website, IE 10 Users Targeted in Possible Attempt to Steal Military Secrets Web Hosting News 2014-02-14 13:36:54
SOE, UOL BoaCompra, Gamerica Partner to Bring Online Game PlanetSide 2 to Brazil Web Hosting News 2014-05-01 08:21:55


Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes
Postbit Selector

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off

Forum Jump
Login:
Log in with your username and password
Username:
Password:



Forgot Password?
Advertisement:
Web Hosting News:
WHT Membership
WHT Membership



 

X

Welcome to WebHostingTalk.com

Create your username to jump into the discussion!

WebHostingTalk.com is the largest, most influentual web hosting community on the Internet. Join us by filling in the form below.


(4 digit year)

Already a member?