hosted by liquidweb


Go Back   Web Hosting Talk : Web Hosting Main Forums : SEO / SEM Discussions : Problem - Robots.txt appearing in SEPRs
Reply

Forum Jump

Problem - Robots.txt appearing in SEPRs

Reply Post New Thread In SEO / SEM  Discussions Subscription
 
Send news tip View All Posts Thread Tools Search this Thread Display Modes
  #1  
Old 11-04-2011, 04:44 AM
webaholic webaholic is offline
Junior Guru Wannabe
 
Join Date: May 2011
Location: Kolkata
Posts: 37
Exclamation

Problem - Robots.txt appearing in SEPRs


Hi,

I have seen recently robots.txt for my site & one from my blog (Blogger custom domain) is appearing in SERPs (snapshots attached). I have no idea how did this happen. I have never placed the robots.txt link to any forum or other sites. Whereas I often use these free online website analysis tools like websitegrader.com/woorank.com which may checks robots file while analyzing.

I am not sure, but I hope using url removal tool in Google Webmaster Tools won't be a good idea. What I can do to fix this? Do I really need to care about this?

Thanks,
Jim
Attached Thumbnails
Click image for larger version

Name:	webaholic-robots.jpg
Views:	67
Size:	29.2 KB
ID:	20623   Click image for larger version

Name:	webaholic-blogger-robots.jpg
Views:	64
Size:	29.1 KB
ID:	20624  



Sponsored Links
  #2  
Old 11-04-2011, 04:51 AM
lynxus lynxus is offline
Lord of live chats
 
Join Date: Jul 2009
Location: UK
Posts: 1,262
What on earth were you searching for?

I wouldn't care tbh..
Pretty much every site has that file, so its no secret that its there ( you wont need to link to it as google looks for it anyway )

Why its being indexed is odd mind you.. But IMO it doesnt really matter.

__________________
Live chat software -> IMsupporting.com
Increase Sales Today - 100% No Strings Free Trial

  #3  
Old 11-04-2011, 09:52 AM
webaholic webaholic is offline
Junior Guru Wannabe
 
Join Date: May 2011
Location: Kolkata
Posts: 37
Quote:
Originally Posted by lynxus View Post
What on earth were you searching for?
Hope you have probably came across this "site:yourdomain.com". It tells you how many pages of yours is indexed by Google. This is something on earth which almost every webmaster wants to know.

Sponsored Links
  #4  
Old 11-04-2011, 09:56 AM
lynxus lynxus is offline
Lord of live chats
 
Join Date: Jul 2009
Location: UK
Posts: 1,262
I only asked because I tried that, along with the filetype tags to narrow my search down however robots.txt doesn't appear for any domain i look at.

Very strange.

id personally raise the question on googles own forums.. You have more of a chance of getting it fixed if it is a bug. ( ive had many things tweaked by admins due to issues with GWT and other systems they run.. )

__________________
Live chat software -> IMsupporting.com
Increase Sales Today - 100% No Strings Free Trial

  #5  
Old 11-08-2011, 03:00 AM
sijugk sijugk is offline
Newbie
 
Join Date: Feb 2010
Posts: 21
Quote:
Originally Posted by webaholic View Post
Hi,

I have seen recently robots.txt for my site & one from my blog (Blogger custom domain) is appearing in SERPs (snapshots attached) Do I really need to care about this?

Thanks,
Jim
Strange!!! I do not think you really need to care it. If I am you, I won't take any effort to remove it from google index list.

__________________
Internet Tech | Free Article Submission

  #6  
Old 11-10-2011, 09:57 AM
jonathan cole jonathan cole is offline
Junior Guru Wannabe
 
Join Date: Feb 2011
Posts: 83
There is no any problem if it has been index by search engine let it be. If you have placed some thing in your directory it must be indexed.

  #7  
Old 11-16-2011, 05:33 PM
nicoweb nicoweb is offline
Newbie
 
Join Date: Nov 2011
Location: Leicester
Posts: 15
I have never seen that before just make sure that there are no links pointing to the robots.txt file and your robots.txt hasn't been included in your sitemap by accident.

Reply

Similar Threads
Thread Thread Starter Forum Replies Last Post
Need help with robots.txt 2399Skillz SEO / SEM Discussions 4 08-09-2011 07:59 AM
Directing Robots With Robots.txt Nullified Web Design and Content 0 02-27-2005 12:12 PM
what is robots.txt ? constantine Programming Discussion 1 01-13-2005 02:56 PM
Robots.txt Naresh Web Design and Content 3 08-26-2004 02:44 PM
robots.txt do you have them? Postmaster Web Design and Content 7 07-17-2004 09:03 AM

Related posts from TheWhir.com
Title Type Date Posted
Outbound Spam Causing Sleepless Nights? Blog 2013-05-13 09:52:21
Cloud Expo Europe 2013 Web Hosting Events 2012-12-05 14:26:07
Blog Topics for Web Hosts Blog 2012-08-28 15:41:43
How To Deliver Products Customers Will Pay For with David Koston - HostingCon 2012 Web Hosting News 2012-07-18 10:46:16
HostingCon Preview: Q&A with David Koston of Fortuity LLC Web Hosting News 2012-07-10 12:54:20


Tags
google, robots.txt, serps

Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes
Postbit Selector

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off

Forum Jump
Login:
Log in with your username and password
Username:
Password:



Forgot Password?
Advertisement:
Web Hosting News:



 

X

Welcome to WebHostingTalk.com

Create your username to jump into the discussion!

WebHostingTalk.com is the largest, most influentual web hosting community on the Internet. Join us by filling in the form below.


(4 digit year)

Already a member?