Results 1 to 9 of 9
  1. #1
    Join Date
    Apr 2011

    Why Do All My Blog Posts Get Crawled So Fast By Google?

    Honestly, is it just me? Is this the norm? I'm finding, literally 3 minutes or so after publishing, my content get's crawled by Google and indexed.

    I'm talking about articles published for clients using the Wordpress platform. Not even 4 minutes ago, I published a post, with some links to other post and other related articles on the web and checked very shortly thereafter and there it is - this has been happening to me for a long time.

    Is it just my refined SEO setup with Wordpress? My sitemap generator plugin? The fact that I'm logged in to a Google account (not in same browser)? It couldn't be the cross posting cause on this particular post, I've turned off all cross-posting with the exception of the posts automatically being picked up by RSS Graffiti - and just now, a quick glance back at the client's Facebook page shows the post wasn't even picked up yet!

    I'm asking because every now and then I find posts of people asking questions like how long does it take for Google to crawl their pages, questions like that. I haven't had a problem with that for years.

    What gives? It Google just the quick page-crawling-speed-daemon on the net?
      0 Not allowed!

  2. #2
    Join Date
    Jun 2007
    Going to dig into this I do notice many days that we post any blog articles, it is typically always the highest entry page that date.
    Adam Piatek - CTO Ritmo Technology Group
    Dedicated Servers, Web Hosting Solutions Ventrilo Servers
    adam (at) ritmohost (dot) com
      0 Not allowed!

  3. #3
    Join Date
    Jul 2009
    I would assume that Google prioritizes based on links/pagerank. I've posted on my personal blog and had the #1 spot in Google literally about 30 seconds later. I've posted on some of my other blogs and had to wait a day for it to even come up.
    Sam Barrow - CEO @ SQUIDIX (1-855-SQUIDIX)
    Ask Us About Sponsoring Your Web Site (High Traffic Sites Only)
    Squidix - Shared, Reseller, Semi-Dedicated, Managed VPS and Managed Dedicated Hosting
    Midwestern Web - Web Design & Development Services
      0 Not allowed!

  4. #4
    Your blog is important for Google and Google indexes it fast. Google indexes sites according to their quality and if Google knows a site qualified, it will be indexed very fast. And your blog has this situation and its the reason. Some websites don't get index even after two days and it depends on what i said.
      0 Not allowed!

  5. #5
    In the cases of wordpress blog, fast indexing is possible. My blogs also index within 2-3 minutes after publishing new blog post. But in the case of static sites it takes time.
      0 Not allowed!

  6. #6
    Join Date
    Feb 2011
    Well i think this is a thing that could only make your day sunny.
    If one of your blogs is very well seen by Google that could make the serch engine crawl very fast the other.
    Especially this will happen if you have links between them
      0 Not allowed!

  7. #7
    Join Date
    Aug 2010
    Google uses RealTime to deliver up to the second results for queries. So, at least a part of the crawling process must be instantaneous. I assume they have algorithms for common words and phrases to reduce the enormous amount of data to some extent. When we write blog posts, we actually use few common words, without realizing it, and this simplifies the crawling and indexing processes.
    Lloyd Burrell
    Office Desk Reviews
      0 Not allowed!

  8. #8
    Join Date
    Feb 2007
    For blogs, especially the ones which get constantly updated with fresh materials, fast crawling and indexing are nothing surprising. As you know, blogs have an internal RSS pinging technology which would tell search engines and blog crawlers as soon as contents get updated and Google would be among first machines to visit them.

    Of course newly launched weblogs need to remain online for some time before search engines like Google get seriously interested in crawling them after every update.
      0 Not allowed!

  9. #9
    Google love blogs, new, orignal contents, update regularly, SEO-friendly structure, Google love all these elements. It's normal if you have shared original contents and updated your blog regularly for certain time. And why do you ask? It's a good thing for your website.
      0 Not allowed!

Similar Threads

  1. Replies: 30
    Last Post: 08-24-2010, 10:40 AM
  2. Do tags in blog posts help?
    By Blurple in forum SEO / SEM Discussions
    Replies: 13
    Last Post: 03-04-2010, 08:33 AM
  3. Replies: 2
    Last Post: 12-31-2009, 05:58 AM
  4. Posts without a Blog?
    By McJon in forum Web Design and Content
    Replies: 2
    Last Post: 03-20-2008, 09:50 PM
    By checknme in forum Domain Name Offers
    Replies: 3
    Last Post: 11-16-2003, 12:47 PM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts