Results 1 to 8 of 8
  1. #1
    Join Date
    Mar 2005

    Implications of hundreds of near-identical pages

    Hello all,

    Our company has around half a million products which will be on our new site. Each one can be represented by it's own page / URL.

    However, many products are near-identical to others - they form part of a 'family', with minor variation in detail from one to the next.
    For example we could have say 200 products, with 20 fields, all identical apart from a different SKU and maybe one field with a different value.
    We can't present these in any other way than as individual products.

    Does anyone know if there are possible problems with search engines - e.g could this be seen as possible index spamming?

    And if so, what could we do so as not to be penalised?
    Last edited by KatDog; 11-06-2009 at 11:28 AM. Reason: typo

  2. #2
    As far as I know, the real penalty for duplicated content comes into play when content is copied between two different domains. For instance, has 10+ paragraphs of content that is exactly the same as what is seen on In any case, check out this post from Google on their Webmaster Central Blog, it demystifies the 'duplicate content penalty'.

    100% White-Label Branded Online Backup Reseller Program
    Windows / Mac / Linux / FreeBSD / Solaris / Novell
    Call Now! 1-800-213-2157 sales (at)

  3. #3
    Join Date
    Mar 2005
    Thanks for that, will check it out.

  4. #4
    Join Date
    Nov 2006
    Karachi, Pakistan
    KatDog basically don't use dynamic URLs. Use URLs with query strings in them and google will not penalise you.

  5. #5
    Join Date
    Sep 2009
    If the pages look identical or near identical, Google will likely simply choose to serve only one version. The main "penalty" is that the PageRank/importance is spread out among near duplicate pages that Google is unlikely to serve. It's better to concentrate such traffic/links/PageRank.

    If you can't consolidate the near identical pages, I see a couple options.

    (1) Differentiate the pages more. Make sure the differentiation appears in the meta description of the page and near the beginning to the HTML body content, or near keywords users are likely to use to search for that product. Make it obvious to users and robots how near-duplicate pages differ.

    (2) If the differentiation is more for internal purposes and isn't relevant to users, a better approach might be to use canonical meta tags. This tells robots that multiple pages should be indexed as one.

  6. #6
    Join Date
    Mar 2005
    Excellent, thanks Memidex. (1) will be done partly as a matter of course and partly by the nature of the content, so that's fine. I'll look at the canonical tag - must admit that's a new one on me - looks promising. Cheers again.

  7. #7
    Join Date
    Mar 2005
    If you have plenty of near-equal pages, I'd suggest you take a look at the nearly new tag called Canonical and use it accordingly.
    DuplikaHosting en Argentina made with love
    Trusted by more than 4000 customers since 2005.

  8. #8
    I think the title tag is the most important factor and try to make them different using the variants of your main keywords or include your SKU there. This practice would help your site in on-page SEO, too.

    Wish this help,
    Men, women and kids air jordan shoes,
    air jordan fusion shoes shop online.

Similar Threads

  1. __Can i Use/produce 400 'Identical' Content pages on my site ??
    By eyes2005 in forum Web Design and Content
    Replies: 3
    Last Post: 03-31-2007, 09:18 AM
  2. Replies: 2
    Last Post: 09-07-2005, 04:03 PM
  3. Search Engines and Identical Pages
    By BigBison in forum Web Design and Content
    Replies: 6
    Last Post: 08-01-2005, 06:12 AM
  4. Pages should be identical
    By MDColson in forum Programming Discussion
    Replies: 1
    Last Post: 12-14-2004, 10:06 PM
  5. Weird GIf size changes in identical pages!
    By kenfused in forum Programming Discussion
    Replies: 4
    Last Post: 08-20-2003, 05:33 PM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts