{"id":8865,"date":"2011-12-12T16:29:07","date_gmt":"2011-12-12T16:29:07","guid":{"rendered":"http:\/\/www.smartinsights.com\/?p=8865"},"modified":"2011-12-12T16:29:07","modified_gmt":"2011-12-12T16:29:07","slug":"introduction-duplicate-content","status":"publish","type":"post","link":"https:\/\/www.smartinsights.com\/search-engine-optimisation-seo\/index-inclusion\/introduction-duplicate-content\/","title":{"rendered":"An introduction to duplicate content"},"content":{"rendered":"

5 DIY options for identifying duplicate content to improve SEO<\/h2>\n

\"\"<\/a>SEOs talk a lot about why duplicate content matters and what to do about it, marketers don't tend to.<\/p>\n

I think an understanding of duplicate content is important to all marketers who manage SEO so they can ask the right questions of their search specialists or agencies or fix the problem themselves. \u00a0So to help bridge the gap, this is first of two posts explaining what duplicate content is, why it matters and what to do about it.<\/p>\n

What is duplicate content<\/h2>\n

Duplicate content is where a search engine identifies different pages as similar. As a result it either doesn\u2019t include them in the index or down-weights their importance. So you may have pages that you think are unique and should attract visits, but the search engines don't see it that way and pages identified as duplicate content wont attract any visits - that's why they matter. The reason for this is that search engines like Google can crawl over one trillion URLs<\/a>, but they only want to store and rank the more relevant ones<\/p>\n

Duplicate content on your own site is usually the biggest SEO problem, but it can potentially be a problem where other websites are copying your content for their own gain (it can be innocent and most would not realise the potential impact).<\/p>\n

In this post I'll focus on identifying duplicate content on your own website. If you are concerned about your content been copied by others you can use services like CopyScape<\/a> to review that.<\/p>\n

How to review and manage duplicate content<\/span><\/p>\n

Google primarily identifies duplicate content through pages which have identical\/similar titles, description, headings and copy, so to start with you have to audit these.\u00a0You can use any of the following methods to help find potential duplicate content issues, the reality is that it will likely require several of them to do an effective job.<\/p>\n

Option 1. Use Google Webmaster Tools<\/strong><\/h3>\n

This is the best starting point. If you don't have a budget for SEO then site marketers can do this on their own.<\/p>\n

Once your site is verified within Google Webmaster Tools you can navigate down the left to diagnostics & then into\u00a0HTML suggestions where you will see a information on duplicate title \/ description tags through to those pages with long titles or descriptions.<\/p>\n

\"Google<\/a><\/p>\n

If you have duplicate page titles or meta descriptions as in this example you should review these to see whether the pages should be targeted uniquely.<\/p>\n

Option 2. Utilise the SEOmoz Tool kit<\/h3>\n

Use the SEOmoz tool to find duplicate content (you can take out subscription one month at a time for one-off tasks like this). Within the crawl diagnostics panel duplicate content will come up as an error in red, from here you can drill down into the issues and prioritse your work. The full crawl of your site can take up to 7days (depending on size etc) so please bear that in mind!<\/p>\n

Option 3. Utilise the Google \"site:\" command<\/h3>\n

Select sample generic or product keyphrases in quotes reviewing the site using the Google site: command. To create the screen shot below I typed the following into Google<\/p>\n

site:www.asos.com Ralph Lauren Rugby Top<\/a><\/em><\/p>\n

\"\"<\/a>From here you can identify if titles \/ descriptions are the same, you may also receive a message like below which means that Google has identified them as duplicate pages and has down graded them to its secondary index.<\/p>\n

\"error<\/a><\/p>\n

Option 4. Screaming SEO Frog \/ Xenu<\/h3>\n

I have mentioned these two tools a number of times in previous blog posts<\/a>. They are famed for their ability to report back broken links on your website but they also return information which once in Excel you can use to identify duplciate URL's, Titles & descriptions. Just by using the sort functions & the formula \"=A1=A2\" (swap column & row as required) you can easily see where there are potential issues. If the excel formula returns the value \"true\" then the two rows are identical & therefore a duplicate.<\/p>\n

Option 5. Google Analytics Data<\/span><\/p>\n

Another option is to review landing pages in web analytics that aren\u2019t receiving any natural visitors or their natural search traffic is low compared to other traffic across the page (sometimes called SEO inactive pages). To do this have an excel file with all your pages in, then apply an advance segment to your reports in Google Analytics so that it only includes traffic from organic search, compare the two reports to identify those pages which are not receiving organic traffic.<\/p>\n

Once you have identified duplicate content which should be attracting visitors but isn't the next task is to identify why this is happening and try to prevent it. That's the subject of my next post.<\/p>\n","protected":false},"excerpt":{"rendered":"

5 DIY options for identifying duplicate content to improve SEO SEOs talk a lot about why duplicate content matters and what to do about it, marketers don’t tend to. I think an understanding of duplicate content is important to all …..<\/p>\n","protected":false},"author":8,"featured_media":8927,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"_glsr_average":0,"_glsr_ranking":0,"_glsr_reviews":0,"footnotes":""},"categories":[634],"tags":[],"class_list":["post-8865","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-index-inclusion","srace-reach","advicetype-digital-marketing-software-reviews"],"acf":[],"yoast_head":"\nAn introduction to duplicate content | Smart Insights<\/title>\n<meta name=\"description\" content=\"An introduction to duplicate content 5 DIY options for identifying duplicate content to improve SEO SEOs talk a lot about why duplicate content matters and what to do about it, marketers.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.smartinsights.com\/search-engine-optimisation-seo\/index-inclusion\/introduction-duplicate-content\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"An introduction to duplicate content | Smart Insights\" \/>\n<meta property=\"og:description\" content=\"An introduction to duplicate content 5 DIY options for identifying duplicate content to improve SEO SEOs talk a lot about why duplicate content matters and what to do about it, marketers.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.smartinsights.com\/search-engine-optimisation-seo\/index-inclusion\/introduction-duplicate-content\/\" \/>\n<meta property=\"og:site_name\" content=\"Smart Insights\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/smartinsights\" \/>\n<meta property=\"article:published_time\" content=\"2011-12-12T16:29:07+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.smartinsights.com\/wp-content\/uploads\/2011\/12\/Duplicate-content.png\" \/>\n\t<meta property=\"og:image:width\" content=\"391\" \/>\n\t<meta property=\"og:image:height\" content=\"481\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Chris Soames\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@smartinsights\" \/>\n<meta name=\"twitter:site\" content=\"@smartinsights\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Chris Soames\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"4 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.smartinsights.com\/search-engine-optimisation-seo\/index-inclusion\/introduction-duplicate-content\/\",\"url\":\"https:\/\/www.smartinsights.com\/search-engine-optimisation-seo\/index-inclusion\/introduction-duplicate-content\/\",\"name\":\"An introduction to duplicate content | Smart Insights\",\"isPartOf\":{\"@id\":\"https:\/\/www.smartinsights.com\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.smartinsights.com\/search-engine-optimisation-seo\/index-inclusion\/introduction-duplicate-content\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/www.smartinsights.com\/search-engine-optimisation-seo\/index-inclusion\/introduction-duplicate-content\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.smartinsights.com\/wp-content\/uploads\/2011\/12\/Duplicate-content.png\",\"datePublished\":\"2011-12-12T16:29:07+00:00\",\"dateModified\":\"2011-12-12T16:29:07+00:00\",\"author\":{\"@id\":\"https:\/\/www.smartinsights.com\/#\/schema\/person\/86d23545d1f1dd891346229f6f3efabb\"},\"description\":\"An introduction to duplicate content 5 DIY options for identifying duplicate content to improve SEO SEOs talk a lot about why duplicate content matters and what to do about it, marketers.\",\"breadcrumb\":{\"@id\":\"https:\/\/www.smartinsights.com\/search-engine-optimisation-seo\/index-inclusion\/introduction-duplicate-content\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.smartinsights.com\/search-engine-optimisation-seo\/index-inclusion\/introduction-duplicate-content\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.smartinsights.com\/search-engine-optimisation-seo\/index-inclusion\/introduction-duplicate-content\/#primaryimage\",\"url\":\"https:\/\/www.smartinsights.com\/wp-content\/uploads\/2011\/12\/Duplicate-content.png\",\"contentUrl\":\"https:\/\/www.smartinsights.com\/wp-content\/uploads\/2011\/12\/Duplicate-content.png\",\"width\":391,\"height\":481},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.smartinsights.com\/search-engine-optimisation-seo\/index-inclusion\/introduction-duplicate-content\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.smartinsights.com\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"An introduction to duplicate content\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.smartinsights.com\/#website\",\"url\":\"https:\/\/www.smartinsights.com\/\",\"name\":\"Smart Insights\",\"description\":\"Digital Marketing > The Marketing Strategy Blog\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.smartinsights.com\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.smartinsights.com\/#\/schema\/person\/86d23545d1f1dd891346229f6f3efabb\",\"name\":\"Chris Soames\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.smartinsights.com\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/c0266f35071f2ce8113c6c5da473750f?s=96&d=identicon&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/c0266f35071f2ce8113c6c5da473750f?s=96&d=identicon&r=g\",\"caption\":\"Chris Soames\"},\"description\":\"Chris Soames is a Smart Insights blogger and consultant, he has worked in digital marketing for over 6 years with the last few years managing international web strategies for a leading travel brand. Now the Commercial Director at First 10, an Integrated marketing agency, he helps clients get clarity on their marketing strategy and create campaigns engineered to engage with their consumers to help drive sell-through. Most of all, Chris enjoys working with talented people who want to create great (& commercial) things not just tick boxes.\",\"sameAs\":[\"http:\/\/www.first10.co.uk\"],\"url\":\"https:\/\/www.smartinsights.com\/author\/chris-soames\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"An introduction to duplicate content | Smart Insights","description":"An introduction to duplicate content 5 DIY options for identifying duplicate content to improve SEO SEOs talk a lot about why duplicate content matters and what to do about it, marketers.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.smartinsights.com\/search-engine-optimisation-seo\/index-inclusion\/introduction-duplicate-content\/","og_locale":"en_US","og_type":"article","og_title":"An introduction to duplicate content | Smart Insights","og_description":"An introduction to duplicate content 5 DIY options for identifying duplicate content to improve SEO SEOs talk a lot about why duplicate content matters and what to do about it, marketers.","og_url":"https:\/\/www.smartinsights.com\/search-engine-optimisation-seo\/index-inclusion\/introduction-duplicate-content\/","og_site_name":"Smart Insights","article_publisher":"https:\/\/www.facebook.com\/smartinsights","article_published_time":"2011-12-12T16:29:07+00:00","og_image":[{"width":391,"height":481,"url":"https:\/\/www.smartinsights.com\/wp-content\/uploads\/2011\/12\/Duplicate-content.png","type":"image\/png"}],"author":"Chris Soames","twitter_card":"summary_large_image","twitter_creator":"@smartinsights","twitter_site":"@smartinsights","twitter_misc":{"Written by":"Chris Soames","Est. reading time":"4 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.smartinsights.com\/search-engine-optimisation-seo\/index-inclusion\/introduction-duplicate-content\/","url":"https:\/\/www.smartinsights.com\/search-engine-optimisation-seo\/index-inclusion\/introduction-duplicate-content\/","name":"An introduction to duplicate content | Smart Insights","isPartOf":{"@id":"https:\/\/www.smartinsights.com\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.smartinsights.com\/search-engine-optimisation-seo\/index-inclusion\/introduction-duplicate-content\/#primaryimage"},"image":{"@id":"https:\/\/www.smartinsights.com\/search-engine-optimisation-seo\/index-inclusion\/introduction-duplicate-content\/#primaryimage"},"thumbnailUrl":"https:\/\/www.smartinsights.com\/wp-content\/uploads\/2011\/12\/Duplicate-content.png","datePublished":"2011-12-12T16:29:07+00:00","dateModified":"2011-12-12T16:29:07+00:00","author":{"@id":"https:\/\/www.smartinsights.com\/#\/schema\/person\/86d23545d1f1dd891346229f6f3efabb"},"description":"An introduction to duplicate content 5 DIY options for identifying duplicate content to improve SEO SEOs talk a lot about why duplicate content matters and what to do about it, marketers.","breadcrumb":{"@id":"https:\/\/www.smartinsights.com\/search-engine-optimisation-seo\/index-inclusion\/introduction-duplicate-content\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.smartinsights.com\/search-engine-optimisation-seo\/index-inclusion\/introduction-duplicate-content\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.smartinsights.com\/search-engine-optimisation-seo\/index-inclusion\/introduction-duplicate-content\/#primaryimage","url":"https:\/\/www.smartinsights.com\/wp-content\/uploads\/2011\/12\/Duplicate-content.png","contentUrl":"https:\/\/www.smartinsights.com\/wp-content\/uploads\/2011\/12\/Duplicate-content.png","width":391,"height":481},{"@type":"BreadcrumbList","@id":"https:\/\/www.smartinsights.com\/search-engine-optimisation-seo\/index-inclusion\/introduction-duplicate-content\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.smartinsights.com\/"},{"@type":"ListItem","position":2,"name":"An introduction to duplicate content"}]},{"@type":"WebSite","@id":"https:\/\/www.smartinsights.com\/#website","url":"https:\/\/www.smartinsights.com\/","name":"Smart Insights","description":"Digital Marketing > The Marketing Strategy Blog","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.smartinsights.com\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/www.smartinsights.com\/#\/schema\/person\/86d23545d1f1dd891346229f6f3efabb","name":"Chris Soames","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.smartinsights.com\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/c0266f35071f2ce8113c6c5da473750f?s=96&d=identicon&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/c0266f35071f2ce8113c6c5da473750f?s=96&d=identicon&r=g","caption":"Chris Soames"},"description":"Chris Soames is a Smart Insights blogger and consultant, he has worked in digital marketing for over 6 years with the last few years managing international web strategies for a leading travel brand. Now the Commercial Director at First 10, an Integrated marketing agency, he helps clients get clarity on their marketing strategy and create campaigns engineered to engage with their consumers to help drive sell-through. Most of all, Chris enjoys working with talented people who want to create great (& commercial) things not just tick boxes.","sameAs":["http:\/\/www.first10.co.uk"],"url":"https:\/\/www.smartinsights.com\/author\/chris-soames\/"}]}},"_links":{"self":[{"href":"https:\/\/www.smartinsights.com\/wp-json\/wp\/v2\/posts\/8865","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.smartinsights.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.smartinsights.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.smartinsights.com\/wp-json\/wp\/v2\/users\/8"}],"replies":[{"embeddable":true,"href":"https:\/\/www.smartinsights.com\/wp-json\/wp\/v2\/comments?post=8865"}],"version-history":[{"count":0,"href":"https:\/\/www.smartinsights.com\/wp-json\/wp\/v2\/posts\/8865\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.smartinsights.com\/wp-json\/wp\/v2\/media\/8927"}],"wp:attachment":[{"href":"https:\/\/www.smartinsights.com\/wp-json\/wp\/v2\/media?parent=8865"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.smartinsights.com\/wp-json\/wp\/v2\/categories?post=8865"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.smartinsights.com\/wp-json\/wp\/v2\/tags?post=8865"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}