Web Site Crawler

SiteMap Generation

On-Page SEO

IziSEO can help you find duplicate content across the pages of your website.

It is easy to configure this search: just go to Settings - Page and tick "Check for duplicate content":

Settings for checking duplicate content

Set the text percentage and enable the check for duplicate content

If any duplicate content is spotted, you'll see the number of pages containing it in the pink-colored cell in the "Duplicate Pages" column:

How duplicate content is displayed

Getting rid of duplicate content

Here are some tips on using IziSEO (or any other site integrity check tool) to identify pages with duplicate content:

  • Set the percentage of text which should be checked on each page. Google will reliably ignore anything below 10%, but perhaps you may wish to increase this value, especially if you have little text on your pages. This is applicable to online stores, catalogues, websites with lots of dynamically generated content etc.
  • Crawl the first 50 pages and see if any duplicate content is found across them. If you are using some sort of template for generating the content of each page (for example, if you have code that generates the header and footer, as well as some brief description and guidelines), then you'll quickly see if that template accounts for a significant part of your page. If IziSEO alerts duplicate content, consider redesigning this template or adding some unique content inside.
  • Analyze how much of the duplicate content consists of menu links, copyright notes, slogans etc. If they account for all of that content, then there's probably nothing to worry about. Google will normally frown upon big lumps of texts within one or more paragraphs that are consistently repeated on the pages of your website.
  • If you have identical pages with different URLs, mark one of them as canonical. E.g. if they can be accessed from different menus or shortcuts on the site, but they lead to the same article, put <link rel="canonical" href="/"> in the code of each duplicate page. The href attribute must lead to the same article that you appointed "canonical". More advise on this here.

This article covers finding duplicate content across one website, i.e. on internal pages. You might also be interested in checking if your website's content is excessively quoted elsewhere on the web. In that case here are great tools I'm using for detecting external duplicate pages:

  • Copyscape
  • Duplichecker
  • Plagium
  • Plagiarisma
  • Plagspotter


jackpot city casino
Copyright @ 2015 SoftFactum.com     27 Hillier Str., Sheung Wan, Hong Kong