{"id":43,"date":"2011-06-18T01:01:44","date_gmt":"2011-06-18T01:01:44","guid":{"rendered":"http:\/\/www.marketerscenter.com\/blog\/?p=43"},"modified":"2023-04-13T07:18:52","modified_gmt":"2023-04-13T07:18:52","slug":"how-to-bulk-plagarism-check-your-site-and-deal-with-content-scrapers","status":"publish","type":"post","link":"https:\/\/www.marketerscenter.com\/blog\/how-to-bulk-plagarism-check-your-site-and-deal-with-content-scrapers\/","title":{"rendered":"How to Bulk Plagiarism Check Your Site and Deal with Content Scrapers"},"content":{"rendered":"

Every night before I go to bed, I brush my teeth, pray to the mighty gods of SEO, and then usually read the latest happenings on the Google Panda update. A few of my favorite sites were affected by Panda and this mishap has been the center of my attention for the past 2 months.<\/p>\n

A recent thread I found questioned the connection between the Panda slap and scrapers reposting dupe content (Are DMCAs the Answer to Panda?<\/a>). This thread poses an interesting question: Could you be getting punished because someone stole your content?<\/p>\n

It’s a scary thought but some are coming to the conclusion that this just might be the case. For some people, their websites hardest hit by Panda are also the ones most scraped and plagiarised.<\/p>\n

I wanted to check out if that was the case for me. Could my fitness blog hit hard by Panda just be a victim of hardcore copyright infringement?<\/p>\n

Scaling the Plagiarism Checking<\/h2>\n

After fumbling around with Copyscape for, oh I don’t know, 3 minutes – I realized this just isn’t going to work.<\/p>\n

I needed to find a better solution, something that could check my websites in BULK.<\/p>\n

I eventually came on this thread @ BHW: Check for Duplicate Content in Bulk<\/a><\/p>\n

After reading the above post on there I downloaded the freeware Uncover<\/a> made by textbroker.<\/p>\n

Uncover: A Free Tool for Finding Duplicate Content in Bulk<\/h2>\n

Basically, you can point Uncover to your sitemap or archives page and it will grab all the links on the page. You can even go several levels deep (more than 1) but I don’t recommend doing this. It will collect a bunch of URLs that you don’t need checked (like feed URLs and plugin URLs) and will make the checking a lot slower.<\/p>\n

After it has grabbed all the URLs you want checked, you can click the button, and off it goes. This runs on your computer, and depending on how many articles you’ve got, it should be done within 10-20 minutes or so.<\/p>\n

After it’s complete, you can go through each URL checked one by one and it gives a little list of potential copies, how many words are copied, and what percentage you’re copied.<\/p>\n

An interesting detail about this program is that it seems to work even better than Copyscape itself. I cross-referenced the dupe content it was spitting out with Copyscape and it was picking up MAJOR copies that Copyscape wasn’t even reporting. Pretty interesting considering Copyscape seems to be the standard in the industry and not reporting on 80% copied articles is a bit alarming.<\/p>\n

My Results from Using Uncover for Just 10 Minutes<\/h2>\n

Only after checking the first 5 posts, I came across a user that was set up about 3 years ago on Zimbio to scrape several of my blogs at a time using the auto-import feature. It was taking posts the very day they were published off a lot of my blogs and slapping them up there.<\/p>\n

Same with a feed site I found.<\/p>\n

What kind of effect this could have on my sites, I’m not sure, but it certainly can’t be healthy. A couple of support e-mails and I’m sure the problem will be taken care of.<\/p>\n

Usually, I am just focused on building links and content, not protecting what I’ve already done. I guess it’s understandable that it’s taken me this long to catch these CONTENT OFFENDERS.<\/p>\n

There are a couple of other random sites I found copying my exercise site’s content, I think a DMCA notice or two should do the trick here.<\/p>\n

Filing DMCAs and Releasing the Dogs<\/h2>\n

This is the step I’m currently at.<\/p>\n

File a DMCA with this link.<\/a><\/p>\n

Here is the click path:<\/p>\n