Scraper site: Difference between revisions
m Properly spelled snippets |
Emir Pilavdzic please stop spamming wikipedia by promoting your sites. |
||
Line 23: | Line 23: | ||
Scrapers tend to be associated in the mind with [[link farm]]s and are sometimes perceived as the same thing. |
Scrapers tend to be associated in the mind with [[link farm]]s and are sometimes perceived as the same thing. |
||
== External links == |
|||
* [http://www.adsblacklist.com/ AdsBlackList.com] — attempts to filter MFA websites by generating a collaborative list. |
|||
{{Spamming}} |
{{Spamming}} |
Revision as of 11:09, 9 November 2006
A scraper site is a website that pulls all of its information from other websites using web scraping. In essence, no part of a scraper site is original. A search engine is an example of a scraper site. Sites such as Yahoo and Google scrape content from other websites and index the content so you can search the index by keywords. Search engines then display snippets of the original site content which they have scraped in response to your search.
In the last few years, and due to the advent of the Google Adsense publishing plan, scraper sites have proliferated at an amazing rate for spamming search engines. Sites like Wikipedia are frequently one of the sources of material for scraper sites.
Made for AdSense
Some scraper sites are created for monetizing the site using advertising programs such as Google AdSense. In such case, they are called Made for AdSense sites or MFA. This is also a derogatory term used to refer to websites that have no redeeming value except to get web visitors to the website for the sole purpose of clicking on advertisements.
The problem with Made for AdSense sites is they are considered sites that are spamming search engines and diluting the search results by providing surfers with less than satisfactory search results. The scraped content is considered redundant to that which would be shown by the search engine under normal circumstances had no MFA website been found in the listings.
These types of websites are being eliminated in various search engines and sometimes show up as supplemental results instead of being displayed in the initial search results.
Legality
Because scraper sites take content from other sites without the permission of the original creators, they frequently violate copyright law. It is illegal to republish copyrighted material without the copyright holder's permission. This applies regardless of whether the material was originally published on a blog, a mailing list, or any other less-formal medium, just as much as if it were commercially published.
Even taking content from an open content site can be a copyright violation, if done in a way which does not respect the license. For instance, the GNU Free Documentation License (GFDL) and Creative Commons ShareAlike (CC-BY-SA) licenses require that a republisher inform readers of the license conditions, and give credit to the original author. Most scraper sites which copy GFDL- or CC-BY-SA-licensed content do not do this, and therefore are infringing copyright law.
Techniques
Many scrapers will pull snippets and text from websites that rank high for keywords they have targeted. This way they hope to rank highly in the SERPs (Search Engine Results Pages). RSS feeds are vulnerable to scrapers.
Some scraper sites consist of advertisements and paragraphs of words randomly selected from a dictionary. Often a visitor will click on an advertisement because it is the only comprehensible text on the page. Operators of these scraper sites gain financially from these clicks. Ad networks such as Google AdSense are constantly working to remove these sites from their programs.
Scrapers tend to be associated in the mind with link farms and are sometimes perceived as the same thing.