Home > slashdot > Facebook Kills Dataset of Crawled Public Profiles

Facebook Kills Dataset of Crawled Public Profiles

March 31st, 2010 03:19 admin Leave a comment Go to comments

holy_calamity writes “Internet entrepreneur Pete Warden wrote a crawler that collated the public profiles of 210 million Facebook profiles and was set to release an anonymised version to researchers. The pages crawled can be read by any web user, and the robots.txt did not forbid crawling. However, Facebook claimed he had violated its terms of service and threatened legal action. Fearing costs, Warden has now destroyed his dataset. For a snapshot of the insights that data could have allowed, see Warden’s post on how the friend networks of the 120 million US users in his data segregated into seven clusters.” Of course, if he had it, this means anyone who wants it made their own version of this.

Source: Facebook Kills Dataset of Crawled Public Profiles

Related Articles:

  1. Facebook Crawler Speaks Back
  2. Drawing Inspiration From Facebook, Google Revamps Public User Profiles
  3. Dating Site Creates Profiles From Public Records
  4. Huge Site Ranking Dataset Donated to the Common Crawl Foundation
  5. ‘Dating’ Site Imports 250k Facebook Profiles
blog comments powered by Disqus