Datamob: datasets

Koblenz Network Collection (KONECT)

Mon, 30 Jan 2012 19:39:22 -0500

The Koblenz Network Collection (KONECT) is a project to collect large network datasets of all types in order to perform research in the area of network mining. Data sources include Twitter, Flickr, Digg, Amazon, Prosper, Netflix and Wikipedia. Collected by the Institute of Web Science and Technologies of the University of Koblenz–Landau.

By Jérôme Kunegis.

url: http://konect.uni-koblenz.de/

Farmers' Market API

Sun, 20 Nov 2011 22:46:34 -0500

Programmatic access to information about all the farmers' markets in the United States, via the USDA.

By Code for America fellow John Mertens.

url: http://codeforamerica.org/2011/08/08/farmers-market-api/

Open State Project

Sun, 23 Jan 2011 19:39:32 -0500

The Open State Project collects and makes available data about U.S. state legislative activities, including bill summaries, votes, sponsorships, legislators and committees. This data is gathered directly from the states and made available in a common format for interested developers, through a RESTful API and regular data dump.

A project of Sunlight Labs.

url: http://openstates.sunlightlabs.com/

Stanford Large Network Dataset Collection

Sun, 12 Dec 2010 10:30:40 -0500

A collection of large network datasets: social networks, web graphs, road networks, internet networks, citation networks, collaboration networks and communication networks.

Includes data from Slashdot, Epinions, LiveJournal, Wikipedia, Amazon, Twitter and MemeTracker.

Posted as examples for use with the Stanford Network Analysis Platform (SNAP).

url: http://snap.stanford.edu/data/index.html

Daily Global Weather Measurements, 1929-2009

Sun, 12 Dec 2010 09:34:22 -0500

A collection of daily weather measurements (temperature, wind speed, humidity, pressure, &c.) from 9000+ weather stations around the world.

Data originally collected as part of the Global Surface Summary of Day (GSOD) by the National Climactic Data Center (NCDC). Collected and transformed by Infochimps.org.

url: http://aws.amazon.com/datasets/2759/185-0886336-5629151

Reddit Article Voting Data Donated by Users

Tue, 16 Nov 2010 22:57:25 -0500

Article voting data from social news site Reddit, donated by 40,000 users.

Compiled by David King of Reddit.

Unofficial Hacker News API

Sun, 26 Sep 2010 17:44:49 -0400

Programmatic access to Hacker News stories, comments and votes. Originally developed for iHackerNews, a mobile version of Hacker News. Returns data in JSON; JSONP and XML coming soon.

By Ronnie Roller.

url: http://api.ihackernews.com/

FCC License View API and Dataset

Sun, 26 Sep 2010 17:15:02 -0400

The FCC issues licenses for use of the United States' airwaves and other purposes. The FCC License View API provides snapshots such as the number of licenses across different services, how many licenses different entities have, and how many licenses are up for renewal in the near future.

Sample call:

http://data.fcc.gov/api/license-view/basicSearch/getLicenses?searchValue=Verizon%20Wireless&format=jsonp&callback=?

The complete set of data in the License View database is also available for download.

url: http://reboot.fcc.gov/developer/license-view-api

Consumer Broadband Test API

Sun, 26 Sep 2010 17:05:12 -0400

Returns the Consumer Broadband Test speed test statistics for a U.S. County given the passed Latitude and Longitude. The statistics are grouped into wireline and wireless and are the number of tests, average download speed, average upload speed, maximum download speed and maximum upload speed. This data is calculated nightly and includes all tests to date performed through the consumer broadband test.

From the Federal Communications Commission.

url: http://reboot.fcc.gov/developer/consumer-broadband-test-api

Facebook Dataset

Wed, 22 Sep 2010 21:01:49 -0400

This is a dataset collected during April-May 2009. It contains the following two representative samples of Facebook users with a few annotated properties:

- MHRW: A sample of 957,000 unique users obtained Facebook-wide by Metropolis-Hastings random walks, which is shown to closely approximate the ground truth.

- UNI: A uniform sample of 984,000 unique users that represents the ground truth. User IDs were selected uniformly at random from the platform's 32-bit ID space—essentially a rejection sampling procedure.

For each dataset, we release two files. The first file contains for each sampled user ID, the number of times the user was sampled and the user IDs of his/her friends. The second file contains additional node properties for each sampled user. For each sampled user ID we have the number of times sampled, the total number of friends, privacy settings and network membership. User IDs and network IDs are anonymized.

Submitted by Minas Gjoka

url: http://odysseas.calit2.uci.edu/wiki/doku.php?id=public:online_social_networks#available_datasets