Datamob: media

Reddit Article Voting Data Donated by Users

Tue, 16 Nov 2010 22:57:25 -0500

Article voting data from social news site Reddit, donated by 40,000 users.

Compiled by David King of Reddit.

Unofficial Hacker News API

Sun, 26 Sep 2010 17:44:49 -0400

Programmatic access to Hacker News stories, comments and votes. Originally developed for iHackerNews, a mobile version of Hacker News. Returns data in JSON; JSONP and XML coming soon.

By Ronnie Roller.

url: http://api.ihackernews.com/

Reddit Article Voting Data

Sat, 15 May 2010 05:22:51 -0400

Article voting data from social news site Reddit.

"The dump is 29MB gzip compressed and contains 7,405,561 votes from 31,927 users over 2,046,401 links. It contains votes only from users with the preference "make my votes public" turned on (which is not the default)."

Compiled by David King of Reddit.

url: http://www.reddit.com/r/redditdev/comments/bubhl/csv_dump_of_reddit_voting_data/

Cornell Movie Review Data

Sun, 18 Apr 2010 10:54:10 -0400

A collection of movie-review datasets for use in sentiment-analysis experiments. Movie review documents are labeled with respect to their overall sentiment polarity (positive or negative) or subjective rating (e.g., "two and a half stars"), and sentences labeled with respect to their subjectivity status (subjective or objective) or polarity.

Compiled by Bo Pang and Lillian Lee.

url: http://www.cs.cornell.edu/people/pabo/movie-review-data/

Slashdot Zoo

Wed, 17 Mar 2010 12:58:13 -0400

The social network of Slashdot.org, consisting of "friend" and "foe" relations among 78,000 users of the site. Extracted between May 2008 and February 2009.

Submitted by Jérôme Kunegis

url: http://www.dai-labor.de/en/competence_centers/irml/datasets/the_slashdot_zoo/

Music Recommendation Datasets

Sat, 27 Feb 2010 09:37:26 -0500

Two datasets created using the Last.fm API. One dataset is comprised of information about around 360,000 Last.fm users, including basic profile information and artist playcount per user. An additional dataset containing the entire listening history for 1,000 Last.fm users is forthcoming.

Compiled by Oscar Celma.

url: http://denoiserthebetter.posterous.com/music-recommendation-datasets

Delicious Folksonomy Dataset: September 2009

Sat, 27 Feb 2010 09:20:30 -0500

Dataset comprised of 1.25 million Delicious bookmarks, retrieved in September 2009.

Compiled by Arvind Narayanan.

url: http://arvindn.livejournal.com/116137.html

Delicious Folksonomy Dataset: 2007-2008

Tue, 23 Feb 2010 20:38:16 -0500

This dataset contains all public bookmarks and associated tag assignments of about 950,000 Delicious users, retrieved between December 2007 and April 2008. The full corpus is about 7GB of compressed data and is one of the largest folksonomy datasets used in research so far. See this post and this publication for more details on how it's been used.

Compiled by Robert Wetzker.

url: http://robertwetzker.com/2009/06/25/delicious-dataset-for-download/

Social Media Datasets

Tue, 23 Feb 2010 20:26:48 -0500

Datasets from Flickr, Twitter, YouTube, Delicious, Digg and Engadget. Compiled by Munmun De Choudhury.

Available for research purposes under a Creative Commons Attribution-Noncommercial 3.0 United States License.

url: http://www.public.asu.edu/~mdechoud/datasets.html

Social Tagging of Wikipedia Articles

Wed, 17 Feb 2010 22:37:36 -0500

Wiki10+ is a dataset created during April 2009 with data retrieved from Delicious and the English Wikipedia. It contains 20,764 unique URLs of English Wikipedia articles and their corresponding annotations on Delicious.

Available for research purposes. Compiled by Arkaitz Zubiaga.

url: http://nlp.uned.es/social-tagging/wiki10+/

DeliciousT140 Dataset

Wed, 17 Feb 2010 22:26:58 -0500

DeliciousT140 is a dataset created during June 2008 with data retrieved from the social bookmarking site Delicious and the web. It contains 144,574 unique URLs, all of them with their corresponding social tags retrieved from Delicious. This set of documents is annotated with 67,104 different tags.

Available for research purposes. Compiled by Arkaitz Zubiaga.

url: http://nlp.uned.es/social-tagging/delicioust140/

Social Bookmarking Data

Wed, 17 Feb 2010 22:20:04 -0500

Social-ODP-2k9 is a dataset created during December 2008 and January 2009 with data retrieved from Delicious and StumbleUpon, the Open Directory Project and the web. It contains 12,616 unique URLs along with their corresponding social annotations:

- Number of users annotating it, from Delicious

- Top 10 list of tags, from Delicious

- Full Tag Activity (FTA), from Delicious

- Notes, from Delicious

- Reviews, from StumbleUpon

- URL category, from the Open Directory Project

Available for research purposes. Compiled by Arkaitz Zubiaga.

url: http://nlp.uned.es/social-tagging/socialodp2k9/

Chronicling America API

Fri, 30 Oct 2009 21:43:49 -0400

Open programmatic access to information about historic American newspapers (1690-present) and select digitized newspaper pages (1880-1922). Returns results in Atom or Linked Data via RDF. Searching newspaper pages is also possible via OpenSearch. No API key or registration needed.

Sponsored jointly by the National Endowment for the Humanities and the Library of Congress as part of the National Digital Newspaper Program (NDNP).

url: http://chroniclingamerica.loc.gov/about/api/

Wikipedia Page Traffic Statistics

Sun, 26 Jul 2009 11:04:18 -0400

A 320 GB sample of the data used to power Trending Topics, containing 7 months of hourly page traffic statistics for over 2.5 million Wikipedia articles along with the associated Wikipedia content, linkgraph and metadata. Compiled by Peter Skomoroch.

All text content, statistics and link data is licensed under the GNU Free Documentation License (GFDL).

url: http://developer.amazonwebservices.com/connect/entry.jspa?externalID=2596

The New York Times Best Sellers API

Sat, 09 May 2009 19:56:51 -0400

Access data from all New York Times best-seller lists including rank history for specific best sellers. Four request types are available: get a best-seller list, search best-seller lists, get the history of a best seller and get the names of Times best-seller lists.

url: http://developer.nytimes.com/docs/best_sellers_api

thingISBN

Sat, 09 May 2009 11:31:35 -0400

thingISBN is a simple API for discovering related editions from LibraryThing, which calls it a tool for "edition disambiguation." Give it an ISBN and it returns a list of other ISBNs—different formats, translations, and more in XML.

The entire dataset is also available in one feed at http://www.librarything.com/feeds/thingISBN.xml.gz.

For more information see the thingISBN category on the Thingology blog.

url: http://www.librarything.com/thingology/2006/06/introducing-thingisbn_14.php

Discogs API

Sun, 05 Apr 2009 19:40:22 -0400

RESTful API for the Discogs community-built database of music information. Artist, label and release data is made available through a public domain license.

url: http://www.discogs.com/help/api

The New York Times Article Search API

Sun, 01 Mar 2009 09:12:13 -0500

The NYT Article Search API provides searchable access to nearly three million New York Times articles from 1981 to the present day. Results returned in JSON.

url: http://developer.nytimes.com/docs/article_search_api?authChecked=1

outside.in API

Tue, 11 Nov 2008 06:38:31 -0500

The Outside.in API lets you easily integrate hyperlocal news in your sites and applications by providing recent news stories and blog posts for any neighborhood, ZIP code, city, or state in the United States in JSON.

url: http://developers.outside.in

The New York Times Movie Reviews API

Sat, 01 Nov 2008 18:46:13 -0400

Programmatically access over 22,000 New York Times movie reviews dating back to 1924. Data available in JSON, XML or serialized PHP. Registration required.

See the announcement on Open for more information.

url: http://developer.nytimes.com/docs/movie_reviews_api

Songs Sampled in Girl Talk's 'Feed the Animals'

Sun, 14 Sep 2008 20:59:10 -0400

Information about the 264 samples used in Girl Talk's Feed the Animals album, along with a few visualizations. CSV format. By Andy Baio.

url: http://waxy.org/2008/09/girl_turk/

LibraryThing Web Services API

Tue, 05 Aug 2008 23:21:56 -0400

RESTful XML-based API for querying the LibraryThing Common Knowledge database of interesting facts about books. Developer key required. Creative Commons Attribution-Share Alike 3.0 license.

See the announcement on LibraryThing for more information.

See also the LibraryThing Books API.

url: http://www.librarything.com/services/webservices.php

Comprehensive Knowledge Archive Network (CKAN) API

Wed, 30 Jul 2008 21:54:07 -0400

RESTful API for querying the Comprehensive Knowledge Archive Network's database of "open knowledge" packages and projects.

url: http://www.ckan.net/api/rest/

BBC Backstage: Feeds & APIs

Fri, 18 Jul 2008 22:28:20 -0400

BBC TV and radio data, programme catalogue information, search API and more. Available for non-commercial use with attribution.

url: http://backstage.bbc.co.uk/data/Data

NPR API

Fri, 18 Jul 2008 19:16:19 -0400

Query an archive of National Public Radio content dating back to 1995. Returns results in RSS, MediaRSS, JSON, Atom and custom NPRML formats.

See the announcement on NPR.org for more information.

url: http://www.npr.org/api/

LibraryThing Books API

Tue, 15 Jul 2008 19:12:15 -0400

JSON-based API for LibraryThing book data. Licensing is still being finalized.

url: http://www.librarything.com/blog/2008/07/introducing-librarything-books-api.php

Freebase Data Dumps

Sat, 12 Jul 2008 02:06:28 -0400

Full data dumps of the Freebase shared database of the world's knowledge. Available in tab-separated values format and a low-level link export suitable for converting into RDF or XML. Creative Commons Attribution license.

See also: Freebase API and Freebase Wikipedia Extraction (WEX).

url: http://download.freebase.com/datadumps/

U.S. Copyright Renewal Records

Sun, 29 Jun 2008 16:25:17 -0400

U.S. copyright renewal records, downloadable as a single XML file. By Google software engineer Jarkko Hietaniemi. Public domain.

url: http://booksearch.blogspot.com/2008/06/us-copyright-renewal-records-available.html

BookMooch API

Thu, 19 Jun 2008 08:08:18 -0400

Query or download the database for BookMooch, a book exchange community. ASCII text and XML formats. Creative Commons Attribution-Noncommercial-Share Alike 3.0 License.

url: http://bookmooch.com/api/

Star Wars Kid Data Dump

Sun, 25 May 2008 22:01:05 -0400

Data from Waxy.org's server logs concerning the initial spread of the Star Wars Kid viral video in 2003. Public domain.

url: http://waxy.org/2008/05/star_wars_kid_the_data_dump/

Open Library API

Sat, 24 May 2008 21:33:54 -0400

Query the Open Library database, the goal of which is to provide one web page for every book ever published.

url: http://openlibrary.org/dev/docs/api

Amazon ISBN Similarity Graph

Mon, 05 May 2008 00:36:18 -0400

Output of a crawl of Amazon.com's item similarity API from January 18, 2008 for ISBNs (International Standard Book Numbers). ASCII text and XML. By Aaron Swartz.

url: http://www.archive.org/details/amazon_similarity_isbn/

Stanford Copyright Renewal Database

Wed, 30 Apr 2008 22:11:28 -0400

Downloadable dataset of 250,000 records on U.S. copyright renewal for books published between 1950 and 1995.

url: http://collections.stanford.edu/copyrightrenewals/bin/page?forward=home

Metafilter Infodump

Wed, 23 Apr 2008 07:35:55 -0400

Collection of data culled from the Metafilter community weblog database: stats on Metafilter posts, comments, tags, favorites and users. ASCII text.

url: http://stuff.metafilter.com/infodump/

Network Datasets Compiled by Mark Newman

Mon, 14 Apr 2008 19:05:56 -0400

A collection of network datasets drawn from studies of human social networks, dolphin social networks, works of literature, power grids, books, blogs and more. Compiled by Mark Newman, professor of physics at the University of Michigan.

url: http://www-personal.umich.edu/~mejn/netdata/

White Glove Tracking Dataset

Tue, 08 Apr 2008 21:52:31 -0400

Data on the location and position of Michael Jackson's white glove in all 10,060 frames of his nationally televised 1983 performance of the song "Billie Jean."

url: http://www.whiteglovetracking.com/

Netflix Prize

Tue, 08 Apr 2008 00:48:22 -0400

"The Netflix Prize seeks to substantially improve the accuracy of predictions about how much someone is going to love a movie based on their movie preferences." Register to download the dataset.

url: http://www.netflixprize.com//index

Frequent Itemset Mining Dataset Repository

Tue, 08 Apr 2008 00:37:35 -0400

Anonymized clickstream data from a Hungarian news portal, anonymized retail market basket data from an anonymous Belgian retail store, anonymized traffic accident data and more.

url: http://fimi.cs.helsinki.fi/data/

Oscar-nominated Movie Piracy Data

Tue, 08 Apr 2008 00:35:50 -0400

Data tracking the online distribution of every Oscar-nominated film since 2003. Compiled by Andy Baio of Waxy.org.

url: http://waxy.org/2010/02/pirating_the_2010_oscars/

Worldometers

Sun, 12 Dec 2010 11:21:18 -0500

Worldometers collects and displays real-time statistics on global population, government and economics, society and media, the environment, energy, food, water and health. Part of the Real Time Statistics Project.

Check out their many data sources.

url: http://www.worldometers.info

NYC Way

Tue, 15 Dec 2009 12:17:05 -0500

NYC Way is an iPhone application that bundles a variety of local resources useful for residents and tourists alike. It happens to be one of the first mobile apps to combine a wide variety of datasets from NYC.gov (along with various third-party datasets), location awareness and social media. Experience the power of 30+ NYC-related iPhone apps packaged into one.

Based around the theme of making our government more transparent, NYC Way is a first step to help NYC.gov share their rich datasets with the rest of us. It uses various datasets from NYC Data Mine, and many others available via NYC.gov.

NYC Way is location-aware and provides you with information sorted by proximity. The app allows you to update your Facebook status or send out a tweet about any place you discovered or visited.

In an upcoming release, we plan to implement real-time location v/s interest analysis, and hook the app up to a sophisticated Complex Event Processing backend that will correlate user interests and actions with current situation and location to make valuable local recommendations.

NYC Way includes all of the following and more:

Nearest wifi hotspot locations
NYC restaurant inspection results
Major NYC tourist attractions
NYC street eats (NYC street vendors)
NYC coffee shops
NYC gadget stores
NYC events
NYC live traffic cams and traffic updates
NYC subway station locations and alerts
NYC police stations, wanted criminals, average emergency response times, ERs and more
Nearest waste disposal sites and waste collection schedules
Nearest post offices, 24-hour pharmacies, Zipcar locations
Swine flu vaccination locator, parking ticket search, can I park here
Volunteer opportunities
NYC local news including the New York Times, New York Post and WNBC
NYC recreation information including ice-skating rinks, zoos, aquariums and museums

Submitted by Shariq

url: http://www.nycway.com

NYT Trender

Sun, 10 May 2009 17:55:38 -0400

Compare any two terms by number of mentions in the New York Times in 2008. By Derek Gottfrid.

url: http://tyn-search.appspot.com/

softcover

Sat, 09 May 2009 11:37:11 -0400

Softcover is kind enough to email you when books come out in paperback. By Jonathan Soma.

url: http://softcover.xoxosoma.com/

NPR Road Trip

Tue, 09 Dec 2008 20:28:39 -0500

Locate National Public Radio (NPR) radio stations along any driving route in the United States.

url: http://www.nprroadtrip.com/

Map of Newspaper Endorsements in the 2008 U.S. Presidential Election

Sat, 01 Nov 2008 20:11:05 -0400

Map of newspaper endorsements in the 2008 U.S. Presidential election, using data from Editor & Publisher's list. By Philip (Flip) Kromer.

url: http://infochimps.org/static/gallery/politics/endorsements_map/endorsements_map.html

CrunchBase WordPress Plugin

Fri, 18 Jul 2008 17:57:46 -0400

Plugin for the WordPress weblog platform designed to enable easy insertion of CrunchBase company profiles into blog posts. By Vaibhav Gadodia.

url: http://blog.gadodia.net/crunchbase-api-wordpress-plugin/

Ramazon

Mon, 23 Jun 2008 10:59:19 -0400

Ramazon uses the Flare Visualization Toolkit to create an interactive visualization of related items on Amazon.com. A follow-up to the Influence Viewer. By Martin Dudek.

url: http://goosebumps4all.net/ramazon/

Newsstream

Tue, 13 May 2008 14:29:27 -0400

A visualization of the waxing and waning popularity of news stories over time, using Google News clustering data. Written in Common Lisp, uses SVG (Scalable Vector Graphics). By Eli Naeher.

url: http://newsstream.codeanddata.com

Amazon Book Map

Wed, 30 Apr 2008 21:58:57 -0400

Dense mosaic of over 700,000 book covers, color coded by book category and grouped together according to similarity. By Chris Harrison.

url: http://www.chrisharrison.net/projects/amazonviz/index.html

President Bush State of the Union Speech Sentence Diagrams

Fri, 25 Apr 2008 10:25:02 -0400

Diagrammatic expressions of the content of President George W. Bush's State of the Union Addresses. Offers contrasts between speeches made in different years. By David Sparks

url: http://arbitrarian.wordpress.com/2008/04/13/bushs-legacy-speaks-for-itself/

Interactive Netflix Prize Visualization

Mon, 21 Apr 2008 19:34:12 -0400

A visualization of the 17,700 movies that comprise the Netflix Prize competition dataset. By Todd Holloway.

url: http://abeautifulwww.com/2007/04/03/an-interactive-visualization-of-the-netflix-prize-dataset/

White Glove Tracking Visualization Gallery

Tue, 08 Apr 2008 21:53:37 -0400

Gallery of animations and visualizations created from the White Glove Tracking dataset of the location and position of Michael Jackson's white glove during his nationally televised performance of "Billie Jean."

url: http://www.whiteglovetracking.com/