Datamob: language

Delicious Folksonomy Dataset: September 2009

Sat, 27 Feb 2010 09:20:30 -0600

Dataset comprised of 1.25 million Delicious bookmarks, retrieved in September 2009.

url: http://arvindn.livejournal.com/116137.html

Delicious Folksonomy Dataset: 2007-2008

Tue, 23 Feb 2010 20:38:16 -0600

This dataset contains all public bookmarks and associated tag assignments of about 950,000 Delicious users, retrieved between December 2007 and April 2008. The full corpus is about 7GB of compressed data and is one of the largest folksonomy datasets used in research so far. See this post and this publication for more details on how it's been used.

Compiled by Robert Wetzker.

url: http://robertwetzker.com/2009/06/25/delicious-dataset-for-download/

Social Tagging of Wikipedia Articles

Wed, 17 Feb 2010 22:37:36 -0600

Wiki10+ is a dataset created during April 2009 with data retrieved from Delicious and the English Wikipedia. It contains 20,764 unique URLs of English Wikipedia articles and their corresponding annotations on Delicious.

Available for research purposes. Compiled by Arkaitz Zubiaga.

url: http://nlp.uned.es/social-tagging/wiki10+/

DeliciousT140 Dataset

Wed, 17 Feb 2010 22:26:58 -0600

DeliciousT140 is a dataset created during June 2008 with data retrieved from the social bookmarking site Delicious and the web. It contains 144,574 unique URLs, all of them with their corresponding social tags retrieved from Delicious. This set of documents is annotated with 67,104 different tags.

Available for research purposes. Compiled by Arkaitz Zubiaga.

url: http://nlp.uned.es/social-tagging/delicioust140/

Social Bookmarking Data

Wed, 17 Feb 2010 22:20:04 -0600

Social-ODP-2k9 is a dataset created during December 2008 and January 2009 with data retrieved from Delicious and StumbleUpon, the Open Directory Project and the web. It contains 12,616 unique URLs along with their corresponding social annotations:

- Number of users annotating it, from Delicious

- Top 10 list of tags, from Delicious

- Full Tag Activity (FTA), from Delicious

- Notes, from Delicious

- Reviews, from StumbleUpon

- URL category, from the Open Directory Project

Available for research purposes. Compiled by Arkaitz Zubiaga.

url: http://nlp.uned.es/social-tagging/socialodp2k9/

New York City Baby Name Data

Sun, 06 Dec 2009 11:23:42 -0600

Two CSV files available for download: all New York City baby names dating back to 1920, and New York City baby names broken down by ethnicity, dating back to 1990.

Data supplied by the New York City Department of Health and Mental Hygiene, compiled by Jennifer 8. Lee for the New York Times City Room Blog.

url: http://cityroom.blogs.nytimes.com/2009/12/02/jayden-is-the-no-1-baby-boys-name-in-the-city/

We Feel Fine API

Mon, 16 Nov 2009 22:13:03 -0600

We Feel Fine is a data collection engine that scours the internet every ten minutes, harvesting and identifying expressions of human feelings from a large number of blogs. 15,000 to 20,000 feelings are identified and saved per day. You can use the We Feel Fine API to access this data. Optional parameters include feeling, gender, weather conditions and country. By Sep Kamvar and Jonathan Harris.

Licensed under a Creative Commons Attribution-NonCommercial-Sharealike license.

url: http://www.wefeelfine.org/api.html

OpenCyc API

Fri, 30 Oct 2009 22:00:51 -0500

Programmatic access to the open source version of the Cyc Knowledge Base, the world's largest and most complete general knowledge base and commonsense reasoning engine. The Cyc Knowledge Base is a formalized representation of a vast quantity of fundamental human knowledge: facts, rules of thumb, and heuristics for reasoning about the objects and events of everyday life. OpenCyc includes the Cyc ontology, which contains hundreds of thousands of terms, plus millions of assertions relating the terms to each other, forming an upper ontology whose domain is all of human consensus reality. Returns results in XML.

url: http://ws.opencyc.org/

UMass Amherst Linguistics Sentiment Corpora

Wed, 11 Feb 2009 21:35:54 -0600

N-gram counts extracted from over 700,000 online product reviews in Chinese, English, German and Japanese. Formatted to be read as R data frames. By Noah Constant, Christopher Davis, Christopher Potts and Florian Schwarz. Creative Commons Attribution-Noncommercial-Share Alike 3.0 License.

url: http://semanticsarchive.net/Archive/jQ0ZGZiM/readme.html

Capitol Words API

Sun, 25 Jan 2009 20:04:47 -0600

The Capitol Words API provides several methods of accessing detailed information from the Capitol Words database of word frequency from the U.S. Congressional Record. Returns results in JSON and XML.

url: http://www.capitolwords.org/api/

Big Huge Thesaurus API

Sun, 14 Sep 2008 21:55:50 -0500

Query a database of 145,000 English language words for synonyms. Returns data in JSON, XML, serialized PHP array or plain text formats. Based on data from the Princeton University WordNet database and the Carnegie Mellon Pronouncing Dictionary. By John Watson.

url: http://words.bighugelabs.com/api.php

Dolores Labs' Color Name Dataset

Tue, 08 Apr 2008 19:51:12 -0500

10,000 color/label pairs, based on data collected through Amazon's Mechanical Turk crowdsourcing marketplace. By Brendan O'Connor.

url: http://blog.doloreslabs.com/2008/03/our-color-names-data-set-is-online/

Given Name Frequency Project

Tue, 08 Apr 2008 00:07:15 -0500

Four datasets on given name popularity.

url: http://www.galbithink.org/names/agnames.htm

U.S. Census Bureau - 1990 Names

Tue, 08 Apr 2008 00:06:33 -0500

url: http://www.census.gov/genealogy/names/names_files.html

Congress Speaks

Sun, 01 Nov 2009 18:49:40 -0600

An exploration of the words spoken in the 110th U.S. Congress. By Periscopic.

url: http://congressspeaks.com/

ReadTheStimulus.org

Sun, 25 Jan 2009 22:43:43 -0600

The text of the American Recovery & Reinvestment Act of 2009 (House Stimulus Bill), made searchable with comments for each page enabled. Actual dollar appropriations from the bill have been parsed out by volunteers and entered into a Google spreadsheet.

url: http://readthestimulus.org

Capitol Words

Sun, 25 Jan 2009 19:57:23 -0600

Capitol Words visualizes the most frequently used words in the Congressional Record, offering an at-a-glance view of which issues U.S. lawmakers address on a daily, weekly, monthly and yearly basis. A project of Sunlight Foundation.

Also available as an API.

url: http://www.capitolwords.org/

Newsstream

Tue, 13 May 2008 14:29:27 -0500

A visualization of the waxing and waning popularity of news stories over time, using Google News clustering data. Written in Common Lisp, uses SVG (Scalable Vector Graphics). By Eli Naeher.

url: http://newsstream.codeanddata.com

President Bush State of the Union Speech Sentence Diagrams

Fri, 25 Apr 2008 10:25:02 -0500

Diagrammatic expressions of the content of President George W. Bush's State of the Union Addresses. Offers contrasts between speeches made in different years. By David Sparks

url: http://arbitrarian.wordpress.com/2008/04/13/bushs-legacy-speaks-for-itself/

Color Name Networks

Fri, 25 Apr 2008 10:00:00 -0500

Network and cluster diagrams derived from the Dolores Labs color name dataset. By David Sparks.

url: http://arbitrarian.wordpress.com/2008/03/31/plotting-the-colors/

Color Flower

Fri, 25 Apr 2008 09:46:13 -0500

A visualization of the Dolores Labs color name dataset in which color names radiate from the center according to their hue. By Chris Harrison.

url: http://www.chrisharrison.net/projects/colorflower/index.html

Baby Name Voyager

Mon, 21 Apr 2008 03:00:25 -0500

Visualization of child name popularity over time.

url: http://www.babynamewizard.com/namevoyager/lnv0105.html

Color Name Explorer

Tue, 08 Apr 2008 19:56:29 -0500

Interactive 3D explorer application of data from the Dolores Labs color name experiment. By Jeff Clark.

url: http://www.neoformix.com/2008/ColorNamesExplorer.html

Color Name Cloud Visualization

Tue, 08 Apr 2008 19:55:32 -0500

A visualization of data from a color names experiment by Dolores Labs in which people were asked what they would call various colors. By Martin Wattenberg.

url: http://blog.doloreslabs.com/2008/03/awesome-cloud-view-of-our-color-names-data/

Dolores Labs' Color Name Cloud

Tue, 08 Apr 2008 19:52:24 -0500

A visualization of data from a color names experiment by Dolores Labs in which people were asked what they would call various colors. By Brendan O'Connor.

url: http://blog.doloreslabs.com/2008/03/where-does-blue-end-and-red-begin/