Datamob

Slashdot Zoo

Wed, 17 Mar 2010 12:58:13 -0500

The social network of Slashdot.org, consisting of "friend" and "foe" relations among 78,000 users of the site. Extracted between May 2008 and February 2009.

submitted by: Jérôme Kunegis

url: http://www.dai-labor.de/index.php?id=1726&L=1

Music Recommendation Datasets

Sat, 27 Feb 2010 09:37:26 -0600

Two datasets created using the Last.fm API. One dataset is comprised of information about around 360,000 Last.fm users, including basic profile information and artist playcount per user. An additional dataset containing the entire listening history for 1,000 Last.fm users is forthcoming.

Compiled by Oscar Celma.

url: http://denoiserthebetter.posterous.com/music-recommendation-datasets

Delicious Folksonomy Dataset: September 2009

Sat, 27 Feb 2010 09:20:30 -0600

Dataset comprised of 1.25 million Delicious bookmarks, retrieved in September 2009.

Compiled by Arvind Narayanan.

url: http://arvindn.livejournal.com/116137.html

Delicious Folksonomy Dataset: 2007-2008

Tue, 23 Feb 2010 20:38:16 -0600

This dataset contains all public bookmarks and associated tag assignments of about 950,000 Delicious users, retrieved between December 2007 and April 2008. The full corpus is about 7GB of compressed data and is one of the largest folksonomy datasets used in research so far. See this post and this publication for more details on how it's been used.

Compiled by Robert Wetzker.

url: http://robertwetzker.com/2009/06/25/delicious-dataset-for-download/

Social Media Datasets

Tue, 23 Feb 2010 20:26:48 -0600

Datasets from Flickr, Twitter, YouTube, Delicious, Digg and Engadget. Compiled by Munmun De Choudhury.

Available for research purposes under a Creative Commons Attribution-Noncommercial 3.0 United States License.

url: http://www.public.asu.edu/~mdechoud/datasets.html

Grid Workloads Archive

Thu, 18 Feb 2010 06:30:16 -0600

The primary purpose of the Grid Workloads Archive (GWA) is to provide (anonymized) workload traces from grid environments to researchers and to practitioners alike. The GWA contains long-term workload traces taken from grid systems, and tools for their analysis. A complete description of the GWA can be found in [1].

[1] Alexandru Iosup, Hui Li, Mathieu Jan, Shanny Anoep, Catalin Dumitrescu, Lex Wolters, Dick H. J. Epema: The Grid Workloads Archive. Future Generation Comp. Syst. 24(7): 672-686 (2008) http://dx.doi.org/10.1016/j.future.2008.02.003

submitted by: S. Gam

url: http://gwa.ewi.tudelft.nl/

Social Tagging of Wikipedia Articles

Wed, 17 Feb 2010 22:37:36 -0600

Wiki10+ is a dataset created during April 2009 with data retrieved from Delicious and the English Wikipedia. It contains 20,764 unique URLs of English Wikipedia articles and their corresponding annotations on Delicious.

Available for research purposes. Compiled by Arkaitz Zubiaga.

url: http://nlp.uned.es/social-tagging/wiki10+/

DeliciousT140 Dataset

Wed, 17 Feb 2010 22:26:58 -0600

DeliciousT140 is a dataset created during June 2008 with data retrieved from the social bookmarking site Delicious and the web. It contains 144,574 unique URLs, all of them with their corresponding social tags retrieved from Delicious. This set of documents is annotated with 67,104 different tags.

Available for research purposes. Compiled by Arkaitz Zubiaga.

url: http://nlp.uned.es/social-tagging/delicioust140/

Social Bookmarking Data

Wed, 17 Feb 2010 22:20:04 -0600

Social-ODP-2k9 is a dataset created during December 2008 and January 2009 with data retrieved from Delicious and StumbleUpon, the Open Directory Project and the web. It contains 12,616 unique URLs along with their corresponding social annotations:

- Number of users annotating it, from Delicious

- Top 10 list of tags, from Delicious

- Full Tag Activity (FTA), from Delicious

- Notes, from Delicious

- Reviews, from StumbleUpon

- URL category, from the Open Directory Project

Available for research purposes. Compiled by Arkaitz Zubiaga.

url: http://nlp.uned.es/social-tagging/socialodp2k9/

toronto.ca/open

Fri, 29 Jan 2010 21:50:39 -0600

The City of Toronto's official data set catalog. Data available in XML and ESRI Shapefile formats.

url: http://www.toronto.ca/open/

Big Apple Ed

Mon, 01 Mar 2010 07:15:55 -0600

Big Apple Ed helps students, parents and teachers find out about New York City schools in one place by pulling together information from disparate sources, including view testing data, contact information, suspension rates and student/teacher ratios.

Third Place Overall Winner of the NYC Big Apps competition. Uses the School Search (NYC DOE) dataset from NYC Data Mine.

By Jonathan Soma, Adda Birnir and Kate Reyes.

url: http://www.bigappleed.com

Playaround NYC

Sat, 27 Feb 2010 11:28:40 -0600

PlayaroundNYC was created to help New Yorkers see how well their neighborhoods are supported by playgrounds. It uses walking distance to playgrounds and pollution caused by nearby truck routes to generate an overview of how well different areas of New York City are supported by playgrounds. An interactive map allows users to determine the proximity and quality of nearby playgrounds in all five boroughs.

Uses the following NYC Data Mine datasets: Directory of Playgrounds, Borough & Community Districts; and GIS: Boroughs.

By Noel Billig.

url: http://www.playaroundnyc.com/

Trees Near You

Sat, 27 Feb 2010 09:55:41 -0600

Trees Near You is an iPhone application that helps you learn about the more than 500,000 trees that live on New York City sidewalks. For any area of the city, from block to borough, you can see the different species that live there, and measure the environmental (and monetary!) benefits that these trees provide.

Winner of the Best Application Honorable Mention in the NYC Big Apps competition. Uses the following NYC Data Mine datasets: "Street Tree Census" files for all five boroughs, and "Neighborhood Names GIS" for neighborhood names centroids.

By Brett Camper.

url: http://www.treesnearyou.com/

Hybrowse

Wed, 17 Feb 2010 23:21:19 -0600

Browse Etsy and other listings "Venn diagram-style" by combining item tags. By Jakob Lodwick and Peter Vidani.

url: http://hybrowse.com/Etsy

Census 2010 "Hard to Count" Interactive Maps

Mon, 25 Jan 2010 19:19:32 -0600

Maps the "hard to count" population nationwide to help organizations who are planning their outreach efforts for the 2010 Census.

The site provides interactive maps at the state, metropolitan area, county and tract level, along with detailed statistics for each area. You can search in various ways, and also add overlays showing Congressional districts, ZIP codes, tract-level maps of 2000 Census mail return rates, and recent foreclosure risk. An FAQ is available.

submitted by: Steven Romalewski

url: http://www.censushardtocountmaps.org/

The Full Wiki Maps

Mon, 11 Jan 2010 03:15:56 -0600

View all the locations mentioned in any Wikipedia article on a map.

submitted by: Luke Metcalfe

url: http://www.thefullwiki.org

NYC Way

Tue, 15 Dec 2009 12:17:05 -0600

NYC Way is an iPhone application that bundles a variety of local resources useful for residents and tourists alike. It happens to be one of the first mobile apps to combine a wide variety of datasets from NYC.gov (along with various third-party datasets), location awareness and social media. Experience the power of 30+ NYC-related iPhone apps packaged into one.

Based around the theme of making our government more transparent, NYC Way is a first step to help NYC.gov share their rich datasets with the rest of us. It uses various datasets from NYC Data Mine, and many others available via NYC.gov.

NYC Way is location-aware and provides you with information sorted by proximity. The app allows you to update your Facebook status or send out a tweet about any place you discovered or visited.

In an upcoming release, we plan to implement real-time location v/s interest analysis, and hook the app up to a sophisticated Complex Event Processing backend that will correlate user interests and actions with current situation and location to make valuable local recommendations.

NYC Way includes all of the following and more:

Nearest wifi hotspot locations
NYC restaurant inspection results
Major NYC tourist attractions
NYC street eats (NYC street vendors)
NYC coffee shops
NYC gadget stores
NYC events
NYC live traffic cams and traffic updates
NYC subway station locations and alerts
NYC police stations, wanted criminals, average emergency response times, ERs and more
Nearest waste disposal sites and waste collection schedules
Nearest post offices, 24-hour pharmacies, Zipcar locations
Swine flu vaccination locator, parking ticket search, can I park here
Volunteer opportunities
NYC local news including the New York Times, New York Post and WNBC
NYC recreation information including ice-skating rinks, zoos, aquariums and museums

submitted by: Shariq

url: http://www.nycway.com

Casual Earnings of German Parliamentarians

Mon, 14 Dec 2009 06:03:28 -0600

This site shows the casual earnings of the Members of the German Bundestag. The data is issued in unstructured, isolated lists by the Bundestag. This site scrapes, structures and aggregates the earnings to create a better overview for German citizens.

Sorry, but the site is in German only!

submitted by: Henning Wolf

url: http://www.nebeneinkuenfte-bundestag.de

The Decline: The Geography of a Recession

Sat, 21 Nov 2009 09:49:04 -0600

Interactive map showing the deterioration of the U.S. economy from January 2007 to September 2009. By LaToya Egwuekwe.

url: http://cohort11.americanobserver.net/latoyaegwuekwe/multimediafinal.html

tinyThom.as

Mon, 16 Nov 2009 22:28:50 -0600

THOMAS is the official database of United States Congress legislative information. Links on THOMAS expire, and they're long. tinyThom.as makes them permanent, and short, and also provides links to related content on OpenCongress and GovTrack. By Asa Hopkins.

url: http://tinythom.as/

Open311

Sun, 07 Mar 2010 21:18:48 -0600

Website aimed at facilitating an international effort to build open interoperable systems that allow citizens to more directly interact with their cities. Run by the Open Planning Project.

url: http://open311.org/

MapTogether

Mon, 01 Mar 2010 17:39:15 -0600

The MapTogether project provides free map-related training and tools for community and nonprofit groups around the world. Their resources include software, datasets, online mapping services, documentation, and training resources.

url: http://maptogether.org/

Information is Beautiful

Fri, 26 Feb 2010 13:56:24 -0600

Blog by David McCandless which regularly features original data visualizations and associated source data.

url: http://www.informationisbeautiful.net/

Tableau Public

Wed, 17 Feb 2010 21:20:30 -0600

A Windows desktop application for easy data visualization and publication on the web.

url: http://www.tableausoftware.com/public/

Protovis

Tue, 05 Jan 2010 06:23:09 -0600

"A graphical approach to visualization" which uses Javascript and SVG for web-native data visualizations. By Mike Bostock and Jeffrey Heer.

url: http://vis.stanford.edu/protovis/

City of Vancouver Open Data Catalogue

Fri, 30 Oct 2009 19:17:34 -0500

Catalog of public datasets generated by the City of Vancouver.

url: http://data.vancouver.ca/datacatalogue/index.htm

R for Programmers

Fri, 23 Oct 2009 17:19:30 -0500

An accessible tutorial on the R programming language and software environment for statistical computing and graphics. By Norm Matloff.

url: http://heather.cs.ucdavis.edu/~matloff/r.html

Applications for New South Wales

Wed, 14 Oct 2009 21:38:48 -0500

Development contest from the government of New South Wales in Australia rewarding developers that use government and public data sources related to NSW to create applications.

url: http://www.information.nsw.gov.au/apps4nsw

data.australia.gov.au

Wed, 14 Oct 2009 21:30:27 -0500

Catalog of public datasets generated by the Australian government.

url: http://data.australia.gov.au

MashUp Australia Contest

Wed, 14 Oct 2009 21:27:35 -0500

Development contest from Australia's Government 2.0 Taskforce rewarding developers that use government data sources like those available on data.australia.gov.au to create applications.

url: http://mashupaustralia.org/