Datamob: social networks

Koblenz Network Collection (KONECT)

Mon, 30 Jan 2012 19:39:22 -0500

The Koblenz Network Collection (KONECT) is a project to collect large network datasets of all types in order to perform research in the area of network mining. Data sources include Twitter, Flickr, Digg, Amazon, Prosper, Netflix and Wikipedia. Collected by the Institute of Web Science and Technologies of the University of Koblenz–Landau.

By Jérôme Kunegis.

url: http://konect.uni-koblenz.de/

Stanford Large Network Dataset Collection

Sun, 12 Dec 2010 10:30:40 -0500

A collection of large network datasets: social networks, web graphs, road networks, internet networks, citation networks, collaboration networks and communication networks.

Includes data from Slashdot, Epinions, LiveJournal, Wikipedia, Amazon, Twitter and MemeTracker.

Posted as examples for use with the Stanford Network Analysis Platform (SNAP).

url: http://snap.stanford.edu/data/index.html

Reddit Article Voting Data Donated by Users

Tue, 16 Nov 2010 22:57:25 -0500

Article voting data from social news site Reddit, donated by 40,000 users.

Compiled by David King of Reddit.

Unofficial Hacker News API

Sun, 26 Sep 2010 17:44:49 -0400

Programmatic access to Hacker News stories, comments and votes. Originally developed for iHackerNews, a mobile version of Hacker News. Returns data in JSON; JSONP and XML coming soon.

By Ronnie Roller.

url: http://api.ihackernews.com/

Facebook Dataset

Wed, 22 Sep 2010 21:01:49 -0400

This is a dataset collected during April-May 2009. It contains the following two representative samples of Facebook users with a few annotated properties:

- MHRW: A sample of 957,000 unique users obtained Facebook-wide by Metropolis-Hastings random walks, which is shown to closely approximate the ground truth.

- UNI: A uniform sample of 984,000 unique users that represents the ground truth. User IDs were selected uniformly at random from the platform's 32-bit ID space—essentially a rejection sampling procedure.

For each dataset, we release two files. The first file contains for each sampled user ID, the number of times the user was sampled and the user IDs of his/her friends. The second file contains additional node properties for each sampled user. For each sampled user ID we have the number of times sampled, the total number of friends, privacy settings and network membership. User IDs and network IDs are anonymized.

Submitted by Minas Gjoka

url: http://odysseas.calit2.uci.edu/wiki/doku.php?id=public:online_social_networks#available_datasets

Reddit Article Voting Data

Sat, 15 May 2010 05:22:51 -0400

Article voting data from social news site Reddit.

"The dump is 29MB gzip compressed and contains 7,405,561 votes from 31,927 users over 2,046,401 links. It contains votes only from users with the preference "make my votes public" turned on (which is not the default)."

Compiled by David King of Reddit.

url: http://www.reddit.com/r/redditdev/comments/bubhl/csv_dump_of_reddit_voting_data/

The Pirate Bay Dataset

Sun, 25 Apr 2010 12:48:35 -0400

Dataset containing the metadata of 679,515 unique torrents from The Pirate Bay, one of the most popular BitTorrent trackers. For each torrent, the following metadata is included: ID of the torrent, category, torrent size, number of leechers, number of seeders. Collected on December 5th, 2008. CSV format.

Compiled by the Communications Systems Research Group CSG at the Computer Science Department of the University of Zurich, Switzerland.

url: http://www.csg.uzh.ch/publications/data/piratebay

Amazon Customer Review Data

Sun, 25 Apr 2010 12:36:25 -0400

A dataset of Amazon.com customer reviews, for opinion mining, sentiment analysis and opinion spam detection research.

Compiled by Nitin Jindal and Bing Liu. More data and background available here.

url: http://131.193.40.52/data/

Slashdot Zoo

Wed, 17 Mar 2010 12:58:13 -0400

The social network of Slashdot.org, consisting of "friend" and "foe" relations among 78,000 users of the site. Extracted between May 2008 and February 2009.

Submitted by Jérôme Kunegis

url: http://www.dai-labor.de/en/competence_centers/irml/datasets/the_slashdot_zoo/

Music Recommendation Datasets

Sat, 27 Feb 2010 09:37:26 -0500

Two datasets created using the Last.fm API. One dataset is comprised of information about around 360,000 Last.fm users, including basic profile information and artist playcount per user. An additional dataset containing the entire listening history for 1,000 Last.fm users is forthcoming.

Compiled by Oscar Celma.

url: http://denoiserthebetter.posterous.com/music-recommendation-datasets

Delicious Folksonomy Dataset: September 2009

Sat, 27 Feb 2010 09:20:30 -0500

Dataset comprised of 1.25 million Delicious bookmarks, retrieved in September 2009.

Compiled by Arvind Narayanan.

url: http://arvindn.livejournal.com/116137.html

Delicious Folksonomy Dataset: 2007-2008

Tue, 23 Feb 2010 20:38:16 -0500

This dataset contains all public bookmarks and associated tag assignments of about 950,000 Delicious users, retrieved between December 2007 and April 2008. The full corpus is about 7GB of compressed data and is one of the largest folksonomy datasets used in research so far. See this post and this publication for more details on how it's been used.

Compiled by Robert Wetzker.

url: http://robertwetzker.com/2009/06/25/delicious-dataset-for-download/

Social Media Datasets

Tue, 23 Feb 2010 20:26:48 -0500

Datasets from Flickr, Twitter, YouTube, Delicious, Digg and Engadget. Compiled by Munmun De Choudhury.

Available for research purposes under a Creative Commons Attribution-Noncommercial 3.0 United States License.

url: http://www.public.asu.edu/~mdechoud/datasets.html

Social Tagging of Wikipedia Articles

Wed, 17 Feb 2010 22:37:36 -0500

Wiki10+ is a dataset created during April 2009 with data retrieved from Delicious and the English Wikipedia. It contains 20,764 unique URLs of English Wikipedia articles and their corresponding annotations on Delicious.

Available for research purposes. Compiled by Arkaitz Zubiaga.

url: http://nlp.uned.es/social-tagging/wiki10+/

DeliciousT140 Dataset

Wed, 17 Feb 2010 22:26:58 -0500

DeliciousT140 is a dataset created during June 2008 with data retrieved from the social bookmarking site Delicious and the web. It contains 144,574 unique URLs, all of them with their corresponding social tags retrieved from Delicious. This set of documents is annotated with 67,104 different tags.

Available for research purposes. Compiled by Arkaitz Zubiaga.

url: http://nlp.uned.es/social-tagging/delicioust140/

Social Bookmarking Data

Wed, 17 Feb 2010 22:20:04 -0500

Social-ODP-2k9 is a dataset created during December 2008 and January 2009 with data retrieved from Delicious and StumbleUpon, the Open Directory Project and the web. It contains 12,616 unique URLs along with their corresponding social annotations:

- Number of users annotating it, from Delicious

- Top 10 list of tags, from Delicious

- Full Tag Activity (FTA), from Delicious

- Notes, from Delicious

- Reviews, from StumbleUpon

- URL category, from the Open Directory Project

Available for research purposes. Compiled by Arkaitz Zubiaga.

url: http://nlp.uned.es/social-tagging/socialodp2k9/

We Feel Fine API

Mon, 16 Nov 2009 22:13:03 -0500

We Feel Fine is a data collection engine that scours the internet every ten minutes, harvesting and identifying expressions of human feelings from a large number of blogs. 15,000 to 20,000 feelings are identified and saved per day. You can use the We Feel Fine API to access this data. Optional parameters include feeling, gender, weather conditions and country. By Sep Kamvar and Jonathan Harris.

Licensed under a Creative Commons Attribution-NonCommercial-Sharealike license.

url: http://www.wefeelfine.org/api.html

Hunch API

Sun, 21 Jun 2009 11:22:47 -0400

RESTful API for programmatically accessing Hunch, a questions and answers service that harnesses collective knowledge to offer solutions to user-entered problems. Hunch is designed so that every time it's used, it learns something new. Query for questions, responses, topics, search results and categories as well as statistics pertaining to THAY (Teach Hunch About You) questions and responses. Returns results in JSON. API key required.

url: http://www.hunch.com/developers/

Etsy API

Sun, 10 May 2009 09:17:05 -0400

RESTful API for programmatically accessing Etsy, a global handmade marketplace. Provides access to data on users, shops, item listings, feedback, tags and categories, favorites and gift guides. Returns results in JSON. API key required.

Review the Etsy API Terms of Use.

url: http://developer.etsy.com

TimesPeople API

Fri, 27 Feb 2009 23:09:14 -0500

With the TimesPeople API, you can retrieve user data for nytimes.com, including the user profiles, activities, news feeds, and networks. Returns data in JSON or XML.

Read the announcement on Open for more information.

url: http://developer.nytimes.com/docs/timespeople_api/

GetSatisfaction API

Sun, 28 Sep 2008 14:26:02 -0400

This API provides access to all the questions, answers and ideas exchanged between companies and their customers on GetSatisfaction. Data available in JSON, Atom and XHTML.

url: http://developers.getsatisfaction.com

Trust Network Datasets

Sun, 11 May 2008 12:23:58 -0400

Collection of network datasets in which there are entities (people, robots) and some social relationship connecting two of these entities. From TrustLet, a cooperative environment for the scientific research of trust metrics on social networks. Released datasets are licensed under Creative Commons Attribution 3.0.

url: http://www.trustlet.org/wiki/Trust_network_datasets

Metafilter Infodump

Wed, 23 Apr 2008 07:35:55 -0400

Collection of data culled from the Metafilter community weblog database: stats on Metafilter posts, comments, tags, favorites and users. ASCII text.

url: http://stuff.metafilter.com/infodump/

Network Datasets Compiled by Alex Arenas

Mon, 14 Apr 2008 19:08:08 -0400

A collection of network datasets on email interchange, jazz musician collaboration and more.

url: http://deim.urv.cat/~aarenas/data/welcome.htm

Network Datasets Compiled by Mark Newman

Mon, 14 Apr 2008 19:05:56 -0400

A collection of network datasets drawn from studies of human social networks, dolphin social networks, works of literature, power grids, books, blogs and more. Compiled by Mark Newman, professor of physics at the University of Michigan.

url: http://www-personal.umich.edu/~mejn/netdata/

Enron Email Dataset

Tue, 08 Apr 2008 21:18:37 -0400

200,000 internal emails from Enron, 1999-2002, made public in 2003 as part of the US Federal Energy Regulatory Commission's investigation into Enron. 400 MB, compressed.

url: http://www.cs.cmu.edu/~enron/

FilterBy

Wed, 17 Feb 2010 23:21:19 -0500

Browse Etsy and other listings "Venn diagram-style" by combining item tags. By Jakob Lodwick and Peter Vidani.

url: http://filterby.com/

NYC Way

Tue, 15 Dec 2009 12:17:05 -0500

NYC Way is an iPhone application that bundles a variety of local resources useful for residents and tourists alike. It happens to be one of the first mobile apps to combine a wide variety of datasets from NYC.gov (along with various third-party datasets), location awareness and social media. Experience the power of 30+ NYC-related iPhone apps packaged into one.

Based around the theme of making our government more transparent, NYC Way is a first step to help NYC.gov share their rich datasets with the rest of us. It uses various datasets from NYC Data Mine, and many others available via NYC.gov.

NYC Way is location-aware and provides you with information sorted by proximity. The app allows you to update your Facebook status or send out a tweet about any place you discovered or visited.

In an upcoming release, we plan to implement real-time location v/s interest analysis, and hook the app up to a sophisticated Complex Event Processing backend that will correlate user interests and actions with current situation and location to make valuable local recommendations.

NYC Way includes all of the following and more:

Nearest wifi hotspot locations
NYC restaurant inspection results
Major NYC tourist attractions
NYC street eats (NYC street vendors)
NYC coffee shops
NYC gadget stores
NYC events
NYC live traffic cams and traffic updates
NYC subway station locations and alerts
NYC police stations, wanted criminals, average emergency response times, ERs and more
Nearest waste disposal sites and waste collection schedules
Nearest post offices, 24-hour pharmacies, Zipcar locations
Swine flu vaccination locator, parking ticket search, can I park here
Volunteer opportunities
NYC local news including the New York Times, New York Post and WNBC
NYC recreation information including ice-skating rinks, zoos, aquariums and museums

Submitted by Shariq

url: http://www.nycway.com

CraftWeasel

Sat, 25 Jul 2009 12:08:26 -0400

Enter your Etsy username for recommended items based on your Etsy Favorites. By Martin Jones.

url: http://www.craftweasel.com/

More Cloth

Mon, 29 Jun 2009 22:15:52 -0400

Browse fabrics by color range on Etsy, a global handmade marketplace. By Catherine Jones.

url: http://morecloth.com/

Gotta Etsy

Wed, 24 Jun 2009 09:45:22 -0400

iPhone OS 3.0 application for searching and browsing shops and listings on Etsy, a global handmade marketplace. Offers the ability to bookmark listings for future reference. By Jacob Yelizarov.

url: http://www.apptism.com/apps/gotta-etsy

ColorMatch

Mon, 08 Jun 2009 21:06:24 -0400

Upload an image and ColorMatch will search Etsy for items that match the colors in your image along with any optional keywords. By 26 Olive Street.

url: http://26olivestreet.com/colormatch/

Etsy Addict

Sun, 10 May 2009 10:08:25 -0400

Application for searching and browsing Etsy, a global handmade marketplace, from your iPhone or iPod Touch. By Daniel Dickison.

url: http://danieldickison.com/etsyaddict/

Heartomatic

Sun, 10 May 2009 09:38:15 -0400

A set of tools enabling Etsy sellers to see who is "hearting" them or their items and whether their work has been featured in various promotional sections of Etsy. By Julian Lievano and Karena Colquhoun.

url: http://www.craftcult.com/heartomatic.php

TimesPeople Google Gadget

Fri, 27 Feb 2009 23:13:13 -0500

The TimesPeople Google Gadget lets you see what articles and blog posts nytimes.com users are recommending and commenting on from your Gmail account. By Michael Donohoe.

url: http://www.ifelse.org/projects/gadgets/timespeople/index.html

Unfluence

Sun, 04 May 2008 22:40:24 -0400

Interactive network maps of U.S. state-level political contribution data.

url: http://unfluence.primate.net/index.html

Shared Board Members of America's Big Companies

Mon, 21 Apr 2008 20:06:44 -0400

Graphical network showing companies that share board members and CEOs. Created using data extracted from SEC filings and entered into Freebase.

url: http://blog.freebase.com/2008/04/09/visualizing-corporate-america/

ExxonSecrets

Mon, 21 Apr 2008 03:40:21 -0400

Greenpeace research project which uses the TheyRule mapping interface to explore how climate change skeptics receive funding from ExxonMobil.

url: http://www.exxonsecrets.org/maps.php

Enron Explorer

Tue, 08 Apr 2008 21:20:16 -0400

Application for exploring the Enron Email Dataset, including a Visualiser for seeing each person's social network based on their email activity. Developed as a technology demonstrator for Trampoline Systems' SONAR platform.

url: http://enron.trampolinesystems.com/

They Rule

Mon, 07 Apr 2008 23:23:09 -0400

They Rule allows you to create maps of the interlocking directories of the top companies in the US in 2004.

url: http://theyrule.net/