Datamob: infrastructure

FCC License View API and Dataset

Sun, 26 Sep 2010 17:15:02 -0400

The FCC issues licenses for use of the United States' airwaves and other purposes. The FCC License View API provides snapshots such as the number of licenses across different services, how many licenses different entities have, and how many licenses are up for renewal in the near future.

Sample call:

http://data.fcc.gov/api/license-view/basicSearch/getLicenses?searchValue=Verizon%20Wireless&format=jsonp&callback=?

The complete set of data in the License View database is also available for download.

url: http://reboot.fcc.gov/developer/license-view-api

Consumer Broadband Test API

Sun, 26 Sep 2010 17:05:12 -0400

Returns the Consumer Broadband Test speed test statistics for a U.S. County given the passed Latitude and Longitude. The statistics are grouped into wireline and wireless and are the number of tests, average download speed, average upload speed, maximum download speed and maximum upload speed. This data is calculated nightly and includes all tests to date performed through the consumer broadband test.

From the Federal Communications Commission.

url: http://reboot.fcc.gov/developer/consumer-broadband-test-api

New York City Subway Data

Sat, 10 Jul 2010 13:23:18 -0400

Official New York City MTA subway, bus and commuter rail schedule data, service status data, performance data, turnstile data, traffic and usage data. Available in General Transit Feed Specification (GTFS) format, XML, CSV and plain text formats.

url: http://www.mta.info/developers/

The Pirate Bay Dataset

Sun, 25 Apr 2010 12:48:35 -0400

Dataset containing the metadata of 679,515 unique torrents from The Pirate Bay, one of the most popular BitTorrent trackers. For each torrent, the following metadata is included: ID of the torrent, category, torrent size, number of leechers, number of seeders. Collected on December 5th, 2008. CSV format.

Compiled by the Communications Systems Research Group CSG at the Computer Science Department of the University of Zurich, Switzerland.

url: http://www.csg.uzh.ch/publications/data/piratebay

Grid Workloads Archive

Thu, 18 Feb 2010 06:30:16 -0500

The primary purpose of the Grid Workloads Archive (GWA) is to provide (anonymized) workload traces from grid environments to researchers and to practitioners alike. The GWA contains long-term workload traces taken from grid systems, and tools for their analysis. A complete description of the GWA can be found in [1].

[1] Alexandru Iosup, Hui Li, Mathieu Jan, Shanny Anoep, Catalin Dumitrescu, Lex Wolters, Dick H. J. Epema: The Grid Workloads Archive. Future Generation Comp. Syst. 24(7): 672-686 (2008) http://dx.doi.org/10.1016/j.future.2008.02.003

Submitted by S. Gam

url: http://gwa.ewi.tudelft.nl/

Failure Trace Archive

Fri, 15 Jan 2010 00:52:45 -0500

The Failure Trace Archive (FTA) is centralized public repository of availability traces of parallel and distributed systems, and tools for their analysis. The purpose of this archive is to facilitate the design, validation and comparison of fault-tolerant models and algorithms.

Submitted by Jeremy Cowles

url: http://fta.inria.fr/apache2-default/pmwiki/index.php?n=Main.DataSets

Transport for London API

Fri, 04 Sep 2009 22:23:20 -0400

Programmatically access information on all forms of public transport in London. The ‘Tube this weekend’ feed contains information on planned line and station closures for the coming weekend. The ’Station location’ feed is a geo-coded KML feed of most London Underground, Docklands Light Railway and London Overground stations. The 'Findaride' KML feed contains details of licensed London minicab and other private-hire operators. Registration required.

url: http://www.tfl.gov.uk/businessandpartners/syndication/

Unofficial Chicago Transit Authority API

Sun, 10 May 2009 12:19:33 -0400

An unofficial, RESTful API for the Chicago Transit Authority. Get data for bus locations and routes. Results returned in XML. By Harper Reed.

url: http://chicagowiki.transitapi.com/Home

BART API

Tue, 09 Dec 2008 20:58:39 -0500

Developer-friendly real-time estimated time of arrival (ETA) feeds, transit schedules, advisory feeds and trip planning information for Bay Area Rapid Transit (BART), serving the San Francisco Bay Area in California. RESTful API returning results in XML. Licensed under a simple License Agreement with no usage limitations.

url: http://bart.gov/developers

DIMES Project Data

Wed, 30 Apr 2008 21:25:27 -0400

Data from the DIMES Project, a distributed scientific research project aiming to study and map the structure and topology of the internet. CSV format.

url: http://www.netdimes.org/DIMESControlCenter/MonthlyData.jsp

FAA Data & Statistics

Fri, 25 Apr 2008 18:11:27 -0400

U.S. aviation data, downloadable in ASCII text and Microsoft Excel formats.

url: http://www.faa.gov/data_statistics/

National Bridge Inventory Data

Fri, 25 Apr 2008 16:56:55 -0400

Data on 600,000 U.S. bridges. ASCII text.

url: http://www.fhwa.dot.gov/bridge/nbi/ascii.cfm

Navajo Nation Water Quality Project

Sun, 23 Jan 2011 18:42:52 -0500

The Navajo Nation Water Quality Project makes Navajo Nation water quality information available for the first time online.

Many parts of the Navajo Indian reservation in the southwestern U.S. are contaminated with radioactive debris left over from Cold War uranium mining. The U.S. Environmental Protection Agency did extensive water sampling in the 1990s to determine which Navajo water sources were contaminated and which were safe to drink from, but this data was never made available to the public in an accessible form. The Navajo Nation Water Quality project seeks to address that.

A joint project of Groundswell Educational Films and the Northwestern University Chemistry Department.

url: http://navajowater.org/

Train Delay NYC

Wed, 22 Dec 2010 11:23:47 -0500

An iOS app for checking the status of New York City trains and buses.

By Scott Bossak.

url: http://traindelaynyc.com/

FlightCaster

Sat, 10 Jul 2010 13:56:33 -0400

FlightCaster is a mobile application that predicts flight delays, using an advanced algorithm that scours data on every U.S. domestic flight for the past 10 years and matches it to real-time conditions.

By FlightCaster, Inc.

url: http://flightcaster.com/

Exit Strategy NYC

Sat, 10 Jul 2010 13:37:25 -0400

Exit Strategy NYC is a mobile application that shows you where to stand on a given New York City subway platform, so you can board the train at the right position to arrive directly in front of the exit at your destination station. No phone service or wifi is needed.

By Jonathan and Ashley Wegener.

url: http://www.exitstrategynyc.com/

London Underground Live

Fri, 25 Jun 2010 00:05:07 -0400

Map showing all trains on the London Underground in approximately real time.

By Matthew Somerville, Frances Berriman and James Aylett.

url: http://traintimes.org.uk:81/map/tube/

Ride the City

Sun, 28 Mar 2010 15:16:48 -0400

Ride the City helps bicyclists find safe bike routes in major cities, including New York City, Chicago, Austin, San Diego, Seattle and Louisville.

Uses LION centerline data from NYC Data Mine.

By Vaidila Kungys and Jordan Anderson.

url: http://www.ridethecity.com/

California Stimulus Map

Fri, 04 Sep 2009 21:56:56 -0400

View information about projects in California known to have received funding from the federal government through the American Recovery and Reinvestment Act (Recovery Act). By Stamen Design.

Map data is available for download as a CSV.

url: http://www.recovery.ca.gov/HTML/RecoveryImpact/map.shtml

FlyOnTime.us

Sun, 19 Jul 2009 11:10:06 -0400

Find out how late your U.S. flight is on average or find the most on-time flight from one city to another. By Josh Sulkin.

The source code for FlyOnTime.us is licensed under an MIT License and available here. There is also a FlyOnTime.us API with data presented on the website available in JSON and XML formats.

url: http://www.flyontime.us/

Stimulus Watch

Sat, 07 Feb 2009 11:48:37 -0500

Find, view, sort and discuss local projects that are candidates for funding by United States federal grant programs when the American Recovery and Reinvestment Act passes. The projects come from the U.S. Conference of Mayors' Main Street Economic Recovery Report. Download dataset in Excel here.

url: http://stimuluswatch.org/

iLive.at

Sun, 25 Jan 2009 21:59:06 -0500

Enter a Washington, D.C. address and receive information tailored to that location and organized into categories like Errands, Emergencies, Recently Reported Crimes, People, Transportation and "Did You Know?" Built by Travis Hurant, Tim Koelkebeck and Brian Sobel for Apps for Democracy competition.

url: http://www.ilive.at/

San Francisco Walkability Map

Wed, 30 Jul 2008 23:09:59 -0400

Detailed map of the most walkable sections of San Francisco, CA, using data from Walk Score. Created with Processing. Scraping code available for download. By Lee Byron.

url: http://leebyron.com/how/2008/07/13/mapping-walkability-san-francisco/

Walk Score

Wed, 30 Jul 2008 22:52:21 -0400

Ranks U.S. addresses by walkability by means of Walk Scores. By Front Seat civic software.

url: http://www.walkscore.com/

Botnet Visualization

Fri, 09 May 2008 23:21:26 -0400

Annotated, interactive map of a botnet. By David Vorel and Scott Berinato for CSO Online.

url: http://www.csoonline.com/article/348317/What_a_Botnet_Looks_Like

Internet Map

Wed, 30 Apr 2008 21:33:48 -0400

Set of visualizations showing how cities around the world are interconnected via internet router configurations. 89,344 connections mapped in all. By Chris Harrison.

url: http://www.chrisharrison.net/projects/InternetMap/index.html

Flight Patterns

Fri, 25 Apr 2008 18:22:13 -0400

Animated visualizations of U.S. air traffic data.

url: http://users.design.ucla.edu/%7Eakoblin/work/faa/index.html