Open Data

TAP Summit

TAP Summit

2011-07-30

Jeff Schuler

jeff@websubstrate.com

@jeffschuler

Presenter Notes

We will talk tech, but don't worry

OMG WTF BBQ

  • machine-readability
  • CSV
  • PDF
  • XML
  • JSON
  • API
  • REST
  • WSDL

Presenter Notes

Slides, backchannel

These slides (HTML5): http://bit.ly/tap-open-data -- Press 'h' for help.

QR Code

Markdown text only: http://bit.ly/tap-open-data-md

Twitter: #CuyTAP, #opendata

Presenter Notes

Goals

  • Find common understanding of Open Data.
  • Share best-in-class examples of Open Data in government.
  • Understand advantages of publicly releasing datasets in machine-readable form.
  • Address implementation details: data formats and moving from data sets to data services.
  • Identify available local resources, desired improvements, and starting points.
  • Form plan for continued discussion and action.

Presenter Notes

Roles & Guidelines

  • Timekeeper & Scribe
  • Stepping Up and Stepping Back

Presenter Notes

Who's Here?

  • Technologists?
  • Software/Web Developers?
  • Designers?
  • Researchers?
  • GIS?
  • Funders?
  • County?

...

Around the room

Presenter Notes

Defining Open Data

"Open Data is the idea that certain data should be freely available to everyone to use and republish as they wish, without restrictions,"

-- http://en.wikipedia.org/wiki/Open_data

Presenter Notes

Principles

  • Completeness: all raw information
  • Primacy primary source data; allows verification
  • Timeliness: maximize usefulness
  • Easy of Physical and Electronic Access
  • Machine readability
  • Non-discrimination: who can access
  • Use of Commonly Owned Standards: Open standards. (MS Office is not an open standard!)
  • Licensing: remove barriers, public domain
  • Permanence: version-tracking and archiving
  • Usage Costs: precludes transformative uses

-- Sunlight Foundation: Ten Principles for Opening Up Government Information http://sunlightfoundation.com/policy/documents/ten-open-data-principles/

Presenter Notes

Machine readability

Creative Uses

  • data visualization
  • web apps
  • mobile apps
  • mashups

Efficiency at County level

Don't have to create everything, just provide the data.

Presenter Notes

Data Formats

Once all data is being exposed, the next goal should be to provide in at least one well-known, machine readable format. Preferably these should be made available in bulk as that is the most common use case and will save server time/bandwidth in the long run. An API allowing access to individual bills, etc. is nice, but not as important or accessible as bulk access.

Suggested formats, in order of preference based on ease of use:

  • Structured
    • JSON, CSV, XML
    • Other Formats: SQL Dump, DBF, Excel, etc.
  • Semi-structured: HTML/Plain Text
  • Worst Case: PDF only

-- http://code.google.com/p/openstates/wiki/StateBestPractices

Presenter Notes

Initiatives: Federal

Presenter Notes

Data.gov

http://data.gov/

Data.gov

Presenter Notes

The Federal IT Dashboard

http://www.itdashboard.gov/

Fed IT Dashboard

Presenter Notes

Reboot.FCC.gov

.notes: APIs .notes: "What datasets...?" http://reboot.fcc.gov/reform/data

http://reboot.fcc.gov/

Reboot.FCC.gov

Presenter Notes

Initiatives: Other States, Cities

Presenter Notes

Presenter Notes

CivicApps for Greater Portland

http://www.civicapps.org/datasets

CivicApps for Greater Portland

Presenter Notes

Apps for Metro Chicago

http://www.appsformetrochicago.com/

Apps for Metro Chicago

Presenter Notes

New York State Senate

http://www.nysenate.gov/developers/

New York State Senate

Presenter Notes

Presenter Notes

Discussion: Models

  • What do we like?
  • Which models might best apply here?
  • What else can we envision locally?

Presenter Notes

Local Resources

Presenter Notes

Cleveland.com Data Central

http://www.cleveland.com/datacentral/

Cleveland.com Data Central

Presenter Notes

Presenter Notes

Presenter Notes

Cuyahoga County

Presenter Notes

Presenter Notes

More County/local examples?

Presenter Notes

Discussion: County

  • What's possible?
  • Barriers/Hurdles
  • Costs: Savings & Expenses
  • What commitments exist?
  • What commitments should/can be made?

Presenter Notes

Misc

Presenter Notes

Presenter Notes

Google Public Data Explorer

http://www.google.com/publicdata

Google Public Data Explorer

Presenter Notes

Sunlight Foundation

http://sunlightfoundation.com/

Presenter Notes

Flu App Challenge

http://fluapp.challenge.gov/

Flu App Challenge

Presenter Notes

Code for America

http://codeforamerica.org/

Code for America

Presenter Notes

Discussion: Starting Points

  • Types of Data
  • Low-hanging Fruit
  • Clearinghouse
  • On-going...

Presenter Notes

Pilot Project

Please come to Mobile and Web Apps this afternoon!

Presenter Notes