Table of contents
  1. Fact Checking EnergyData.gov: Claims Come Up Short
  2. Story
  3. Spotfire Dashboard
  4. Research Notes
  5. Energy Datapalooza: Unleashing the Power of Open Data to Advance our Energy Future
  6. Energy Datapalooza Fact Sheet
    1. Administration Announcements
      1. New Application Programming Interfaces (APIs)
        1. Electricity API
        2. Fuel Economy API
        3. Environmental APIs
        4. Biomass API
      2. New Data for Entrepreneurs and Innovators
        1. Energy.Data.Gov
        2. 20 new Datasets from DOE
      3. New Events and Challenges
        1. Vehicles Data Challenge: Improving Safety and Fuel Efficiency through Technology Innovation
        2. SXSW ECO Code-a-thon
      4. New Green Button Integration
        1. Home Energy Yardstick
    2. Private Sector Committments
      1. Green Button Commitments
        1. New utility commitments expand Green Button Download My Data to include nearly 5 million new U.S. households and businesses
        2. New commitments to Green Button Connect My Data capabilities
        3. New companies commit to use the Green Button standard
      2. New Consumer Data Protections
        1. Privacy Seal Program
  7. Data.gov/Energy Beta
    1. Home
    2. Special Features
    3. Welcome
    4. Energy Data Initiative
    5. Challenges
    6. Sitemap
    7. Data/Tools
    8. Apps
      1. Mobile Apps
        1. AIRNow
        2. Alternate Fuel Locator
        3. Fuel Economy.gov
        4. Sustainable Facilities Tool
        5. EPA Mobile
      2. Web Apps
    9. Maps
    10. Challenges
      1. Open Challenges
        1. Apps for Energy
        2. Build your own challenge for energy efficiency
        3. Rooftop Solar Challenge
      2. Check Out the Winners From These Previous Challenges
        1. Code for Livability
        2. 2011 ENERGY STAR National Building Competition: Battle of the Buildings
        3. America’s Home Energy Education Challenge
        4. Apps for the Environment
        5. Data Visualization Student Challenge
        6. NASA's Green Flight Challenge
        7. What's your energy innovation?
        8. 2011 Presidential Green Chemistry Challenge awards
        9. Sustainable Urban Housing: Collaborating for Liveable and Inclusive Cities
      3. Have Information to Share?
    11. Resources
      1. Federal Data
        1. FERC Natural Gas Storage
        2. NOAA Global Earth Observation — Integrated Data Environment (GEO-IDE)
        3. The Office of Scientific and Technical Information (OSTI)
        4. U.S. Energy Information Administration
      2. Non-Federal Data
        1. California Appliance Efficiency Database
        2. California Commercial Energy End-Use Survey (CEUS)
        3. California Database for Energy Efficiency Resources (DEER)
        4. California Energy Consumption Data Management System
        5. California Renewable Portfolio Standard-Eligible Investor Owned Utility Contract Database
        6. New York: Empire State Oil & Gas Information System
        7. North Carolina Green Technologies Database
        8. NYSERDA Monitored Performance and Operational Statistics
      3. General References
        1. Building Rating.org
        2. Carbon Cycle 2.0
        3. Database of State Incentives for Renewables & Efficiency (DSIRE)
        4. Electricity Sector Information Sharing and Analysis Center (ES-ISAC)
        5. Natural Association of Regulatory Utility Commissioners (NARUC)
        6. NERC Assessments and Tools
        7. NREL Energy Analysis Division
        8. NREL Renewable Energy Certificate and Green Power Markets
        9. NREL Technology and Program Market Data
        10. OMB Sustainability and Energy Scorecards
        11. US Department of Energy – Energy Efficiency & Renewable Energy: National Weatherization Training Portal
    12. Blogs
      1. Interested in Open Energy Data? Watch the Energy Datapalooza Live!
      2. Celebrating Innovation and Open Data at the Energy Datapalooza
      3. Web Tool for Planning Green Projects
      4. Harnessing Energy Data to Help Your Pocketbook and the Planet
      5. Open Data for a Clean, Secure Energy Future
      6. Energy Powerball
      7. Unlocking the Power of Energy Data
      8. Unconferences, Hack-A-Thons, and a Code for Livability
      9. Data, Apps, and Maps: Working Toward a GreenGov
      10. Historical Federal Government Energy Use Data Available
      11. Creating the Emissions and Generation Resource Integrated Database (eGRID)
        1. Data Summary
        2. Uses of eGRID
        3. Accessing eGRID Data
        4. Future Plans
        5. Author information
      12. More than 1000 votes for Popular Choice GreenApp Fueled by Communities, Engagement
      13. Modeling a Green Energy Challenge after a Blue Button
      14. Join the Energy.Data.gov community
      15. Welcome to Energy.Data.gov
    13. Forums
    14. The Energy Data Initiative
  8. Energy Datapalooza
  9. Let us know about your Energy Apps!
    1. Historical Federal Government Energy Use Data Available
    2. Green Button Initative
      1. Green Button is live in California
      2. Apps Using Green Button Data
        1. Best Student App Grand Prize
        2. EcoDog Green Button Tool
        3. Energy Insight
        4. EnergyAi
        5. Genability Explorer
        6. People Power 1.0
        7. PlotWatt
        8. Simple Energy
    3. Celebrating Our Apps for Energy Developers
      1. WHAT ARE THE KEY FACTS?
      2. BEST OVERALL APP GRAND PRIZE: LEAFULLY
      3. BEST OVERALL APP SECOND PRIZE: MELON
      4. BEST OVERALL APP THIRD PRIZE:  VELOBILL
      5. BEST STUDENT APP GRAND PRIZE: WOTZ
      6. BEST STUDENT APP SECOND PRIZE: BUDGET IT YOURSELF
    4. Code for Livability
      1. Come Join Us in Creating Livable Communities!
      2. Highlighted Data
      3. What's Already Been Done?  
      4. Get Recognized, Feel Rewarded
    5. Battle of the Buildings
      1. Update
      2. About the Challenge
      3. Important dates
    6. America’s Home Energy Education Challenge
    7. Apps for the Environment
  10. Green Button Develop
    1. SAMPLE DATA
    2. SAMPLE REGIONAL CUSTOMER DATA COURTESY OF SDG&E
    3. ADDITIONAL TECHNICAL RESOURCES
      1. NIST Smart Grid Interoperability Panel
      2. ESPI Standards Development
      3. Testing and Certification
      4. Reference Implementations and Developer Tools
      5. Developmental Green Button Test Web Site
    4. GRID-INTEROP 2011 GREEN BUTTON LIVE DEMO - DEC 2011
    5. SAMPLE DATA MANIPULATION -- CHARTING AND TABULAR OUTPUT
      1. Charting
      2. Usage Information
      3. Tabular Output
        1. Data for period starting: 03-01-2012 00:00  for 1 day
        2. Data for period starting: 03-02-2012 00:00  for 1 day
        3. Data for period starting: 03-03-2012 00:00  for 1 day
        4. Data for period starting: 03-04-2012 00:00  for 1 day
        5. Data for period starting: 03-05-2012 00:00  for 1 day
        6. Data for period starting: 03-06-2012 00:00  for 1 day
        7. Data for period starting: 03-07-2012 00:00  for 1 day
        8. Data for period starting: 03-08-2012 00:00  for 1 day
        9. Data for period starting: 03-09-2012 00:00  for 1 day
        10. Data for period starting: 03-10-2012 00:00  for 1 day
        11. Data for period starting: 03-11-2012 00:00  for 23 hours
        12. Data for period starting: 03-11-2012 23:00  for 1 day
        13. Data for period starting: 03-12-2012 23:00  for 1 day
        14. Data for period starting: 03-13-2012 23:00  for 1 day
  11. Tweets
  12. NEXT

EnergyData.gov

Last modified
Table of contents
  1. Fact Checking EnergyData.gov: Claims Come Up Short
  2. Story
  3. Spotfire Dashboard
  4. Research Notes
  5. Energy Datapalooza: Unleashing the Power of Open Data to Advance our Energy Future
  6. Energy Datapalooza Fact Sheet
    1. Administration Announcements
      1. New Application Programming Interfaces (APIs)
        1. Electricity API
        2. Fuel Economy API
        3. Environmental APIs
        4. Biomass API
      2. New Data for Entrepreneurs and Innovators
        1. Energy.Data.Gov
        2. 20 new Datasets from DOE
      3. New Events and Challenges
        1. Vehicles Data Challenge: Improving Safety and Fuel Efficiency through Technology Innovation
        2. SXSW ECO Code-a-thon
      4. New Green Button Integration
        1. Home Energy Yardstick
    2. Private Sector Committments
      1. Green Button Commitments
        1. New utility commitments expand Green Button Download My Data to include nearly 5 million new U.S. households and businesses
        2. New commitments to Green Button Connect My Data capabilities
        3. New companies commit to use the Green Button standard
      2. New Consumer Data Protections
        1. Privacy Seal Program
  7. Data.gov/Energy Beta
    1. Home
    2. Special Features
    3. Welcome
    4. Energy Data Initiative
    5. Challenges
    6. Sitemap
    7. Data/Tools
    8. Apps
      1. Mobile Apps
        1. AIRNow
        2. Alternate Fuel Locator
        3. Fuel Economy.gov
        4. Sustainable Facilities Tool
        5. EPA Mobile
      2. Web Apps
    9. Maps
    10. Challenges
      1. Open Challenges
        1. Apps for Energy
        2. Build your own challenge for energy efficiency
        3. Rooftop Solar Challenge
      2. Check Out the Winners From These Previous Challenges
        1. Code for Livability
        2. 2011 ENERGY STAR National Building Competition: Battle of the Buildings
        3. America’s Home Energy Education Challenge
        4. Apps for the Environment
        5. Data Visualization Student Challenge
        6. NASA's Green Flight Challenge
        7. What's your energy innovation?
        8. 2011 Presidential Green Chemistry Challenge awards
        9. Sustainable Urban Housing: Collaborating for Liveable and Inclusive Cities
      3. Have Information to Share?
    11. Resources
      1. Federal Data
        1. FERC Natural Gas Storage
        2. NOAA Global Earth Observation — Integrated Data Environment (GEO-IDE)
        3. The Office of Scientific and Technical Information (OSTI)
        4. U.S. Energy Information Administration
      2. Non-Federal Data
        1. California Appliance Efficiency Database
        2. California Commercial Energy End-Use Survey (CEUS)
        3. California Database for Energy Efficiency Resources (DEER)
        4. California Energy Consumption Data Management System
        5. California Renewable Portfolio Standard-Eligible Investor Owned Utility Contract Database
        6. New York: Empire State Oil & Gas Information System
        7. North Carolina Green Technologies Database
        8. NYSERDA Monitored Performance and Operational Statistics
      3. General References
        1. Building Rating.org
        2. Carbon Cycle 2.0
        3. Database of State Incentives for Renewables & Efficiency (DSIRE)
        4. Electricity Sector Information Sharing and Analysis Center (ES-ISAC)
        5. Natural Association of Regulatory Utility Commissioners (NARUC)
        6. NERC Assessments and Tools
        7. NREL Energy Analysis Division
        8. NREL Renewable Energy Certificate and Green Power Markets
        9. NREL Technology and Program Market Data
        10. OMB Sustainability and Energy Scorecards
        11. US Department of Energy – Energy Efficiency & Renewable Energy: National Weatherization Training Portal
    12. Blogs
      1. Interested in Open Energy Data? Watch the Energy Datapalooza Live!
      2. Celebrating Innovation and Open Data at the Energy Datapalooza
      3. Web Tool for Planning Green Projects
      4. Harnessing Energy Data to Help Your Pocketbook and the Planet
      5. Open Data for a Clean, Secure Energy Future
      6. Energy Powerball
      7. Unlocking the Power of Energy Data
      8. Unconferences, Hack-A-Thons, and a Code for Livability
      9. Data, Apps, and Maps: Working Toward a GreenGov
      10. Historical Federal Government Energy Use Data Available
      11. Creating the Emissions and Generation Resource Integrated Database (eGRID)
        1. Data Summary
        2. Uses of eGRID
        3. Accessing eGRID Data
        4. Future Plans
        5. Author information
      12. More than 1000 votes for Popular Choice GreenApp Fueled by Communities, Engagement
      13. Modeling a Green Energy Challenge after a Blue Button
      14. Join the Energy.Data.gov community
      15. Welcome to Energy.Data.gov
    13. Forums
    14. The Energy Data Initiative
  8. Energy Datapalooza
  9. Let us know about your Energy Apps!
    1. Historical Federal Government Energy Use Data Available
    2. Green Button Initative
      1. Green Button is live in California
      2. Apps Using Green Button Data
        1. Best Student App Grand Prize
        2. EcoDog Green Button Tool
        3. Energy Insight
        4. EnergyAi
        5. Genability Explorer
        6. People Power 1.0
        7. PlotWatt
        8. Simple Energy
    3. Celebrating Our Apps for Energy Developers
      1. WHAT ARE THE KEY FACTS?
      2. BEST OVERALL APP GRAND PRIZE: LEAFULLY
      3. BEST OVERALL APP SECOND PRIZE: MELON
      4. BEST OVERALL APP THIRD PRIZE:  VELOBILL
      5. BEST STUDENT APP GRAND PRIZE: WOTZ
      6. BEST STUDENT APP SECOND PRIZE: BUDGET IT YOURSELF
    4. Code for Livability
      1. Come Join Us in Creating Livable Communities!
      2. Highlighted Data
      3. What's Already Been Done?  
      4. Get Recognized, Feel Rewarded
    5. Battle of the Buildings
      1. Update
      2. About the Challenge
      3. Important dates
    6. America’s Home Energy Education Challenge
    7. Apps for the Environment
  10. Green Button Develop
    1. SAMPLE DATA
    2. SAMPLE REGIONAL CUSTOMER DATA COURTESY OF SDG&E
    3. ADDITIONAL TECHNICAL RESOURCES
      1. NIST Smart Grid Interoperability Panel
      2. ESPI Standards Development
      3. Testing and Certification
      4. Reference Implementations and Developer Tools
      5. Developmental Green Button Test Web Site
    4. GRID-INTEROP 2011 GREEN BUTTON LIVE DEMO - DEC 2011
    5. SAMPLE DATA MANIPULATION -- CHARTING AND TABULAR OUTPUT
      1. Charting
      2. Usage Information
      3. Tabular Output
        1. Data for period starting: 03-01-2012 00:00  for 1 day
        2. Data for period starting: 03-02-2012 00:00  for 1 day
        3. Data for period starting: 03-03-2012 00:00  for 1 day
        4. Data for period starting: 03-04-2012 00:00  for 1 day
        5. Data for period starting: 03-05-2012 00:00  for 1 day
        6. Data for period starting: 03-06-2012 00:00  for 1 day
        7. Data for period starting: 03-07-2012 00:00  for 1 day
        8. Data for period starting: 03-08-2012 00:00  for 1 day
        9. Data for period starting: 03-09-2012 00:00  for 1 day
        10. Data for period starting: 03-10-2012 00:00  for 1 day
        11. Data for period starting: 03-11-2012 00:00  for 23 hours
        12. Data for period starting: 03-11-2012 23:00  for 1 day
        13. Data for period starting: 03-12-2012 23:00  for 1 day
        14. Data for period starting: 03-13-2012 23:00  for 1 day
  11. Tweets
  12. NEXT

  1. Fact Checking EnergyData.gov: Claims Come Up Short
  2. Story
  3. Spotfire Dashboard
  4. Research Notes
  5. Energy Datapalooza: Unleashing the Power of Open Data to Advance our Energy Future
  6. Energy Datapalooza Fact Sheet
    1. Administration Announcements
      1. New Application Programming Interfaces (APIs)
        1. Electricity API
        2. Fuel Economy API
        3. Environmental APIs
        4. Biomass API
      2. New Data for Entrepreneurs and Innovators
        1. Energy.Data.Gov
        2. 20 new Datasets from DOE
      3. New Events and Challenges
        1. Vehicles Data Challenge: Improving Safety and Fuel Efficiency through Technology Innovation
        2. SXSW ECO Code-a-thon
      4. New Green Button Integration
        1. Home Energy Yardstick
    2. Private Sector Committments
      1. Green Button Commitments
        1. New utility commitments expand Green Button Download My Data to include nearly 5 million new U.S. households and businesses
        2. New commitments to Green Button Connect My Data capabilities
        3. New companies commit to use the Green Button standard
      2. New Consumer Data Protections
        1. Privacy Seal Program
  7. Data.gov/Energy Beta
    1. Home
    2. Special Features
    3. Welcome
    4. Energy Data Initiative
    5. Challenges
    6. Sitemap
    7. Data/Tools
    8. Apps
      1. Mobile Apps
        1. AIRNow
        2. Alternate Fuel Locator
        3. Fuel Economy.gov
        4. Sustainable Facilities Tool
        5. EPA Mobile
      2. Web Apps
    9. Maps
    10. Challenges
      1. Open Challenges
        1. Apps for Energy
        2. Build your own challenge for energy efficiency
        3. Rooftop Solar Challenge
      2. Check Out the Winners From These Previous Challenges
        1. Code for Livability
        2. 2011 ENERGY STAR National Building Competition: Battle of the Buildings
        3. America’s Home Energy Education Challenge
        4. Apps for the Environment
        5. Data Visualization Student Challenge
        6. NASA's Green Flight Challenge
        7. What's your energy innovation?
        8. 2011 Presidential Green Chemistry Challenge awards
        9. Sustainable Urban Housing: Collaborating for Liveable and Inclusive Cities
      3. Have Information to Share?
    11. Resources
      1. Federal Data
        1. FERC Natural Gas Storage
        2. NOAA Global Earth Observation — Integrated Data Environment (GEO-IDE)
        3. The Office of Scientific and Technical Information (OSTI)
        4. U.S. Energy Information Administration
      2. Non-Federal Data
        1. California Appliance Efficiency Database
        2. California Commercial Energy End-Use Survey (CEUS)
        3. California Database for Energy Efficiency Resources (DEER)
        4. California Energy Consumption Data Management System
        5. California Renewable Portfolio Standard-Eligible Investor Owned Utility Contract Database
        6. New York: Empire State Oil & Gas Information System
        7. North Carolina Green Technologies Database
        8. NYSERDA Monitored Performance and Operational Statistics
      3. General References
        1. Building Rating.org
        2. Carbon Cycle 2.0
        3. Database of State Incentives for Renewables & Efficiency (DSIRE)
        4. Electricity Sector Information Sharing and Analysis Center (ES-ISAC)
        5. Natural Association of Regulatory Utility Commissioners (NARUC)
        6. NERC Assessments and Tools
        7. NREL Energy Analysis Division
        8. NREL Renewable Energy Certificate and Green Power Markets
        9. NREL Technology and Program Market Data
        10. OMB Sustainability and Energy Scorecards
        11. US Department of Energy – Energy Efficiency & Renewable Energy: National Weatherization Training Portal
    12. Blogs
      1. Interested in Open Energy Data? Watch the Energy Datapalooza Live!
      2. Celebrating Innovation and Open Data at the Energy Datapalooza
      3. Web Tool for Planning Green Projects
      4. Harnessing Energy Data to Help Your Pocketbook and the Planet
      5. Open Data for a Clean, Secure Energy Future
      6. Energy Powerball
      7. Unlocking the Power of Energy Data
      8. Unconferences, Hack-A-Thons, and a Code for Livability
      9. Data, Apps, and Maps: Working Toward a GreenGov
      10. Historical Federal Government Energy Use Data Available
      11. Creating the Emissions and Generation Resource Integrated Database (eGRID)
        1. Data Summary
        2. Uses of eGRID
        3. Accessing eGRID Data
        4. Future Plans
        5. Author information
      12. More than 1000 votes for Popular Choice GreenApp Fueled by Communities, Engagement
      13. Modeling a Green Energy Challenge after a Blue Button
      14. Join the Energy.Data.gov community
      15. Welcome to Energy.Data.gov
    13. Forums
    14. The Energy Data Initiative
  8. Energy Datapalooza
  9. Let us know about your Energy Apps!
    1. Historical Federal Government Energy Use Data Available
    2. Green Button Initative
      1. Green Button is live in California
      2. Apps Using Green Button Data
        1. Best Student App Grand Prize
        2. EcoDog Green Button Tool
        3. Energy Insight
        4. EnergyAi
        5. Genability Explorer
        6. People Power 1.0
        7. PlotWatt
        8. Simple Energy
    3. Celebrating Our Apps for Energy Developers
      1. WHAT ARE THE KEY FACTS?
      2. BEST OVERALL APP GRAND PRIZE: LEAFULLY
      3. BEST OVERALL APP SECOND PRIZE: MELON
      4. BEST OVERALL APP THIRD PRIZE:  VELOBILL
      5. BEST STUDENT APP GRAND PRIZE: WOTZ
      6. BEST STUDENT APP SECOND PRIZE: BUDGET IT YOURSELF
    4. Code for Livability
      1. Come Join Us in Creating Livable Communities!
      2. Highlighted Data
      3. What's Already Been Done?  
      4. Get Recognized, Feel Rewarded
    5. Battle of the Buildings
      1. Update
      2. About the Challenge
      3. Important dates
    6. America’s Home Energy Education Challenge
    7. Apps for the Environment
  10. Green Button Develop
    1. SAMPLE DATA
    2. SAMPLE REGIONAL CUSTOMER DATA COURTESY OF SDG&E
    3. ADDITIONAL TECHNICAL RESOURCES
      1. NIST Smart Grid Interoperability Panel
      2. ESPI Standards Development
      3. Testing and Certification
      4. Reference Implementations and Developer Tools
      5. Developmental Green Button Test Web Site
    4. GRID-INTEROP 2011 GREEN BUTTON LIVE DEMO - DEC 2011
    5. SAMPLE DATA MANIPULATION -- CHARTING AND TABULAR OUTPUT
      1. Charting
      2. Usage Information
      3. Tabular Output
        1. Data for period starting: 03-01-2012 00:00  for 1 day
        2. Data for period starting: 03-02-2012 00:00  for 1 day
        3. Data for period starting: 03-03-2012 00:00  for 1 day
        4. Data for period starting: 03-04-2012 00:00  for 1 day
        5. Data for period starting: 03-05-2012 00:00  for 1 day
        6. Data for period starting: 03-06-2012 00:00  for 1 day
        7. Data for period starting: 03-07-2012 00:00  for 1 day
        8. Data for period starting: 03-08-2012 00:00  for 1 day
        9. Data for period starting: 03-09-2012 00:00  for 1 day
        10. Data for period starting: 03-10-2012 00:00  for 1 day
        11. Data for period starting: 03-11-2012 00:00  for 23 hours
        12. Data for period starting: 03-11-2012 23:00  for 1 day
        13. Data for period starting: 03-12-2012 23:00  for 1 day
        14. Data for period starting: 03-13-2012 23:00  for 1 day
  11. Tweets
  12. NEXT

Fact Checking EnergyData.gov: Claims Come Up Short

Published: October 12, 2012

 
Fact Checking EnergyData.gov: Claims Come Up Short
 
After my recent SafetyData.gov review, ("Long On Text, Short On Data Tables"), I was resolved to review the new Energy Data.gov Beta Web Site and check some of the claims presented at the White House's Energy Datapalooza held earlier this month.

I decided the best place to start was the Energy Datapalooza fact sheet because it did not contain any links to actual energy data. Energy Data.gov says "data and insight are combined to facilitate public discussion and awareness of our Nation's energy activities."

So I tried to match the facts to the substance using a knowledge base found elsewhere. Here's what the fact sheet contained – and what I found:

Administration Announcements
  • New Application Programming Interfaces (APIs): 4 – (My comment: I only found three in the Presidential Innovation Fellows Blog and they were not APIs - see below.)
  • New Data for Entrepreneurs and Innovators: 2 – (My comment: Energy.Data.Gov with more than 900 data sets – not really – see below, and 20 new datasets from DOE - actually only 19 that require closer inspection.)
  • New Events and Challenges: 2 – (My comment: At Apps for Energy there are 9 winners from 56 submissions with no new challenges.)
  • New Green Button Integration – (My question: Where do I find how to do this? See below for the work it requires.)
Private Sector Committments
  • Green Button Commitments: Future promises
  • New Consumer Data Protections: Future promises
The three "APIs":

 API for electricity generation, consumption and retail sales from the Energy Information Administration – (My comment: You download the data as Excel.)

• API for the "Find and Compare Cars" data on the FuelEconomy.gov site – (My comment: You download the data as a ZIP of CSV.)

• API for biomass data from the "Billion Ton Report – (My comment: You register and wait for approval to access the data, but it is not an API. Two days later, I received access, downloaded and unzipped a file that gave me 1.1. GB of DAT files with no specific structure. Not what I want to do!)

These are not APIs, but the DoE Energy Information Agency has APIs in beta testing. So how is this post-Energy Datapalooza Blogstatement true: "One of the most exciting announcements for the web technology community was the official unveiling of three new government APIs that provide rapid access to raw and frequently updated data."

So on to the: "DOE announced that the number of datasets available in Energy.Data.Gov – a central discovery engine for federal government datasets, data visualization tools, mobile apps, and more – has doubled in less than three months. It now contains more than 900 federal datasets and technologies that support a growing open data ecosystem."

As a data scientists I did the same thing I did to audit the new Safety.Data.gov data sets, namely rebuilt the Energy Data.gov catalog as linked data with faceted search so I could provide statistics and visualizations in a dashboard show elsewhere.

Some facts of interest for the "908 federal data sets and technologies are: Only 561 are CSV or XLS out of 908. Only 132 CSV and Excel are from DoE (DoE, DoE EIA, DoE NREL, and DoE OSTI). Many of the titles and description do not seem to relate to energy data sets and technolgies at all! My favorite example was "U.S. Bell and Chile Pepper Statistics".

Next I looked more closely at three real data sets to see if they were usable and useful as follows:
  • Federal Government Energy Use Trends: Total energy use and petroleum use have gone down during during 1975-2007 while use of other forms of energy (natural gas, coal, steam, and other) have remained nearly level.
  • Energy Generation: EPA's Emissions and Generation Resource Integrated Database (eGRID) shows nearly 5500 power plants in the Unites States with their annual CO2 emissions generally increasing with plant capacity, except for one notable exception - the Grand Coulee Dam in Washington State with 6809 Megawatt Capacity (the largest by far) generates zero CO² emissions as do nuclear power plants.
  • Energy Consumption Green Button: This is the new initiative to help consumers see the details of their home energy consumption, but the problem is they have to be able to download and import an XML file into Excel, visualize it and decide what action to take. This is where app developers need to provide tools to simplify this and make the options to reduce energy consumption clear to the average citizen.
Finally, I examined the 183 Tweets and commented on some:

US CIO @StevenVDC: Have now doubled the number of #EnergyData sets on @USDataGov. "Over 900" now. #opendata #egov

Yes, but not all are "energy data sets"

DepAdmin Bob Perciasepe @EPAgov has 40 datasets available on http://data.gov #opendata #energydata 
Actually 92

EPA DepAdmin Bob Perciasepe We have a lot of data, but we can't do this (exploit) ourselves. #energydata #opendata


Why not?

RT @digiphile: .@RiggsKubiak wants to build a "LinkedIn for buildings" at @HonestBuildings: http://bit.ly/GHaFaQ #opendata #energydata 
Good idea!

#Lucid CEO #MichaelMurray describes his work to leverage building #EnergyData to create information dashboards.

Yes, I did that

This is huge. RT @aolgov: More about new energy open data portal at http://bit.ly/U10hmb #energydata #opendata #digitialgov #innovation 
.@DataMarket to launch new #energydata vertical. New interview with CEO @hjalli: http://bit.ly/R78Y8D #strataconf #opendata

Good idea and need to take it a step further to deliver results like I did here!

So there are some usable and useful data sets if one goes looking and has the tools and experience to work with them.

However, this also reminds me of an earlier story on GSA's Energy Usage Analysis System Illustrates Data.gov's Limitations where I had difficulty finding the metadata and any useful results from this large data set featured at Data.gov

At the Health Datapalooza, Todd Park agreed with my comments on the need to audit new Data.gov community web sites to see if they delivered on their claims and could produce innovation.

So my fact checking of the new Energy Data.gov and the Energy Datapalooza found that they come up short on their claims and more work needs to be done to deliver on the facts and demonstrate the value of this activity to decision makers and citizens who are paying for this.

Story

EnergyData.gov: Fact Checking Comes Up Short

In my recent "SafetyData.gov Review: Long On Text, Short On Data Tables", I promised a review of the new Energy Data.gov Beta Web Site and the Energy Datapalooza: Unleashing the Power of Open Data. I decided the best place to start was the Energy Datapalooza Fact Sheet because it did not contain any links to actual energy data. Energy Data.gov says "data and insight are combined to facilitate public discussion and awareness of our Nation’s energy activities." So I tried to match the facts to the substance using a knowledge base found elsewhere.

The Fact Sheet contained the folowing:

Administration Announcements

  • New Application Programming Interfaces (APIs): 4 (My comment: I only found three in the Presidential Innovation Fellows Blog and they were not APIs - see below)
  • New Data for Entrepreneurs and Innovators: 2 (My comment: Energy.Data.Gov with more than 900 data sets - not really - see below, and 20 new Datasets from DOE - actually only 19 that require closer inspection)
  • New Events and Challenges: 2 (My comment: At Apps for Energy there are 9 winners from 56 submissions with no new challenges)
  • New Green Button Integration: My question - Where do I find how to do this? See below for the work it requires.
 
Private Sector Commitments
  • Green Button Commitments: Future promises
  • New Consumer Data Protections: Future promises
 
The three "APIs":
• API for electricity generation, consumption and retail sales from the Energy Information Administration My comment: You download the data as Excel

 API for the “Find and Compare Cars” data on the FuelEconomy.gov site My comment: You download the data as a ZIP of CSV

 API for biomass data from the “Billion Ton Report My comment: You register and wait for approval to access the data, but it is not an API. Two days later, I received access, downloaded and unzipped a file that gave me 1.1. GB of DAT files with no specific structure. Not what I want to do!

These are not APIs, but the DoE Energy Information Agency has APIs in beta testing. So how is this post-Energy Datapalooza Blog statement true: "One of the most exciting announcements for the web technology community was the official unveiling of three new government APIs that provide rapid access to raw and frequently updated data."

 
So on to the: "DOE announced that the number of datasets available in Energy.Data.Gov – a central discovery engine for federal government datasets, data visualization tools, mobile apps, and more – has doubled in less than three months. It now contains more than 900 federal datasets and technologies that support a growing open data ecosystem."
 
As a data scientists I did the same thing I did to audit the new Safety Data.gov data sets, namely rebuilt the Energy Data.gov catalog as linked data with faceted search so I could provide statistics and visualizations in a dashboard show elsewhere.
 
Some facts of interest for the "908 federal data sets and technologies are: Only 561 are CSV or XLS out of 908. Only 132 CSV and Excel are from DoE (DoE, DoE EIA, DoE NREL, and DoE OSTI). Many of the titles and description do not seem to relate to energy data sets and technolgies at all! My favorite example was "U.S. Bell and Chile Pepper Statistics".
 
Next I looked more closely at three real data sets to see if they were usable and useful as follows:
  • Federal Government Energy Use Trends: Total energy use and petroleum use have gone down during during 1975-2007 while use of other forms of energy (natural gas, coal, steam, and other) have remained nearly level.
  • Energy Generation: EPA's Emissions and Generation Resource Integrated Database (eGRID) shows nearly 5500 power plants in the Unites States with their annual CO2 emissions generally increasing with plant capacity, except for one notable exception - the Grand Coulee Dam in Washington State with 6809 Megawatt Capacity (the largest by far) generates zero CO2 emissions as do nuclear power plants.
  • Energy Consumption Green Button: This is the new initiative to help consumers see the details of their home energy consumption, but the problem is they have to be able to download and import an XML file into Excel, visualize it and decide what action to take. This is where app developers need to provide tools to simplify this and make the options to reduce energy consumption clear to the average citizen.
 
Finally, I examined the 183 Tweets and commented on some:
 
US CIO @StevenVDC: Have now doubled the number of #EnergyData sets on @USDataGov. "Over 900" now. #opendata #egov
Yes, but not all are "energy data sets"
 
DepAdmin Bob Perciasepe @EPAgov has 40 datasets available on http://data.gov #opendata #energydata
Actually 92
 
EPA DepAdmin Bob Perciasepe We have a lot of data, but we can't do this (exploit) ourselves. #energydata #opendata
Why not?
 
RT @digiphile: .@RiggsKubiak wants to build a "LinkedIn for buildings" at @HonestBuildings: http://bit.ly/GHaFaQ #opendata #energydata
Good idea!
 
#Lucid CEO #MichaelMurray describes his work to leverage building #EnergyData to create information dashboards.
Yes, I did that
 
This is huge. RT @aolgov: More about new energy open data portal at http://bit.ly/U10hmb #energydata #opendata #digitialgov #innovation
.@DataMarket to launch new #energydata vertical. New interview with CEO @hjalli: http://bit.ly/R78Y8D #strataconf #opendata
Good idea and need to take it a step further to deliver results like I did here!
 
So there are some usable and useful data sets if one goes looking and has the tools and experience to work with them. However, this also  reminds me of an earlier story on GSA's Energy Usage Analysis System Illustrates Data.gov's Limitations where I had difficulty finding the metadata and any useful results from this large data set featured at Data.gov.
 
At the Health Datapalooza, Todd Park agreed with my comments on the need to audit new Data.gov community web sites to see if they delivered on their claims and could produce innovation.
 
So my fact checking of the new Energy Data.gov and Data Palooza found that they come up short on their claims and more work needs to be done to deliver on the facts and demonstrate the value of this activity to decision makers and citizens who are paying for this.

Spotfire Dashboard

For Internet Explorer Users and Those Wanting Full Screen Display Use: Web Player Get Spotfire for iPad App

Error: Embedded data could not be displayed. Use Google Chrome

Research Notes

Search for qualified products at http://go.usa.gov/G4i. WHERE?
 

In Beta: http://www.eia.gov/beta/api/index.cfm

Energy Datapalooza: Unleashing the Power of Open Data to Advance our Energy Future

Source: http://www.whitehouse.gov/blog/2012/10/01/energy-datapalooza-unleashing-power-open-data-advance-our-energy-future

Imagine it is a scorching hot summer day, and your smart phone beeps, asking if you’d like it to raise your home thermostat a degree or two to save money.  Or, envision an easy-to-use software package that lets a building owner perform virtual energy audits at a fraction of the cost of in-person audits, so real savings are calculated instantly, building upgrades launched sooner, and construction jobs created faster.

These are the kinds of advances that are on display today at the White House as more than 150 of America’s entrepreneurs, software developers, energy experts, and policy makers come together for an Energy Datapalooza. The gathering is a chance to celebrate new products, services, and apps that are advancing a secure, clean energy future—all built with freely available data from the government and other sources. 

The event includes demonstrations of mobile apps and web-based services that are available to families and businesses today, as well as previews of future inventions. In addition, Secretary of Energy Steven Chu will honor the winners of the Department of Energy’s inaugural “Apps for Energy” challenge, whose inventions include innovative applications such as: Leafully, which uses creative comparisons to help consumers understand how their actions impact the world and their wallet; Melon Power, which helps building owners easily calculate their Energy Star score; and VELOBill, which makes it easy to visualize energy usage data, compare it to peers, and make a plan to save energy.

The day includes several exciting announcements. The Energy Department is launching a new “Vehicles Data Challenge” aimed at spurring technologies that can increase fuel efficiency and protect against distracted driving.  And utilities and software companies are announcing the launch of “Green Button Connect My Data” in California and the Mid-Atlantic.  Green Button Connect My Data enables energy customers to securely and automatically transfer their own energy data to authorized third parties, if they choose to do so. It builds on previous commitments under the Green Button Initiative to help consumers download their own energy data to their desktops.

The Energy Datapalooza will demonstrate how private-sector entrepreneurs are creating jobs and helping Americans save money, using open data as their fuel. To keep the momentum going, the Energy Department is announcing the release of 20 new datasets, three new application programing interfaces to make data easily accessible by software developers, and hundreds of qualified data links in the Energy.Data.Gov community.

For a full list of announcements from the Energy Datapalooza, please see this fact sheet. MY NOTE: See below

Steven Chu is U.S. Secretary of Energy, Todd Park is U.S. Chief Technology Officer, and Nancy Sutley is Chair of the Council on Environmental Quality.

Energy Datapalooza Fact Sheet

Source: http://www.whitehouse.gov/sites/default/files/microsites/ostp/energy_datapalooza_fact_sheet.pdf (PDF)

MY NOTE: Where are the links to the data and APIs?

Unleashing The Power of Open Data To Advance Our Energy Future

Office of Science and Technology Policy | Council on Environmental Quality
Executive Office of the President
 
October 1, 2012
 
As part of the Energy Data Initiative, the Obama Administration hosted an Energy Datapalooza highlighting private-sector entrepreneurs and innovators that are using freely available data from the government and other sources to build products, services, and apps that advance a secure and clean energy future.

Administration Announcements

New Application Programming Interfaces (APIs)

Electricity API
The Energy Information Administration (EIA) announced the development of an API for its series on monthly, quarterly, and annual data for electric generation, consumption, and retail sales.
Fuel Economy API
The Department of Energy (DOE) and the Environmental Protection Agency (EPA) jointly announced the development of a new interface for data from the fueleconomy.gov website. The API will provide access to all of the data currently displayed in the “Find and Compare Cars” interactive tool, which includes model years 1984 through 2013.
Environmental APIs
EPA announced the development of its enhanced Envirofacts API, which will greatly improve the technical community’s degree of access to environmental datasets. EPA also announced it put 40 Energy Star product data sets on Energy.Data.Gov and that it intends to build an API for this important data. EPA is also releasing the beta version of Web services for its Energy Star’s Portfolio Manager tool, which will help building owners more easily benchmark their commercial buildings.
Biomass API
DOE announced the development of an API for biomass data. Specifically, the “U.S. Billion Ton Report” – a landmark study on biomass as a feedstock for bioenergy – will now be more readily available and useful to researchers and software developers.

New Data for Entrepreneurs and Innovators

Energy.Data.Gov
DOE announced that the number of datasets available in Energy.Data.Gov – a central discovery engine for federal government datasets, data visualization tools, mobile apps, and more – has doubled in less than three months. It now contains more than 900 federal datasets and technologies that support a growing open data ecosystem.
20 new Datasets from DOE
The Energy Department’s Office of Energy Efficiency and Renewable Energy (EERE) announced that it has released twenty new datasets, including two from each of the diverse portfolio of EERE Programs (i.e. Solar, Wind and Water, Vehicles, Advanced Manufacturing, Biofuels, Buildings, Fuel Cells, Weatherization, Geothermal, and Federal Energy Management).

New Events and Challenges

Vehicles Data Challenge: Improving Safety and Fuel Efficiency through Technology Innovation
DOE announced an innovation challenge to foster new technologies that can increase fuel efficiency while also addressing distracted driving concerns. The challenge will seek to recognize the best innovative technology solutions that vehicle owners can choose to use with their own private vehicle data. Incentive prizes, such as innovation challenges, are one tool the Federal government is using to tap the top talent and best ideas wherever they lie, sourcing breakthroughs from a broad range of citizen solvers.
SXSW ECO Code-a-thon
DOE announced it will support and participate in the SXSW Eco Code-a-thon, an event where teams of software developers will compete to create new and usable energy tools to help consumer make informed energy choices.

New Green Button Integration

Home Energy Yardstick
EPA announced it will make it easier for consumers to import their actual energy usage data into Home Energy Yardstick, a free tool for consumers that allows consumers to compare their home's energy use to others across the country and see how their home “measures up.” Consumers will be able to take their own household energy usage information, obtained from their local utility in the industry-developed Green Button data format, and upload it into the EPA tool to obtain a Yardstick score for their home and get energy efficiency recommendations.

Private Sector Committments

Green Button Commitments

New utility commitments expand Green Button Download My Data to include nearly 5 million new U.S. households and businesses
Twelve new utilities and energy providers join 23 others that have already agreed to adopt the consensus, industry-developed Green Button data standard. In total, these 35 companies will enable more than 36 million households and businesses to use web and smartphone apps to pick the best rate plan for them; take advantage of customized energy efficiency tips; utilize easy-to-use tools to size and finance rooftop solar panels; and download virtual energy audit software that can cut costs for building owners and help get retrofits started sooner.
 
The utilities and electricity suppliers making new or expanded commitments are:
  • Bangor Hydro Electric Company, serving 117,000 customers in Maine.
  • Central Maine Power, serving 620,000 customers in Maine.
  • Consolidated Edison, serving over 3.3 million electric customers in New York (Green Button will initially be available to approximately 2,500 large building owners).
  • Efficiency Vermont, serving 330,000 customers in Vermont.
  • JEA, serving 430,000 customers in Florida.
  • Northeast Utilities, serving over 3 million electric and natural gas customers throughout New England under the following regulated utilities: Connecticut Light and Power (CL&P), Yankee Gas, Western Massachusetts Electric Company (WMECo), NSTAR Electric, NSTAR Gas, and Public Service Company of New Hampshire (PSNH).
  • Sawnee Electric Membership Corporation (Georgia) and Kootenai Electric Cooperative, Inc. (Idaho), serving 3,000 residential customers.
  • The United Illuminating Company, serving 324,000 customers in Connecticut.
New commitments to Green Button Connect My Data capabilities
Responding to a call by President Obama to help consumers take better control of their energy bills, utilities in California and the Mid-Atlantic have taken a new step to make it easier for their customers to securely transfer their own energy usage data to authorized third parties, based on affirmative (opt-in) customer consent and control. In total, these commitments will provide more than 11 million customers with an easy and secure way to automatically and routinely participate in energy saving opportunities. Utility vendors Aclara, OPower, and Oracle also announced commitments to provide Green Button Connect My Data capabilities to utilities.
New companies commit to use the Green Button standard
Three new companies today announced that they are joining dozens of others that are developing applications or services that use the Green Button data standard. The companies making new commitments are:
  • BuildingIQ
  • Calico Energy Services
  • iControl Networks

New Consumer Data Protections

Privacy Seal Program
The Future of Privacy Forum (FPF), a Washington based think tank committed to advancing responsible data practices, today announced a first of its kind privacy seal program for companies that use consumer energy information. The seal will be powered by TRUSTe, a data privacy management company. The seal will be available to companies offering home energy management, remote home control or security, smart thermostats and other services that seek to access consumer energy data.

Data.gov/Energy Beta

Home

 
Energy

Welcome to

Energy.Data.gov

where data and insight are combined to facilitate public discussion and awareness of our Nation’s energy activities. Whether you are interested in alternative fuels, managing buildings to be more energy efficient, or trying to manage energy in your own home, we have something for you. Look at the data, use the apps, join the conversation.

Make a Suggestion MY NOTE: Goes to Forums

Special Features

Rooftop Solar Challenge: http://www.eere.energy.gov/solarchallenge/ MY NOTE: Do not see data

The Green Button Initiative: https://www.data.gov/communities/node/48/view/green_button MY NOTE: See below

The Energy Data Initiative: http://www.data.gov/communities/node/48/events/energydatainitiative MY NOTE: See below

Celebrating Our Apps for Energy Developers (Also Round Apps for Energy Winners Announced): http://energy.gov/articles/celebrating-our-apps-energy-developers MY NOTE: See below

Code for Livability: http://www.data.gov/communities/node/48/view/5696 MY NOTE: See below for data

 

America’s Home Energy Education Challenge: http://challenge.gov/DOE/178-america...tion-challenge MY NOTE: Do not see data

Apps for the Environment: http://www.epa.gov/appsfortheenvironment/ MY NOTE: I entered this and the data required considerable preparation to use

Welcome

an image of solar panels

Energy.data.gov is a new open government initiative to increase awareness of and deepen insights into our Nation’s energy performance. Energy.data.gov brings together high-value datasets, tools, and applications to shed new light on energy use. These free datasets and tools have been gathered from agencies across the Federal government with the goal of empowering all Americans to understand energy issues, including energy consumption within the Federal government.

Energy Data Initiative

an architect looking at windmill models

The Energy Data Initiative is an Administration-wide effort to liberate government data and voluntarily contributed non-government data as fuel to spur entrepreneurship, create value, and create jobs in the transition to a clean energy economy. Find out more about how you can benefit and participate!

Read More MY NOTE: See below

Challenges

a worker on roof installing a solar panel

To maximize opportunities for education and entrepreneurship across a diverse set of energy subjects, Energy.data.gov has challenges, prizes, and competitions that relate to energy data in meaningful and engaging ways. Compete in a challenge, get to know winners of previous challenges, ask questions, and share your great ideas!

Read More MY NOTE: See below

Sitemap