Table of contents
  1. U.S. Federal Government Handling of Data for Open Government Data in Japan
    1. Abstract
    2. Introduction
    3. Open Data in Japan
    4. My Stories
    5. Recent Research
    6. Results
      1. U.S. Federal Government Handling of Data for Open Government Data in Japan
        1. Outline
        2. Data Science Team
        3. Semantic Community: Mission Statement for 2013
        4. Why We Are Here
        5. Current US Government Semantic Web Strategy
        6. Comment From Owen Ambur
        7. International Linked Open Data Strategy: Linked Open Data Cloud Data
        8. International Linked Open Data: Comments to David Wood
        9. Our Semantic Web Strategy for Data: Simple Explanation
        10. Knowledge Base in Spreadsheet
        11. Knowledge Base in Wiki
        12. Alpha.Data.gov in Spreadsheet
        13. Alpha.Data.gov in Wiki
        14. Alpha.Data.gov
        15. Examples of Alpha.Data.gov
        16. Our Semantic Web Strategy for Data: Spotfire Network Analytics
        17. My 5-Step Method
        18. To Get to 5-Stars With Open Data
        19. System of Systems Architecture
        20. Data Federation in Spotfire: In-Memory and In-Database Data
        21. Data Federation in Spotfire: Database Connections, Information Links, & Analytics Library
        22. Spotfire for Big Data Analytics: Microscope
        23. Data Science Analytics Library: Telescope & Library
        24. A Japan METI Open Data Dashboard: Knowledge Base
        25. A Japan METI Open Data Dashboard: Spreadsheet
        26. A Japan METI Open Data Dashboard: Spotfire
        27. Summary
        28. Building a Digital Government by Example
        29. Q & A
    7. Conclusions and Recommendations
    8. Appendices
      1. Open Government Data In Japan January 2013
        1. TITLE SLIDE
        2. OPEN GOVERNMENT DATA STRATEGY
          1. Significance and Objectives
          2. Basic Direction
          3. Specific Measures 1
          4. Specific Measures 2
          5. Implementation Structures
        3. OPEN DATA HISTORY
          1. Time series
        4. DATA METI PLAN
          1. Creation of “Leading-Edge Integrated Industries” through the Integration of IT/Data and the Existing Industries 1
          2. Creation of “Leading-Edge Integrated Industries” through the Integration of IT/Data and the Existing Industries 2
          3. Open data and architecture
        5. BEST PRACTICES
          1. e-Stat (Ministry of Internal Affairs and Communications
          2. VICS Vehicle Information and communication system
          3. Traffic and Road Closure  Information after the earthquake
          4. Earthquake early-warning system
          5. Support civic participation in energy conservation after the earthquake
          6. Public appeal for greater public engagement in energy conservation
          7. Recovery and Reconstruction Support Program Database
          8. Recovery and Reconstruction Support Program Database To FSnavi
          9. Book search service “kahriru”: Service to search through the books across the libraries in Japan
          10. Tokyo Amesh, Protecting people from rain disasters
          11. Safety map
          12. Food access map
          13. Environmental Information “Kankyo Tenbodai”
          14. The nature of the soil and ground information database
          15. Garbage day Information “Kamakura Gomi Busters”
          16. Smart phone app “Fishing guide”
        6. CHALLENGES
          1. Cabinet secretariat
          2. NPO & Group
      2. My Stories
        1. The Data Transparency Coalition: Building the Federal Financial Information Network in the Cloud for the 113th Congress
        2. From the Year of Big Data to the Year of the Data Scientist Working With Big Data
        3. My EPA Green Apps Data App
        4. Canada's Shared Services Cloud Upstages Federal CIO Van Roekel at NIST Cloud AND Big Data Event
        5. Federal Government Going in Different Directions on Data and Information Sharing
        6. What's on My Dashboard Today?: The District of Columbia Data Catalog and 311 Message Service
        7. A Semantic Web Strategy for Big Data Discussion Meeting
        8. What's on My Dashboard Today? Great East Japan Earthquake Statistics
        9. The EuroStat Regional Yearbook for Semantic Interoperability
        10. Semantic Interoperability Conference 2012: Get Back to the Future!
        11. EnergyData.gov: Fact Checking Comes Up Short
        12. Open Data Exchange Will Help NIEM and the ISE-PM With Its Problems
        13. BIG DATA at the Hill: Demystified and Actionable
        14. SafetyData.gov Review: Long On Text, Short On Data Tables
        15. Open Government Data and Statistical Data: Haven't We Been Here Before?
        16. Presidential Innovation Fellows and Building Blocks Announced Three Years After the Suggestion Was Made
        17. ISE is in a State of Confusion
        18. Imagine if the ISE Did Not Even Know How to Use the Web Effectively
        19. FedStat.net: Commemorating over 135 years of making statistics available to citizens everywhere
        20. FedStat.gov: Celebrating over 15 years of making statistics from more than 100 agencies available to citizens everywhere
        21. Is There a Business Case for Open Government Data?
        22. Digital Agenda For Europe: Data as first-class citizen
        23. A Plan for Scaling NIEM to Big Data
        24. Data.gov Developers Community Space Launched- Is Dr. Merkin In the House?
        25. DoD Enterprise Information Web Market Research for Innovation
        26. Now Data.gov Wishes It Were CKAN (The Open Source Data Portal)
        27. METI Adopts Desktop-As-A-Service Cloud Computing
        28. Data.gov Goes To India - But It Still Needs More Work
        29. U.S.-India Joint Commission on Science and Technology Cooperation Announces Accomplishments
        30. Data.gov.uk - What's Not to Like
        31. DoD Seeks IT Interoperability With Enterprise Information Web
        32. Build The NIEM Information Exchange Clearinghouse In The Cloud
      3. Recent Research
        1. Introducing Alpha.Data.gov
        2. @todd_park
        3. Department of Commerce Open House RSVP
        4. President’s Council of Advisors on Science and Technology (PCAST) Subcommittees and Plenary Meeting Agenda
        5. What Do You Think About Open Government Video of Todd Park, U.S. Chief Technology Officer?
      4. February 12-14 2013 Meetings
        1. Tuesday, February 12, 2013
        2. Wednesday, February 13, 2013
        3. Thursday, February 14, 2013
        4. NIEM Town Hall February 14th!
          1. Community Gathers for a NIEM Town Hall
          2. NIEM 3.0 on schedule for fall release, say architecture committee members
      5. Upcoming Meeting Questions for NIEM and ODG Leaders
        1. Preface
        2. 1. Please clarify the current status and outlook for the convergence of DoD's UCore into NIEM.
        3. 2. Provide us a scheme of your collaboration of the Government of Canada (and Mexico), if possible with a MOU framework
        4. 3. How do you think of EU's ISA project, in terms of your collaboration, what is a major difference between NIEM and ISA, and their interoperability, etc.
        5. 4. The following question could be related the question No.3, but please specify if you have a different approach to the classified information/date that the Federal Agencies/the Public Administration hold, or to the open data to be disclosed to the public. As for the queries raised in October, what approach have you taken in the NIEM for the classified data and the open data?
        6. 5. Are there any functionality of dictionary not to repeat collecting the same information/data?
        7. 6. How do you prepare for the Global standardization of information sharing platform such as NIEM, ISA, etc. to assure their interoperability?
        8. 7. How do you talk with NIST for its standardization?
        9. 8. Please show us examples of domains such as disaster prevention, legal documents/juridical database including criminal data, social insurance/tax data, etc.
        10. 9. What is your relationship with private IT vendors such as IBM, Oracle, MS, etc. How are these private IT vendors planning to sell NIEM related products?
        11. 10. Other
      6. Summary of February 12 2013 Meetings
        1. U.S. Department of Health and Human Services
        2. Data.gov and NIEM
        3. METI Open Government Data
        4. NIEM OMG
        5. NIEM Oracle
          1. NY Report - Open Data needs to be useful for intended audience
        6. Semantic Community
      7. Slides
        1. e-Government and Open Government Data In Japan
        2. E-GOVERNMENT IN JAPAN
          1. Basic Act for IT
          2. Transition of Japanese IT Strategy
          3. Overview of Japanese Government Information Systems
          4. The Government Portal Site “e-Gov”
          5. Projects
          6. Local government
          7. Organization for Promoting e-Government
          8. Information Security Policy Council, National Information Security Center (NISC)
        3. OPEN GOVERNMENT IN JAPAN
          1. Open Government Lab
          2. Services in the lab
          3. Participation
          4. Information Analysis
        4. OPEN GOVERNMENT DATA STRATEGY
          1. Significance and Objectives
          2. Basic Direction
          3. Specific Measures 1
          4. Specific Measures 2
          5. Implementation Structures
        5. OPEN DATA HISTORY & DIRECTION
          1. Time series
          2. Creation of "Leading-Edge Integrated Industries"
          3. Open data and architecture
          4. Data catalogue in Japan
          5. Open Data Ideabox
        6. E-GOV BEST PRACTICES
          1. Making Spots Where Hard Braking Occurs Frequently Safer
          2. Pension-Net: Provision of pension data for each citizen
          3. Provision of medical payment data
          4. Bridge Monitoring System
          5. Information Analysis
          6. “Shorting items” daily ranking
        7. OPEN DATA BEST PRACTICES
          1. e-Stat (Ministry of Internal Affairs and Communications)
          2. VICS: Real time traffic information
          3. Traffic and Road Closure  Information after the earthquake
          4. Earthquake early-warning system
          5. Support civic participation in energy conservation after the earthquake
          6. Public appeal for greater public engagement in energy conservation
          7. Recovery and Reconstruction Support Program Database
          8. Recovery and Reconstruction Support Program Database To FSnavi
          9. Book search service “Calil”
          10. Tokyo Amesh, Protecting people from rain disasters
          11. Safety map
          12. Food access map
          13. Environmental Information “Kankyo Tenbodai”
          14. The nature of the soil and ground information database
          15. Garbage day Information “Kamakura Gomi Busters”
          16. Smart phone app “Fishing guide”
        8. Future e-Government model from best practices
        9. CHALLENGES
          1. Cabinet secretariat
          2. METI Ministry of Economy, Trade and Industry
          3. MIC Ministry of Internal Affairs and Communications
          4. NPO & Group
        10. LATEST PROJECT
          1. Open data analysis drill for disaster management
          2. Combine data on crowed area with local voices
          3. Image: how it works
          4. But!! The Drill postponed by heavy snow
        11. THANK YOU
        12. PIES Title Slide
          1. Background
          2. Basic concept of PIES
          3. Overview
          4. Image of PIES vocabulary
          5. Interoperability
          6. Problems and issues
          7. Similar project(Japanese Character set Project “IPAmj”
          8. Schedule

Final Report

Last modified
Table of contents
  1. U.S. Federal Government Handling of Data for Open Government Data in Japan
    1. Abstract
    2. Introduction
    3. Open Data in Japan
    4. My Stories
    5. Recent Research
    6. Results
      1. U.S. Federal Government Handling of Data for Open Government Data in Japan
        1. Outline
        2. Data Science Team
        3. Semantic Community: Mission Statement for 2013
        4. Why We Are Here
        5. Current US Government Semantic Web Strategy
        6. Comment From Owen Ambur
        7. International Linked Open Data Strategy: Linked Open Data Cloud Data
        8. International Linked Open Data: Comments to David Wood
        9. Our Semantic Web Strategy for Data: Simple Explanation
        10. Knowledge Base in Spreadsheet
        11. Knowledge Base in Wiki
        12. Alpha.Data.gov in Spreadsheet
        13. Alpha.Data.gov in Wiki
        14. Alpha.Data.gov
        15. Examples of Alpha.Data.gov
        16. Our Semantic Web Strategy for Data: Spotfire Network Analytics
        17. My 5-Step Method
        18. To Get to 5-Stars With Open Data
        19. System of Systems Architecture
        20. Data Federation in Spotfire: In-Memory and In-Database Data
        21. Data Federation in Spotfire: Database Connections, Information Links, & Analytics Library
        22. Spotfire for Big Data Analytics: Microscope
        23. Data Science Analytics Library: Telescope & Library
        24. A Japan METI Open Data Dashboard: Knowledge Base
        25. A Japan METI Open Data Dashboard: Spreadsheet
        26. A Japan METI Open Data Dashboard: Spotfire
        27. Summary
        28. Building a Digital Government by Example
        29. Q & A
    7. Conclusions and Recommendations
    8. Appendices
      1. Open Government Data In Japan January 2013
        1. TITLE SLIDE
        2. OPEN GOVERNMENT DATA STRATEGY
          1. Significance and Objectives
          2. Basic Direction
          3. Specific Measures 1
          4. Specific Measures 2
          5. Implementation Structures
        3. OPEN DATA HISTORY
          1. Time series
        4. DATA METI PLAN
          1. Creation of “Leading-Edge Integrated Industries” through the Integration of IT/Data and the Existing Industries 1
          2. Creation of “Leading-Edge Integrated Industries” through the Integration of IT/Data and the Existing Industries 2
          3. Open data and architecture
        5. BEST PRACTICES
          1. e-Stat (Ministry of Internal Affairs and Communications
          2. VICS Vehicle Information and communication system
          3. Traffic and Road Closure  Information after the earthquake
          4. Earthquake early-warning system
          5. Support civic participation in energy conservation after the earthquake
          6. Public appeal for greater public engagement in energy conservation
          7. Recovery and Reconstruction Support Program Database
          8. Recovery and Reconstruction Support Program Database To FSnavi
          9. Book search service “kahriru”: Service to search through the books across the libraries in Japan
          10. Tokyo Amesh, Protecting people from rain disasters
          11. Safety map
          12. Food access map
          13. Environmental Information “Kankyo Tenbodai”
          14. The nature of the soil and ground information database
          15. Garbage day Information “Kamakura Gomi Busters”
          16. Smart phone app “Fishing guide”
        6. CHALLENGES
          1. Cabinet secretariat
          2. NPO & Group
      2. My Stories
        1. The Data Transparency Coalition: Building the Federal Financial Information Network in the Cloud for the 113th Congress
        2. From the Year of Big Data to the Year of the Data Scientist Working With Big Data
        3. My EPA Green Apps Data App
        4. Canada's Shared Services Cloud Upstages Federal CIO Van Roekel at NIST Cloud AND Big Data Event
        5. Federal Government Going in Different Directions on Data and Information Sharing
        6. What's on My Dashboard Today?: The District of Columbia Data Catalog and 311 Message Service
        7. A Semantic Web Strategy for Big Data Discussion Meeting
        8. What's on My Dashboard Today? Great East Japan Earthquake Statistics
        9. The EuroStat Regional Yearbook for Semantic Interoperability
        10. Semantic Interoperability Conference 2012: Get Back to the Future!
        11. EnergyData.gov: Fact Checking Comes Up Short
        12. Open Data Exchange Will Help NIEM and the ISE-PM With Its Problems
        13. BIG DATA at the Hill: Demystified and Actionable
        14. SafetyData.gov Review: Long On Text, Short On Data Tables
        15. Open Government Data and Statistical Data: Haven't We Been Here Before?
        16. Presidential Innovation Fellows and Building Blocks Announced Three Years After the Suggestion Was Made
        17. ISE is in a State of Confusion
        18. Imagine if the ISE Did Not Even Know How to Use the Web Effectively
        19. FedStat.net: Commemorating over 135 years of making statistics available to citizens everywhere
        20. FedStat.gov: Celebrating over 15 years of making statistics from more than 100 agencies available to citizens everywhere
        21. Is There a Business Case for Open Government Data?
        22. Digital Agenda For Europe: Data as first-class citizen
        23. A Plan for Scaling NIEM to Big Data
        24. Data.gov Developers Community Space Launched- Is Dr. Merkin In the House?
        25. DoD Enterprise Information Web Market Research for Innovation
        26. Now Data.gov Wishes It Were CKAN (The Open Source Data Portal)
        27. METI Adopts Desktop-As-A-Service Cloud Computing
        28. Data.gov Goes To India - But It Still Needs More Work
        29. U.S.-India Joint Commission on Science and Technology Cooperation Announces Accomplishments
        30. Data.gov.uk - What's Not to Like
        31. DoD Seeks IT Interoperability With Enterprise Information Web
        32. Build The NIEM Information Exchange Clearinghouse In The Cloud
      3. Recent Research
        1. Introducing Alpha.Data.gov
        2. @todd_park
        3. Department of Commerce Open House RSVP
        4. President’s Council of Advisors on Science and Technology (PCAST) Subcommittees and Plenary Meeting Agenda
        5. What Do You Think About Open Government Video of Todd Park, U.S. Chief Technology Officer?
      4. February 12-14 2013 Meetings
        1. Tuesday, February 12, 2013
        2. Wednesday, February 13, 2013
        3. Thursday, February 14, 2013
        4. NIEM Town Hall February 14th!
          1. Community Gathers for a NIEM Town Hall
          2. NIEM 3.0 on schedule for fall release, say architecture committee members
      5. Upcoming Meeting Questions for NIEM and ODG Leaders
        1. Preface
        2. 1. Please clarify the current status and outlook for the convergence of DoD's UCore into NIEM.
        3. 2. Provide us a scheme of your collaboration of the Government of Canada (and Mexico), if possible with a MOU framework
        4. 3. How do you think of EU's ISA project, in terms of your collaboration, what is a major difference between NIEM and ISA, and their interoperability, etc.
        5. 4. The following question could be related the question No.3, but please specify if you have a different approach to the classified information/date that the Federal Agencies/the Public Administration hold, or to the open data to be disclosed to the public. As for the queries raised in October, what approach have you taken in the NIEM for the classified data and the open data?
        6. 5. Are there any functionality of dictionary not to repeat collecting the same information/data?
        7. 6. How do you prepare for the Global standardization of information sharing platform such as NIEM, ISA, etc. to assure their interoperability?
        8. 7. How do you talk with NIST for its standardization?
        9. 8. Please show us examples of domains such as disaster prevention, legal documents/juridical database including criminal data, social insurance/tax data, etc.
        10. 9. What is your relationship with private IT vendors such as IBM, Oracle, MS, etc. How are these private IT vendors planning to sell NIEM related products?
        11. 10. Other
      6. Summary of February 12 2013 Meetings
        1. U.S. Department of Health and Human Services
        2. Data.gov and NIEM
        3. METI Open Government Data
        4. NIEM OMG
        5. NIEM Oracle
          1. NY Report - Open Data needs to be useful for intended audience
        6. Semantic Community
      7. Slides
        1. e-Government and Open Government Data In Japan
        2. E-GOVERNMENT IN JAPAN
          1. Basic Act for IT
          2. Transition of Japanese IT Strategy
          3. Overview of Japanese Government Information Systems
          4. The Government Portal Site “e-Gov”
          5. Projects
          6. Local government
          7. Organization for Promoting e-Government
          8. Information Security Policy Council, National Information Security Center (NISC)
        3. OPEN GOVERNMENT IN JAPAN
          1. Open Government Lab
          2. Services in the lab
          3. Participation
          4. Information Analysis
        4. OPEN GOVERNMENT DATA STRATEGY
          1. Significance and Objectives
          2. Basic Direction
          3. Specific Measures 1
          4. Specific Measures 2
          5. Implementation Structures
        5. OPEN DATA HISTORY & DIRECTION
          1. Time series
          2. Creation of "Leading-Edge Integrated Industries"
          3. Open data and architecture
          4. Data catalogue in Japan
          5. Open Data Ideabox
        6. E-GOV BEST PRACTICES
          1. Making Spots Where Hard Braking Occurs Frequently Safer
          2. Pension-Net: Provision of pension data for each citizen
          3. Provision of medical payment data
          4. Bridge Monitoring System
          5. Information Analysis
          6. “Shorting items” daily ranking
        7. OPEN DATA BEST PRACTICES
          1. e-Stat (Ministry of Internal Affairs and Communications)
          2. VICS: Real time traffic information
          3. Traffic and Road Closure  Information after the earthquake
          4. Earthquake early-warning system
          5. Support civic participation in energy conservation after the earthquake
          6. Public appeal for greater public engagement in energy conservation
          7. Recovery and Reconstruction Support Program Database
          8. Recovery and Reconstruction Support Program Database To FSnavi
          9. Book search service “Calil”
          10. Tokyo Amesh, Protecting people from rain disasters
          11. Safety map
          12. Food access map
          13. Environmental Information “Kankyo Tenbodai”
          14. The nature of the soil and ground information database
          15. Garbage day Information “Kamakura Gomi Busters”
          16. Smart phone app “Fishing guide”
        8. Future e-Government model from best practices
        9. CHALLENGES
          1. Cabinet secretariat
          2. METI Ministry of Economy, Trade and Industry
          3. MIC Ministry of Internal Affairs and Communications
          4. NPO & Group
        10. LATEST PROJECT
          1. Open data analysis drill for disaster management
          2. Combine data on crowed area with local voices
          3. Image: how it works
          4. But!! The Drill postponed by heavy snow
        11. THANK YOU
        12. PIES Title Slide
          1. Background
          2. Basic concept of PIES
          3. Overview
          4. Image of PIES vocabulary
          5. Interoperability
          6. Problems and issues
          7. Similar project(Japanese Character set Project “IPAmj”
          8. Schedule

  1. U.S. Federal Government Handling of Data for Open Government Data in Japan
    1. Abstract
    2. Introduction
    3. Open Data in Japan
    4. My Stories
    5. Recent Research
    6. Results
      1. U.S. Federal Government Handling of Data for Open Government Data in Japan
        1. Outline
        2. Data Science Team
        3. Semantic Community: Mission Statement for 2013
        4. Why We Are Here
        5. Current US Government Semantic Web Strategy
        6. Comment From Owen Ambur
        7. International Linked Open Data Strategy: Linked Open Data Cloud Data
        8. International Linked Open Data: Comments to David Wood
        9. Our Semantic Web Strategy for Data: Simple Explanation
        10. Knowledge Base in Spreadsheet
        11. Knowledge Base in Wiki
        12. Alpha.Data.gov in Spreadsheet
        13. Alpha.Data.gov in Wiki
        14. Alpha.Data.gov
        15. Examples of Alpha.Data.gov
        16. Our Semantic Web Strategy for Data: Spotfire Network Analytics
        17. My 5-Step Method
        18. To Get to 5-Stars With Open Data
        19. System of Systems Architecture
        20. Data Federation in Spotfire: In-Memory and In-Database Data
        21. Data Federation in Spotfire: Database Connections, Information Links, & Analytics Library
        22. Spotfire for Big Data Analytics: Microscope
        23. Data Science Analytics Library: Telescope & Library
        24. A Japan METI Open Data Dashboard: Knowledge Base
        25. A Japan METI Open Data Dashboard: Spreadsheet
        26. A Japan METI Open Data Dashboard: Spotfire
        27. Summary
        28. Building a Digital Government by Example
        29. Q & A
    7. Conclusions and Recommendations
    8. Appendices
      1. Open Government Data In Japan January 2013
        1. TITLE SLIDE
        2. OPEN GOVERNMENT DATA STRATEGY
          1. Significance and Objectives
          2. Basic Direction
          3. Specific Measures 1
          4. Specific Measures 2
          5. Implementation Structures
        3. OPEN DATA HISTORY
          1. Time series
        4. DATA METI PLAN
          1. Creation of “Leading-Edge Integrated Industries” through the Integration of IT/Data and the Existing Industries 1
          2. Creation of “Leading-Edge Integrated Industries” through the Integration of IT/Data and the Existing Industries 2
          3. Open data and architecture
        5. BEST PRACTICES
          1. e-Stat (Ministry of Internal Affairs and Communications
          2. VICS Vehicle Information and communication system
          3. Traffic and Road Closure  Information after the earthquake
          4. Earthquake early-warning system
          5. Support civic participation in energy conservation after the earthquake
          6. Public appeal for greater public engagement in energy conservation
          7. Recovery and Reconstruction Support Program Database
          8. Recovery and Reconstruction Support Program Database To FSnavi
          9. Book search service “kahriru”: Service to search through the books across the libraries in Japan
          10. Tokyo Amesh, Protecting people from rain disasters
          11. Safety map
          12. Food access map
          13. Environmental Information “Kankyo Tenbodai”
          14. The nature of the soil and ground information database
          15. Garbage day Information “Kamakura Gomi Busters”
          16. Smart phone app “Fishing guide”
        6. CHALLENGES
          1. Cabinet secretariat
          2. NPO & Group
      2. My Stories
        1. The Data Transparency Coalition: Building the Federal Financial Information Network in the Cloud for the 113th Congress
        2. From the Year of Big Data to the Year of the Data Scientist Working With Big Data
        3. My EPA Green Apps Data App
        4. Canada's Shared Services Cloud Upstages Federal CIO Van Roekel at NIST Cloud AND Big Data Event
        5. Federal Government Going in Different Directions on Data and Information Sharing
        6. What's on My Dashboard Today?: The District of Columbia Data Catalog and 311 Message Service
        7. A Semantic Web Strategy for Big Data Discussion Meeting
        8. What's on My Dashboard Today? Great East Japan Earthquake Statistics
        9. The EuroStat Regional Yearbook for Semantic Interoperability
        10. Semantic Interoperability Conference 2012: Get Back to the Future!
        11. EnergyData.gov: Fact Checking Comes Up Short
        12. Open Data Exchange Will Help NIEM and the ISE-PM With Its Problems
        13. BIG DATA at the Hill: Demystified and Actionable
        14. SafetyData.gov Review: Long On Text, Short On Data Tables
        15. Open Government Data and Statistical Data: Haven't We Been Here Before?
        16. Presidential Innovation Fellows and Building Blocks Announced Three Years After the Suggestion Was Made
        17. ISE is in a State of Confusion
        18. Imagine if the ISE Did Not Even Know How to Use the Web Effectively
        19. FedStat.net: Commemorating over 135 years of making statistics available to citizens everywhere
        20. FedStat.gov: Celebrating over 15 years of making statistics from more than 100 agencies available to citizens everywhere
        21. Is There a Business Case for Open Government Data?
        22. Digital Agenda For Europe: Data as first-class citizen
        23. A Plan for Scaling NIEM to Big Data
        24. Data.gov Developers Community Space Launched- Is Dr. Merkin In the House?
        25. DoD Enterprise Information Web Market Research for Innovation
        26. Now Data.gov Wishes It Were CKAN (The Open Source Data Portal)
        27. METI Adopts Desktop-As-A-Service Cloud Computing
        28. Data.gov Goes To India - But It Still Needs More Work
        29. U.S.-India Joint Commission on Science and Technology Cooperation Announces Accomplishments
        30. Data.gov.uk - What's Not to Like
        31. DoD Seeks IT Interoperability With Enterprise Information Web
        32. Build The NIEM Information Exchange Clearinghouse In The Cloud
      3. Recent Research
        1. Introducing Alpha.Data.gov
        2. @todd_park
        3. Department of Commerce Open House RSVP
        4. President’s Council of Advisors on Science and Technology (PCAST) Subcommittees and Plenary Meeting Agenda
        5. What Do You Think About Open Government Video of Todd Park, U.S. Chief Technology Officer?
      4. February 12-14 2013 Meetings
        1. Tuesday, February 12, 2013
        2. Wednesday, February 13, 2013
        3. Thursday, February 14, 2013
        4. NIEM Town Hall February 14th!
          1. Community Gathers for a NIEM Town Hall
          2. NIEM 3.0 on schedule for fall release, say architecture committee members
      5. Upcoming Meeting Questions for NIEM and ODG Leaders
        1. Preface
        2. 1. Please clarify the current status and outlook for the convergence of DoD's UCore into NIEM.
        3. 2. Provide us a scheme of your collaboration of the Government of Canada (and Mexico), if possible with a MOU framework
        4. 3. How do you think of EU's ISA project, in terms of your collaboration, what is a major difference between NIEM and ISA, and their interoperability, etc.
        5. 4. The following question could be related the question No.3, but please specify if you have a different approach to the classified information/date that the Federal Agencies/the Public Administration hold, or to the open data to be disclosed to the public. As for the queries raised in October, what approach have you taken in the NIEM for the classified data and the open data?
        6. 5. Are there any functionality of dictionary not to repeat collecting the same information/data?
        7. 6. How do you prepare for the Global standardization of information sharing platform such as NIEM, ISA, etc. to assure their interoperability?
        8. 7. How do you talk with NIST for its standardization?
        9. 8. Please show us examples of domains such as disaster prevention, legal documents/juridical database including criminal data, social insurance/tax data, etc.
        10. 9. What is your relationship with private IT vendors such as IBM, Oracle, MS, etc. How are these private IT vendors planning to sell NIEM related products?
        11. 10. Other
      6. Summary of February 12 2013 Meetings
        1. U.S. Department of Health and Human Services
        2. Data.gov and NIEM
        3. METI Open Government Data
        4. NIEM OMG
        5. NIEM Oracle
          1. NY Report - Open Data needs to be useful for intended audience
        6. Semantic Community
      7. Slides
        1. e-Government and Open Government Data In Japan
        2. E-GOVERNMENT IN JAPAN
          1. Basic Act for IT
          2. Transition of Japanese IT Strategy
          3. Overview of Japanese Government Information Systems
          4. The Government Portal Site “e-Gov”
          5. Projects
          6. Local government
          7. Organization for Promoting e-Government
          8. Information Security Policy Council, National Information Security Center (NISC)
        3. OPEN GOVERNMENT IN JAPAN
          1. Open Government Lab
          2. Services in the lab
          3. Participation
          4. Information Analysis
        4. OPEN GOVERNMENT DATA STRATEGY
          1. Significance and Objectives
          2. Basic Direction
          3. Specific Measures 1
          4. Specific Measures 2
          5. Implementation Structures
        5. OPEN DATA HISTORY & DIRECTION
          1. Time series
          2. Creation of "Leading-Edge Integrated Industries"
          3. Open data and architecture
          4. Data catalogue in Japan
          5. Open Data Ideabox
        6. E-GOV BEST PRACTICES
          1. Making Spots Where Hard Braking Occurs Frequently Safer
          2. Pension-Net: Provision of pension data for each citizen
          3. Provision of medical payment data
          4. Bridge Monitoring System
          5. Information Analysis
          6. “Shorting items” daily ranking
        7. OPEN DATA BEST PRACTICES
          1. e-Stat (Ministry of Internal Affairs and Communications)
          2. VICS: Real time traffic information
          3. Traffic and Road Closure  Information after the earthquake
          4. Earthquake early-warning system
          5. Support civic participation in energy conservation after the earthquake
          6. Public appeal for greater public engagement in energy conservation
          7. Recovery and Reconstruction Support Program Database
          8. Recovery and Reconstruction Support Program Database To FSnavi
          9. Book search service “Calil”
          10. Tokyo Amesh, Protecting people from rain disasters
          11. Safety map
          12. Food access map
          13. Environmental Information “Kankyo Tenbodai”
          14. The nature of the soil and ground information database
          15. Garbage day Information “Kamakura Gomi Busters”
          16. Smart phone app “Fishing guide”
        8. Future e-Government model from best practices
        9. CHALLENGES
          1. Cabinet secretariat
          2. METI Ministry of Economy, Trade and Industry
          3. MIC Ministry of Internal Affairs and Communications
          4. NPO & Group
        10. LATEST PROJECT
          1. Open data analysis drill for disaster management
          2. Combine data on crowed area with local voices
          3. Image: how it works
          4. But!! The Drill postponed by heavy snow
        11. THANK YOU
        12. PIES Title Slide
          1. Background
          2. Basic concept of PIES
          3. Overview
          4. Image of PIES vocabulary
          5. Interoperability
          6. Problems and issues
          7. Similar project(Japanese Character set Project “IPAmj”
          8. Schedule

U.S. Federal Government Handling of Data for Open Government Data in Japan

Slides Final Report (PDF) Final Report (Word) Interim Report (Word) (Wiki)

Abstract

Semantic Community has a NIEM and Open Government Data Strategy that consists of the following:

  • Open Source Platform for Creating Knowledge Bases:
    • HTML 5
    • Well-defined URLs
    • APIs
  • Machine-readable Semantic Web – Linked Data Formats:
    • Subject
    • Object
    • Predicate
  • Data Science Analytics:
    • Federation
    • Visualizations and Statistics
    • Network Graphs

This Supports Building a Digital Government by Example like Federal CTO Todd Park suggested "by people with technical expertise, an accomplished history, and a passion for disruption."

The NIEM and Open Government Data Strategy has been applied to the Japanese Open Government Data and presented in  A Japan METI Open Data Dashboard.

Clearly, METI: Ministry of Economy, Trade and Industry and MIC: Ministry of Internal Affairs and Communications have an excellent Open Government Data Strategy and Implementation Plan starting at the top with the Prime Minister and striving to benefit from the experience in the US with Data.gov and NIEM.

The Data Science/Data Journalism stories I have written about the following topics: Data Act of 2013, Big Data, Data Apps, Shared Services, Information Sharing Environment (ISE), Dashboards, Semantic Web, Semantic Interoperability, National Information Exchange Model (NIEM), Data.gov and Alpha.Data.gov Audits, Presidential Innovation Fellows, Federal Statistics, Open Government Data, DoD Enterprise Information Web, Data.gov.uk, Digital Agenda for Europe, and Federal Digital Government Strategy, are helpful to distill the US Federal government experience and lessons learned that benefit other governments.

A recent story: What Has Todd Park Been Doing with Open Government Data and How Can He Help the Japanese Government? audits the new Alpha.Data.gov whose theme is: "A collection of open data from government, the private sector, and non-profits that are fueling a new economy", and found that most of the new collection were services and not data downloads, but uploads of your data!

Introduction

This final report is in response to the Request for Research on U.S. Federal Government Handling of Data and Messages (NIEM) by the Japanese Ministry of Economy, Trade, and Industry (METI).

This report shows how METI and MIC can benefit from the experience of the US Data.gov and other Open Government Data initiatives by starting with the right data first and using it to guide the categorization/classification and use of other data sources.

The interim report was organized as follows:

2. Open Data in Japan

3. Background Research

4. Results

5. Conclusions and Recommendations

Appendices

The final report is organized as follows:

Open Data in Japan

My Stories

Recent Research

Results

Conclusions and Recommendations

Appendices

Please note that this entire report can be searched using the Google Chrome Browser function "Find", and illustrates the use of advanced Web technologies for delivering content and data according to the recent US Digital Government Strategy on both standard desktop and mobile devices. Also please note that this page can be saved as a PDF and printed by using the "More" function in the menu above.

Open Data in Japan

Previously, Prime Minister Noda said about Open Data:

Edit section
“e-Gov Open Data Strategy is very important in terms of enhancing transparency and trust of government, and economic revitalization by creating new market. Based on the strategy, I hope agencies disclose public data proactively, and explore practical means to promote its reuse.” See complete slides and reference 2
 
Recently, the slides for Open Government Data In Japan January 2013 have been updated and shared for this final report and selected slides have been used here for highlights.
 

OPEN GOVERNMENT DATA STRATEGY

OGDJapan2013Slide6.GIF

OPEN DATA HISTORY

OGDJapan2013Slide8.GIF

DATA METI PLAN

OGDJapan2013Slide10.GIF

OGDJapan2013Slide11.GIF

OGDJapan2013Slide12.GIF

BEST PRACTICES

OGDJapan2013Slide14.GIF

CHALLENGES

OGDJapan2013Slide32.GIF

 

Clearly, METI: Ministry of Economy, Trade and Industry and MIC: Ministry of Internal Affairs and Communications have an excellent Open Government Data Strategy and Implementation Plan starting at the top with the Prime Minister and striving to benefit from the experience in the US with Data.gov and NIEM.

The Interim Report addressed the Research Needs (The scope and specifics of the data to be disclosed, History, Survey Questions, and Goals) and provided the Background Research Results below:

The relevant information about Data.gov was extracted in an Appendix

 
The complete US Open Government Directive is also in an Appendix
 
The complete EU’s PSI Directive on Re-use of Public Sector Information 2003 and UK Open Government License are also in an Appendix and Appendix, respectively.
 
The SEMIC.EU Framework developed by the author is shown in the table below. This includes the names of key people that I have interviewed for my data journalist stories and that we could interview again.

Table Framework for The Evolution of Working with Open Government Data (DRAFT)

 
Focus Examples Key Persons Reference Results
Messages Person Donna Roy and Anthony Hoang, U.S. Department. of Homeland Security (DHS), National Information Exchange Model (NIEM) NIEM NIEM 2011 National Training Event August 23–25 2011Build the NIEM IEPD Clearinghouse in the CloudA Plan for Scaling NIEM to Big DataAssessment Report
Semantic Assets Vocabularies Vassilios Peristeras, European Commission, Interoperability Solutions for Public Administrations (ISA) Unit, Semic.eu ADMS Studies 2011 Keynote and Data as a first Class Citizen
Data Catalogs Data.gov Jeanne Holm, Data.gov, U.S. General Services Administration, Evangelist for Data.Gov Data.gov 2012 International Open Government Data Conference
Semantic Enhancements SEMIC.EU Brand Niemann, Semantic Community Semantic Community Build SEMIC.EU in the Cloud
Data Tables US Annual Statistical Abstract and EU EuroStat Robert Groves, former director, US Census Bureau FedStats.net and EuroState Yearbook Using Data Science as Evidence in Public Policy With Big Data and Elections
Big Data Semantic Medline Tom Rindflesh, NLM Semantic Medline Federal SOA Big Data Pilots
Business Systems Government Frank Buytendijk
Chief Marketing Officer
Be Informed
Be Informed Newsletter

METI and MIC officials will be meeting with senior US government DHS NIEM and ISE, DoJ, HHS, and GSA OGD officals in upcoming meetings: February 12-14 2013 Meetings and have their key questions answered: Upcoming Meeting Questions for NIEM and ODG Leaders. They will also meet with representatives of OMG and Industry (Oracle, Model-Driven Solutions, and Semantic Community).

My Stories

I have written about the following topics: Data Act of 2013, Big Data, Data Apps, Shared Services, Information Sharing Environment (ISE), Dashboards, Semantic Web, Semantic Interoperability, National Information Exchange Model (NIEM), Data.gov and Alpha.Data.gov Audits, Presidential Innovation Fellows, Federal Statistics, Open Government Data, DoD Enterprise Information Web, Data.gov.uk, Digital Agenda for Europe, and Federal Digital Government Strategy.

My Stories I selected to summarize here that relate specifically to the ISE/NIEM and Open Government Data are:

  • The Data Transparency Coalition: Building the Federal Financial Information Network in the Cloud for the 113th Congress
  • From the Year of Big Data to the Year of the Data Scientist Working With Big Data
  • My EPA Green Apps Data App
  • Canada's Shared Services Cloud Upstages Federal CIO Van Roekel at NIST Cloud AND Big Data Event
  • Federal Government Going in Different Directions on Data and Information Sharing
  • What's on My Dashboard Today?: The District of Columbia Data Catalog and 311 Message Service
  • A Semantic Web Strategy for Big Data Discussion Meeting
  • What's on My Dashboard Today? Great East Japan Earthquake Statistics
  • The EuroStat Regional Yearbook for Semantic Interoperability
  • Semantic Interoperability Conference 2012: Get Back to the Future!
  • EnergyData.gov: Fact Checking Comes Up Short
  • Open Data Exchange Will Help NIEM and the ISE-PM With Its Problems
  • BIG DATA at the Hill: Demystified and Actionable
  • SafetyData.gov Review: Long On Text, Short On Data Tables
  • Open Government Data and Statistical Data: Haven't We Been Here Before?
  • Presidential Innovation Fellows and Building Blocks Announced Three Years After the Suggestion Was Made
  • ISE is in a State of Confusion
  • Imagine if the ISE Did Not Even Know How to Use the Web Effectively
  • FedStat.net: Commemorating over 135 years of making statistics available to citizens everywhere
  • FedStat.gov: Celebrating over 15 years of making statistics from more than 100 agencies available to citizens everywhere
  • Is There a Business Case for Open Government Data?
  • Digital Agenda For Europe: Data as first-class citizen
  • A Plan for Scaling NIEM to Big Data
  • Data.gov Developers Community Space Launched- Is Dr. Merkin In the House?
  • DoD Enterprise Information Web Market Research for Innovation
  • Now Data.gov Wishes It Were CKAN (The Open Source Data Portal)
  • METI Adopts Desktop-As-A-Service Cloud Computing
  • Data.gov Goes To India - But It Still Needs More Work
  • U.S.-India Joint Commission on Science and Technology Cooperation Announces Accomplishments
  • Data.gov.uk - What's Not to Like
  • DoD Seeks IT Interoperability With Enterprise Information Web
  • Build The NIEM Information Exchange Clearinghouse In The Cloud

The Data Science/Data Journalism stories I have written are helpful to distill the US Federal government experience and lessons learned that benefit other governments.

Recent Research

What Has Todd Park Been Doing with Open Government Data and How Can He Help the Japanese Government?

Federal CTO Todd Park had invited me to learn more about his work with Open Government Data (OGD) last fall:

Hi Brand, hope all is terrific with you! Was writing to see if you might be interested in coming to visit with us to have a wide-ranging, off-the-record, for-background discussion about Safety and Energy data.  We’ve read your audits with great interest -- we have additional information that you may find useful, and are also working on a broad array of items in the spirit of constant improvement of everything we’re doing; would love your input and thoughts to help inform these efforts! All the best, Todd

As a data journalist, I kindly deferred Todd's invitation because my work for AOL government is on the record. But I have been following Todd Park's Tweets and activities with interest, especially since the Japanese Government has asked me to help them start their OGD Program.

Interestingly Todd's Tweets this month mentioned the Presidential Inauguration Event on “Technological Innovation and Job Creation", but not his report to the President’s Council of Advisors on Science and Technology (PCAST) which is available in video and has received at least one comment that says:

"It is good to hear OMB will be issuing a policy to make open, machine-readable data the default for U.S. federal agencies. The requirement to provide data in machine-readable format is already referenced in the U.S. Code in about 40 places."

So I auditied the new alpha.data.gov site and found that I had previously worked with the data at EnergyHealthEducation, and Finance links given, but links to the 37 examples of data sets in action were not given so I researched them using Google Search and found that most were services and not data downloads, but uploads of your data!

The new theme of Alpha.Data.gov is: A collection of open data from government, the private sector, and non-profits that are fueling a new economy.

My audit of  alpha.data.gov for Todd Park and others is contained in a machine-readable Semantic Web – Linked Data format spreadsheet.

Results

The author was asked to help arrange a series of meetings and presentations for February 12-14 2013 for the following:

Mr. Kenji Hiramoto, Executive Advisor for CIO at METI

Mr. Shuichi Tashiro, Head of International Standardization Promotion Center at IPA (IT Promotion Agency),  METI's IT agency
Mr. Hajime Horiuchi, Former Professor at TIU, and
Mr. Seiichi Nobuhara, CEO & President at IBT

METI: Ministry of Economy, Trade and Industry and MIC: Ministry of Internal Affairs and Communications

The author hopes to add the Highlights of these meetings to the report afterwards:

and complete the Upcoming Meeting Questions for NIEM and ODG Leaders.

The authors results are summarized in the slide presentation below.

U.S. Federal Government Handling of Data for Open Government Data in Japan

Slides

BrandNiemann02122013Slide1.PNG

Outline

BrandNiemann02122013Slide2.PNG

Current US Government Semantic Web Strategy

BrandNiemann02122013Slide6.PNG

Comment From Owen Ambur

http://www.w3.org/TR/rdfa-lite/

BrandNiemann02122013Slide7.PNG

International Linked Open Data Strategy: Linked Open Data Cloud Data

http://semanticommunity.info/@api/deki/files/8824/=VIVO.xlsx

BrandNiemann02122013Slide8.PNG

Our Semantic Web Strategy for Data: Simple Explanation

http://semanticommunity.info/A_NITRD_Dashboard/Semantic_Medline

BrandNiemann02122013Slide10.PNG

Alpha.Data.gov

http://alpha.data.gov/

BrandNiemann02122013Slide15.PNG

My 5-Step Method

BrandNiemann02122013Slide18.PNG

To Get to 5-Stars With Open Data

http://www.w3.org/DesignIssues/LinkedData.html

BrandNiemann02122013Slide19.PNG

System of Systems Architecture

BrandNiemann02122013Slide20.PNG

Data Federation in Spotfire: In-Memory and In-Database Data

http://semanticommunity.info/A_Spotfire_Gallery/Users_Guide#Working_With_Large_Data_Volumes

BrandNiemann02122013Slide21.PNG

Data Federation in Spotfire: Database Connections, Information Links, & Analytics Library

BrandNiemann02122013Slide22.PNG

Data Science Analytics Library: Telescope & Library

https://silverspotfire.tibco.com/us/library#/users/bniemann/Public

BrandNiemann02122013Slide24.PNG

A Japan METI Open Data Dashboard: Knowledge Base

http://semanticommunity.info/A_Japan_METI_Open_Data_Dashboard

BrandNiemann02122013Slide25.PNG

A Japan METI Open Data Dashboard: Spreadsheet

http://semanticommunity.info/@api/deki/files/19936/METI2012.xlsx

BrandNiemann02122013Slide26.PNG

Summary

BrandNiemann02122013Slide28.PNG

Q & A

Brand Niemann
bniemann@cox.net

Tom Rindflesch
trindflesch@mail.nih.gov

Victor Pollara
victor.pollara@noblis.org

Mark Guiton
mguiton@cray.com

Eric Little
elittle@orbistechnologies.com

Conclusions and Recommendations

This report shows how METI and MIC can benefit from the experience of the US Data.gov and other Open Government Data initiatives by starting with the right data first and using it to guide the categorization/classification and use of other data sources.

Clearly, METI: Ministry of Economy, Trade and Industry and MIC: Ministry of Internal Affairs and Communications have an excellent Open Government Data Strategy and Implementation Plan starting at the top with the Prime Minister and striving to benefit from the experience in the US with Data.gov and NIEM.

The Data Science/Data Journalism stories I have written about the following topics: Data Act of 2013, Big Data, Data Apps, Shared Services, Information Sharing Environment (ISE), Dashboards, Semantic Web, Semantic Interoperability, National Information Exchange Model (NIEM), Data.gov and Alpha.Data.gov Audits, Presidential Innovation Fellows, Federal Statistics, Open Government Data, DoD Enterprise Information Web, Data.gov.uk, Digital Agenda for Europe, and Federal Digital Government Strategy, are helpful to distill the US Federal government experience and lessons learned that benefit other governments.

A recent story: What Has Todd Park Been Doing with Open Government Data and How Can He Help the Japanese Government? audits the new Alpha.Data.gov whose theme is: "A collection of open data from government, the private sector, and non-profits that are fueling a new economy", and found that most of the new collection were services and not data downloads, but uploads of your data!

The authors results are summarized in the slide presentation to be given on February 12, 2013.

Appendices

Open Government Data In Japan January 2013

Source: Email January 18, 2013 (Slides)

TITLE SLIDE

OGDJapan2013Slide0.GIF

OPEN GOVERNMENT DATA STRATEGY

OGDJapan2013Slide1.GIF

Significance and Objectives

OGDJapan2013Slide2.GIF

Basic Direction

OGDJapan2013Slide3.GIF

Specific Measures 1

OGDJapan2013Slide4.GIF

Specific Measures 2

OGDJapan2013Slide5.GIF

Implementation Structures

OGDJapan2013Slide6.GIF

OPEN DATA HISTORY

OGDJapan2013Slide7.GIF

Time series

OGDJapan2013Slide8.GIF

DATA METI PLAN

OGDJapan2013Slide9.GIF

Creation of “Leading-Edge Integrated Industries” through the Integration of IT/Data and the Existing Industries 1

OGDJapan2013Slide10.GIF

Creation of “Leading-Edge Integrated Industries” through the Integration of IT/Data and the Existing Industries 2

OGDJapan2013Slide11.GIF

Open data and architecture

OGDJapan2013Slide12.GIF

BEST PRACTICES

OGDJapan2013Slide13.GIF

e-Stat (Ministry of Internal Affairs and Communications

http://www.stat.go.jp/english/
http://www.nstac.go.jp/en/OGDJapan2013Slide14.GIF

VICS Vehicle Information and communication system

OGDJapan2013Slide15.GIF

Traffic and Road Closure  Information after the earthquake

http://www.its-jp.org/saigai/
http://www.mapion.co.jp/feature/eq2011/traffic.html

OGDJapan2013Slide16.GIF

Support civic participation in energy conservation after the earthquake

http://setsuden.go.jp/

OGDJapan2013Slide18.GIF

Public appeal for greater public engagement in energy conservation

OGDJapan2013Slide19.GIF

Recovery and Reconstruction Support Program Database

OGDJapan2013Slide20.GIF

Recovery and Reconstruction Support Program Database To FSnavi

http://www.fsnavi.jp/

OGDJapan2013Slide21.GIF

Book search service “kahriru”: Service to search through the books across the libraries in Japan

http://calil.jp/

OGDJapan2013Slide22.GIF

Tokyo Amesh, Protecting people from rain disasters

http://tokyo-ame.jwa.or.jp/en/index.html

OGDJapan2013Slide23.GIF

Environmental Information “Kankyo Tenbodai”

OGDJapan2013Slide26.GIF

The nature of the soil and ground information database

http://www.asahigs.co.jp/gspace/dataservice.html

OGDJapan2013Slide27.GIF

Garbage day Information “Kamakura Gomi Busters”

https://itunes.apple.com/jp/app/id49...ign-mpt=uo%3D4

OGDJapan2013Slide28.GIF

Smart phone app “Fishing guide”

OGDJapan2013Slide29.GIF

CHALLENGES

OGDJapan2013Slide30.GIF

Cabinet secretariat

OGDJapan2013Slide31.GIF

NPO & Group

OGDJapan2013Slide32.GIF

My Stories

The Data Transparency Coalition: Building the Federal Financial Information Network in the Cloud for the 113th Congress

http://semanticommunity.info/DataTransparencyCoalition.org

So the Data Transparency Coalition needs to show the 113th Congress this kind of pilot and propose how this kind of work could be made sustainable by a new organization structure like a Federal Chief Data Officer with a staff of data scientists, statisticans, and data handling specialists working as a team that is tasked to deliver value for informing the public and decision makers, supported by public-private partnerships like the Data Transparency Coalition, and others like the Sunlight Foundation.

From the Year of Big Data to the Year of the Data Scientist Working With Big Data

http://semanticommunity.info/Emerging_Technology_SIG_Big_Data_Committee/Government_Challenges_With_Big_Data

So NASA's work with big data seems to be more about tools (software coding) than actual data science about data sets and reinforces Dr. George Strawn's observation that if we do not get some real results with big data of value to the business and science of government, we will be on to something else that will.

My EPA Green Apps Data App

http://semanticommunity.info/AOL_Government/My_EPA_Green_Apps_Data_App

Thomas R. Temin - Editor in chief of FedInsider said: "Federal agencies themselves have built a few apps, maybe 100 or so. But it’s more important that the government market its data to app developers in such a way that they, the developers, see ideas that might be popular."

So Tom Temin is right and it can be done, but in the case of the My EPA Green Apps, they demonstrate a noticeable lack of EPA data, and largest geospatial data sets are in a difficult format to use.

Canada's Shared Services Cloud Upstages Federal CIO Van Roekel at NIST Cloud AND Big Data Event

http://semanticommunity.info/Emerging_Technology_SIG_Big_Data_Committee/Cloud_Computing_AND_Big_Data_Forum_and_Workshop_January_15-17_2013

Steven Woodward, CEO and founder of Cloud Perspectives, a member of the Shared Services Canada Advisory Committee, leading contributor to the NIST FedRamp, and Canadian Cloud Council Government CTO, delivered the real meat when he announced that the Canadian government had created a new centralized shared services in the cloud agency by moving 7500 employee eventually allocated from 43 departments and agencies.

Now we just need a Chief Data Officer for the entire US Government to work on data as data projects and not IT projects like I recommended to Congressional staff last fall and to the Data Transparency Coalition advising the 113 Congress on the reintroduction of the Data Act.

Federal Government Going in Different Directions on Data and Information Sharing

http://semanticommunity.info/AOL_Government/Big_Data_Reveals_Gaps_in_Standards_and_Federal_Human_Capital

DHS wanted a data sharing network, but got NIEM (National Information Exchange Model-an XML-based format for Information Exchange Packages-IEP) instead. Now they realize they really need a network with database technology with cell-level security (Accumulo) and row-level metadata.

What's on My Dashboard Today?: The District of Columbia Data Catalog and 311 Message Service

http://semanticommunity.info/A_Japan_METI_Open_Data_Dashboard/The_Open_Data_Handbook

So the Gray Administration is providing an excellent online 311 service to its citizens based on historical data analysis and its DC Data Catalog is a best practice of crowd-sourcing because I was able to work with it to produce my own dashboard of services.

A Semantic Web Strategy for Big Data Discussion Meeting

http://semanticommunity.info/Emerging_Technology_SIG_Big_Data_Committee

Current projects that are implementing Semantic Web Standards and Technologies. 
Reusable solutions for datasets communicated between machines (Big Data).
Coordination with the Big Data Committee, Collaboration & Transformation SIG and the Advanced Mobility Working Group.
Thoughts on next steps and resources for interested organizations.

A Semantic Web Strategy for Big Data: ET SIG Presentations/Discussion
http://semanticommunity.info/Emerging_Technology_SIG_Big_Data_Committee

Welcome and Agenda
http://semanticommunity.info/Federal_SOA/14th_SOA_for_E-Government_Conference_October_2_2012#SOA_Pilots

Aligning Outcomes, Accelerating Change and Creating Agility in Tough Financial Times
http://semanticommunity.info/AOL_Government/Government_Information_and_Analytics_Summit#KN-1_Aligning_Outcomes.2C_Accelerating_Change_and_Creating_Agility_in_Tough_Financial_Times

CTO Views on Government Big Data and the Top Five Big Data Solutions of 2012
http://semanticommunity.info/@api/deki/files/13765/CIA_Gus_Hunt_Gov_Summit.pdf
http://semanticommunity.info/AOL_Government/Government_Information_and_Analytics_Summit#BD_2_CTO_Views_on_Government_Big_Data_and_the_Top_Five_Big_Data_Solutions_of_2012

Purpose

The Semantic Web

Big Data 1
http://www.emc.com/microsites/cio/ar...ties-Value.pdf

Big Data 2

Big Data 3
http://semanticommunity.info/AOL_Government/Big_Data_Innovation

Searching For Meaning: The Semantic Web

RDF Triples Give Rise to a Web of Connections

SPARQL: The Semantic Query Language

The Challenge of Big Data

Opening Statement by Ralph Hughes
http://semanticommunity.info/AOL_Government/Big_Data_Innovation

Big Data Breakdown

Data Falls Into Three Categories: Structured, Semi-structured, and Unstructured

From Data To Actionable Knowledge

Converting Data to Triples Opens Door to Integration with Other Linked Data

Semantic Data For Free

Data Models Come Full Circle 1

Data Models Come Full Circle 2

My 5-Step Method

Real-time Analytics for Small Data, Big Data, and Huge Data!
http://semanticommunity.info/AOL_Government/AWS_Public_Sector_Summit_2012

A Japan METI Open Data Dashboard
http://semanticommunity.info/A_Japan_METI_Open_Data_Dashboard

Framework for the Evolution of Working with Open Government Data
http://semanticommunity.info/Build_SEMIC.EU_in_the_Cloud/SEMIC_2012_Conference

Big Data Committee Knowledge Capture and Work Force Training (GMU)
http://semanticommunity.info/Emerging_Technology_SIG_Big_Data_Committee
http://semanticommunity.info/A_Spotfire_Gallery/Spotfire_Learning_Network

Basic Concerns

Dutch frontrunners in global E-government
http://www.beinformed.com/BeInformed...ews%20EN.bixml

Eric Little

Victor Pollara

Tom Rindflesch

George Strawn

What's on My Dashboard Today? Great East Japan Earthquake Statistics

http://semanticommunity.info/A_Japan_METI_Open_Data_Dashboard

The Open Government Data/Linked Data Initiatives in the US (Data.gov) and elsewhere started with the wrong data. The author recommended that Data.gov start with the best US government data from the Federal Statistical Agencies (e.g. US Census Bureau) and make it the standard practice of high quality data and metadata rendered in the new linked open data way. Experience has shown that to be the case with the statistical community calling Data.gov and similar efforts essentially ‘IT projects.’ The solution is to first render a countries high quality statistical data in the new way and then try to render the open data the same way as much as possible.  The author has done this for the US and Europe, and now for Japan. This opens the exciting path to work with both sources of data (statistical and open) and "big data".

The EuroStat Regional Yearbook for Semantic Interoperability

http://semanticommunity.info/Build_SEMIC.EU_in_the_Cloud/2012_Eurostat_Regional_Yearbook

The 2012 EuroStat Regional Yearbook provides the highest quality government data by region the European Union has and its organization in an interoperable database and presentation in an interoperable interface demonstrates the semantic interoperability that the Semantic Interoperability Centre for Europe (SEMIC.EU) was created to achieve.

Semantic Interoperability Conference 2012: Get Back to the Future!

http://semanticommunity.info/Build_SEMIC.EU_in_the_Cloud/SEMIC_2012_Conference

So I offered to help SEMIC.EU and here is my suggestion: I am working for a county to start their open data work and am using the SEMIC.EU as an example since I provided suggestions at their beginning (based on my US Federal CIO CouncilSICoP experience) and my SEMIC.EU keynote last year. This story and pilot with a framework tries to capture the evolution of working with open government data from messages (e.g. NIEM) to the current considerable interest in big data and business systems. I am suggesting that countries that are just getting started might jump to the more advanced stages for more immediate results and/or focus on more than one at a time.

EnergyData.gov: Fact Checking Comes Up Short

http://semanticommunity.info/EnergyData.gov

 
At the Health Datapalooza, Todd Park agreed with my comments on the need to audit new Data.gov community web sites to see if they delivered on their claims and could produce innovation.
 
So my fact checking of the new Energy Data.gov and Data Palooza found that they come up short on their claims and more work needs to be done to deliver on the facts and demonstrate the value of this activity to decision makers and citizens who are paying for this.
Open Data Exchange Will Help NIEM and the ISE-PM With Its Problems

http://semanticommunity.info/Information_Sharing_Environment#Story

I have been openly critical of NIEM (National Information Exchange Model) and the ISE-PM (Information Sharing Environment - Program Manager) for limitiations (see Has NIEM Reached A Choke Point With Big Data) and deficiencies (see ISE is in a State of Confusion) because our national security is at stake.

So imagine my pleasure at being vindicated by the work of David Webber, Information Architect, Oracle Public Sector, presented at the 14th SOA for eGovernment Conference at MITRE in McLean, Virginia. David has developed tooling that works with data as well as messages and provides APIs for data that Federal CIO Steven VanRoekel and Federal CTO Todd Park have been calling for in the Digital Government Strategy and Innovation with Government Data Initiative

So I see Open Data Exchange helping NIEM and the ISE-PM with its technical, collaboration with industry, and funding problems and look forward to more results at our 15th SOA for eGovernment Conference and elsewhere.

BIG DATA at the Hill: Demystified and Actionable

http://semanticommunity.info/AOL_Government/BIG_DATA_at_the_Hill

Big Data, which has been the hot topic for conferences this year, has now reached the Hill, as in Capitol Hill, with two recent events:

I provided more detail to Congressional staff members on the nine topics of special interest to them in the table below where I added my ideas on Trends, Issues, and Comments.

 

Topics Trends Issues Comments
Myth vs. Realities Big Data Solves Everything Hype Without Demonstrated Business and Scientific Value See Data Evolution in the Government Enterprise: Will It Still Be Big Data Next Year?
Privacy: Who knows what? The Intelligence Community Knows Everything Who Knows Everything the Intelligence Communty Is Doing? See Intelligence Community Loves Big Data
Cloud: Where Big Data belongs? Terabytes to Zettabytes Bandwidth Limitations Amazon: Fedex Your Storage Devices To Us to Upload Your Big Data
Mobility – of you and your data Bring Your Own Device (BYOD) Conventional Web Sites and Databases Are Not Mobile-Enabled Your Mobile Device Has Access To a Supercomputer
Storage and technology Scalable single level storage Collapses the Server, Network, and storage by removing software and replacing them with memory system primitives Panève’s ZettaLeaf & ZettaTree Products
Data Analytics – hidden gems and spurious conclusions Data Science Too Few Data Scientists - Need a Government Data Science Community See My Data Journalism Articles
Opportunities and risks in data aggregation Aggregate Before Analysis To Reduce Size Needels Could Be Lost See Data Evolution in the Government Enterprise: Will It Still Be Big Data Next Year?
Security concerns for large data sets Integrate Classified and Unclassified Data Sources Different Security Levels Need To Specify/Protect Security at the Row and Element Level
Financial Implications Hadoop for Everything with Big Data Costs 50 Times Higher Than Expected Big Data In Memory Could Be More Costs Effective

The Key People I mentioned above are essentially functioning in multiple roles that include Data Science, Computer Science, and Big Data Entrepreneurship and we need more of them not just speaking at conferences, writing reports, and evangelizing Big Data, but leading teams that do best practice examples of Big Data for the business and science of government in cooperation with industry and academia. We need concrete examples that deliver return on investment soon and often for Big Data to gain and retain taxpayer support in these tight budget times.

SafetyData.gov Review: Long On Text, Short On Data Tables

http://semanticommunity.info/SafetyData.gov

My AOL Gov's Editorial Director Wyatt Kash recently Tweeted: Good view of early work. Much to be done though to turn gov data into more, useful tools.

His AOL Gov article said: "Park, speaking with AOL Government after the event, acknowledged that the datapalozza events take a while to catch the public's attention and that more must be done to make government data easier for the public to access and for machines to ingest.

So the SafetyData.gov audit results are in: one has to wade through lots of text to find them and then there are not many data tables for building apps. The gvernment will need to collect new data and mine other data sources to help the community of developers reach their full potential with government safety data.

Open Government Data and Statistical Data: Haven't We Been Here Before?

http://semanticommunity.info/AOL_Government/APDU

Open Data includes operational and administrative data used now by public agencies for statistical purposes. It’s changing the world of data users and producers alike. Statisticians refer to their data as design data (data from survey's designed to capture data that can answer  questions with statistics with confidence levels) and open data as that just turns up and becomes "big data" because it has no end, which a survey does, like the every 10 year census that lasts several months and then is done until ten years latter.

So in answer to the question about bringing these different worlds of data together, yes we have been there before, but it is definitely different from the past and in the words of Margo Anderson: "it is both brash and exciting".

Presidential Innovation Fellows and Building Blocks Announced Three Years After the Suggestion Was Made

http://semanticommunity.info/AOL_Government/Presidential_Innovation_Fellows_Announced

This week there was a double-post on the White House Blog by Federal CTO Todd Park and the Federal CIO Steve Van Roekel about two new initiatives that would seem to be related, but it is not clear how. AOL government covered both of them: White House To Announce Presidential Innovation Fellows and VanRoekel Touts Digital Strategy Progress. The latter featured the use of the term "building blocks" by Federal CIO Steve VanRoekel:

"It's been a busy three months, and I look forward to adding more building-blocks in the months ahead as we continue to deliver on the President's vision of a more modern, efficient, and accessible government for the 21st Century."

 
To add to the mix, Kshemendra Paul, Program Manager of the Information Sharing Environment, announced the launch of their Building Blocks tool last week in his blog post, Building Blocks: An Exciting New Resource for Info Sharing Guidance and Best Practices
 
"Building Blocks is a knowledge resource tool for sharing insight and best practices in building responsible information sharing. It also showcases stories from our mission partners for real-world examples of success in info sharing."
 
When this happens, I always ask: has this been suggested before and how come they are not coordinated. The anwers were yes this has been suggested before and they are not coordinated for the same reason I wrote An Open Letter To My Former CIO At EPA, Malcolm Jackson, recently, senior leaders in government do not know or ask what has been done before and by whom.

The Tweet about all of this that caught my attention and I resonated with the most was: "This seems like it could be really interesting, what can you actually do if your not a fellow?" So I say to Federal CTO Todd Park, Federal CIO Steve Van Roekel, and Program Manager of the Information Sharing Environment, Kshemendra Paul, lets get coordinated and involve a lot more government employees and citizens in this  because it is a much bigger job than five Presidential Innovation Fellows can do in the next six months!

ISE is in a State of Confusion

http://semanticommunity.info/Information_Sharing_Environment#Story_2

 
Stan Gaver has written eloquently about Why Doesn't the Federal Enterprise Architecture Work? He also says that the problem propagates beyond the Federal EA Program because other federal programs that adopted concepts and definitions from the federal enterprise architecture are at risk because these concepts and definitions are probably flawed and ineffective.
 
One noteworthy example he cites is the ISE: "It is likely that the nation’s anti-terrorism planning has been negatively affected, if not significantly weakened, because a key part of the anti-terrorism plan, the Information Sharing Environment Profile and Architecture Implementation Strategy, has adopted many of its base concepts from the FEA.
 
So I decided to investigate that because I have written a recent article titled: Imagine if the PM-ISE Did Not Even Know How to Use the Web Effectively, and then I had an exchange of Tweets and other experiences that leads me to wonder if they really know what they are doing.
 
My research found that Greg Gardner, Deputy Intelligence Community Chief Information Officer, said recently:  The Direction of the IC Enterprise Architecture is Founded on 7 Key Principles for the Federated Environment:
 
• Principle 1: Community Federation
• Principle 2: Enterprise Information Integration & Sharing
• Principle 3: Think Big, Start Small, And Scale Fast
• Principle 4: Smart Information Assurance
• Principle 5: Design for the Mission; Develop for the Enterprise
• Principle 6: Green IT
• Principle 7: Good Enough is Good Enough

Now Kshmendra Paul, PM-ISE Director says: "The ISE cannot be built nor will it deliver required capabilities without standards-based innovation." So who is directing the IC Information Sharing, Greg Gardner, Deputy Intelligence Community Chief Information Officer, or Kshmendra Paul, PM-ISE, and why this apparent confusion between the IC and with their major industry partner the OMG?

Imagine if the ISE Did Not Even Know How to Use the Web Effectively

http://semanticommunity.info/Information_Sharing_Environment

Now Kshmendra Paul, PM-ISE Director says: "The ISE cannot be built nor will it deliver required capabilities without standards-based innovation." So who is directing the IC Information Sharing, Greg Gardner, Deputy Intelligence Community Chief Information Officer, or Kshmendra Paul, PM-ISE, and why this apparent confusion between the IC and with their major industry partner the OMG?

So I say to the PM-ISE: show us you can use the web by innovating with your recent public content to lead out in Building a Digital Government. This could transform the IC culture one more step from the current "Need to Know", “Need to Share”, “Need to Responsibly Share”, to "Need to Effectively Share".

FedStat.net: Commemorating over 135 years of making statistics available to citizens everywhere

http://semanticommunity.info/FedStats.net

In a related story about FedStats.gov, I mentioned that Data.gov has been around for about three years now and is touted as the prime example of the Open Government Data Initiative based on its growth in number of data sets and communities using them. However, there have been two activities that have been around much longer, with more high-quality data sets, and a larger community, namely FedStats.gov and FedStats.net.

In this story I write about FedStats.net based on the 2012 Annual Statistical Abstract as a Data-Driven Document Dashboard. The Annual Statistical Abstract has been the first source of data for citizens for over 136 years and I rebuilt it to commemorate that great accomplishement.

The first thing I wanted to do was to have metadata and data be together in the spreadsheet, not separately, like Data.gov and most other Open Government Data Initiatives sites, so the user gets both in the same click download. Even better, the Web site, catalog, data (and metadata), and application are all integrated together into a Knowledge Base and a Spreadsheet.

FedStat.gov: Celebrating over 15 years of making statistics from more than 100 agencies available to citizens everywhere

http://semanticommunity.info/FedStats.gov

Data.gov has been around for about three years now and is touted as the prime example of the Open Government Data Initiative based on its growth in number of data sets and communities using them. However, there have been two activities that have been around much longer, with more high-quality data sets, and a larger community, namely FedStats.gov and FedStats.net. I write about the later in a related story.

I was part of the FedStats Team that build FedStats.gov and lead the FedStats.net Team. We received the Gore Hammer Award for that work to Reinvent Government. I see Data.gov as trying to reinvent that reinvention without the expertise that we had across the government at that time. The Data.gov Agency Points of Contact are not the same as the Federal Statistics Community.

I always felt the OMB Office of Information and Regulatory Affairs (OIRA) Statistical Programs & Standards (Katherine Wallman, Chief Statistician of the US Government) should have a major role in the Open Government Data Initiative. When asked if GSA was the right agency to do Data.gov, I recommended the Census Bureau - the government data agency that produces the data book - the Annual Statistical Abstract.

For a a recent story on Officials Explore New Ways To Tap Value Of Global Government Data, I commented: It is much more than: Many of the government's data sets are not as accessible or as easy to use as the government agencies would like people to think, notes data scientist (and AOL Government contributor) Brand Niemann. It is: Is There a Business Case for Open Government Data? and that  FedStats.gov has done a better job of it over many more years.

Is There a Business Case for Open Government Data?

http://semanticommunity.info/AOL_Government/2012_International_Open_Government_Data_Conference#Story_2

After six days of the 2012 International Open Government Data Conference, I and others are ending up asking ourselves this question.

 
I suggested to the organizers that we need to get data success stories out of all of this for the upcoming 38 Degrees: AOL Government Conference and beyond
 
There are three success models and stories I am aware of with use of data:
  • Statistical agencies that get regular funding because it is critical to decisions like congressional districting, etc. 
  • Intelligence community that got a big budget increase for big data because of the need to find more needles in bigger haystacks 
  • Google, Facebook, LinkedIn, etc. that learned it needed a data science team with an information platform to grow their business 
 
So what business value can make open government data fundable and sustainable like the above three?
 
Maybe by some combination of all three.

I hope that future conferences on open government data will feature data stories of how open government data has been put to work and the work of data scientists to make this field of endeavor sustainable and profitable.

Digital Agenda For Europe: Data as first-class citizen

http://semanticommunity.info/AOL_Government/Digital_Agenda_for_Europe

 
Brussels was alive last week with workshops, meetings and conferences building up to the Digital Agenda Assembly on Thursday 21st and Friday 22nd of June:

Each of these meetings provided high quality data with useful stories that make it a first class citizen.

A Plan for Scaling NIEM to Big Data

http://semanticommunity.info/AOL_Government/A_Plan_for_Scaling_NIEM_to_Big_Data

 
Donna Roy, Executive Director of NIEM, recently sent a 'state-of-NIEM' letter to the community thanking them for continuing to help develop a plan for scaling NIEM and addressing challenges facing the program.
 
The National Information Exchange Model is an XML-based information exchange framework from the United States. NIEM represents a collaborative partnership of agencies and organizations across all levels of government (federal, state, tribal, and local) and with private industry. The purpose of this partnership is to effectively and efficiently share critical information at key decision points throughout the whole of the justice, public safety, emergency and disaster management, intelligence, and homeland security enterprise. NIEM is designed to develop, disseminate, and support enterprise-wide information exchange standards and processes that will enable jurisdictions to automate information sharing.
 
In short, NIEM is not a software program, database, network, or computer system, it is a message format. Probaly the most easily understood and used product of NIEM is the data dictionary spreadsheet. It includes all of the element names that are organized hierarchically under core data components (person, property, organization, etc.) with hyperlinks to related elements. This spreadsheet also provides information on the type of data being represented (date, integer, string, etc.) and a precise, context-rich definition of each dictionary component.
 
A quick look at that spreadsheet shows why NIEM is "complex to use" and not "an integrated architectural approach to shared services". I tried to help NIEM evolve in a recent article: Build The NIEM Information Exchange Clearinghouse In The Cloud.
 
Donna Roy's memo says" "Adding new domains to the NIEM model is manually intensive and we have a chokepoint for growth that is restricting our ability to address new demand." In simple terms, the NIEM model does not scale to the "big data" the Intelligence Community Loves and needs.

The technology for dealing with massive volumes of unstructured data and integrating it with structured data has progressed rapidly since NIEM was started in 2005 and would help Dona Roy and NIEM do as their want to do: "open our thinking to continue to provide new ways to work with NIEM in ways we cannot yet imagine: what is NIEM in a mobile strategy, how does NIEM allow for increased Cyber Security for Cloud Computing, and what is NIEM outside of the current XML use case, are those that come to mind."

Data.gov Developers Community Space Launched- Is Dr. Merkin In the House?

http://semanticommunity.info/AOL_Government/Data.gov_Developers_Community_Space_Launched

The purpose of Data.gov is to increase public access to high value datasets generated by the Executive Branch of the Federal Government and its success is measured by public participation and collaboration in openness and innovation.

I have seen Data.gov go through the following stages:

  1. Launch on May 22, 2009, of a catalog of government agency web sites who offer structured data.
  2. First Birthday on May 22, 2010, with many more data sets, visualization software, and evangelist Jeanne Holm.
  3. International Open Government Data Conference, November 15-17, 2010.
  4. Next Generation Data.gov Platform on April 14, 2011, that is interactive, explorable, and social by Socrata.
  5. First open source code released for the Open Government Platform delivered by the governments of India and the U.S, December 5, 2011.
The most recent stage is today "to help launch the Data.gov developers' community space of the people, by the people, and for the people." It offered four attendee options: Developer, Data Journalist, Data Steward, Open Data Advocate, and Other. I had recommended it include Data Scientist because I felt we didn't need more developers coding, we need more data scientists to work with the data, but that category did not appear, so I registered as a Data Journalist.

This caused me to reflect on my years of experience with Data.gov, and its forerunner Fedstats.gov, and to concluded the following:
  1. Data.gov is for Developers
  2. Big Data is for Data Scientists
  3. The Health Data Initiative Forum III, June 5-6, 2012, described as The Heath Datapalooza, Needs Real Innovation Investment!
My three recommendations at the recent excellent Data.gov meeting were:
  1. Add a data scientist to the Data.gov team to lead a community of data scientists from the agencies and non-government organizations in a new community.
  2. Ensure that the new data.gov platform supports the sitemap and schema protocols with well-defined URLs for content, faceted search, and big data in memory.
  3. Encourage the new developer community to build their own data.gov sites to become both publishers and consumers of data to support the new data scientist community above.
DoD Enterprise Information Web Market Research for Innovation

http://semanticommunity.info/A_DoD_DCMO_Enterprise_Information_Web

 
The DoD Enterprise Information Web (EIW) is pioneering the adoption of Semantic Technology and approaches that can be the way forward for enterprise business intelligence and solution architectures in the DoD. I wrote about DoD Seeks IT Interoperability With Enterprise Information Web and gave a demo of it recently at the Washington DC Semantic Technology Conference.

Our team called the Semantic Community is the voice for "Do-It-Yourself" enterprise information web and analytics. Our thesis is that semantics makes sense, but you don't need to wait for the big COTS vendors in order to make an information web nor run analytics across it. Anybody can do it by following a few simple rules, and using some readily available and quite affordable tools.
 
In fact we told them that we had already piloted an DoD EIW for them with DoD public content during most of the past year. We also recommended they follow the NCOIC-NGA Voice of Industry CRADA and the EPA Apps for the Environment Challenge approaches I have written about recently to foster innovation without conventional contractual competition and with DoD public domain data sets. These two things would give them a balance industry view on the use of semantic technologies and free apps from the community of developers, just like the rest of our government is taking advantage of, to foster innovation at low or no cost.
 
The DoD staff and contractors present at our briefing asked good questions and said they would seriously consider our suggestions so I and our team was encouraged and felt rewarded by the considerable free effort we had put into this. I think this is an excellent way for our federal government to do market research and hopefully better inform and improve the contract procurement process. But first we will have to see what, if anything, tangible comes out of this.
Now Data.gov Wishes It Were CKAN (The Open Source Data Portal)

http://semanticommunity.info/AOL_Government/Now_Data.gov_Wishes_It_Were_CKAN_(The_Open_Source_Data_Portal)

Jeanne Holm, Data.gov Evangelist and Chief Knowledge Architect at NASA/JPL, convened the W3C eGovernment Interest Group meeting on 24 January 2012 to discuss:

 
Platforms for open data

The two big announcements were that the 5-member Data.gov Team wishes they had known about CKAN earlier and that the next International Open Government Data conference will be July 10-12 in Washington DC.

I found this very interesting in light of my recent article on "Data.gov Goes To India - But It Still Needs More Work," in which I pointed out that Data.gov.uk (Powered by CKAN) provides a real service to the UK and how Data.gov would do well to emulate that as a concrete service to the US taxpayers that have been paying, expecting, and even demanding it for several years now - which in this case is right next door - the UK!

 
Jeanne called for suggestions from the group and mine were:
  • Include Data Scientists and the Data Science Community on the Data.gov Team
  • Work for a balance between technology, policy, and applications that provide ROI in our meetings and products
METI Adopts Desktop-As-A-Service Cloud Computing

http://semanticommunity.info/A_Japan_METI_Open_Data_Dashboard/METI_Adopts_Desktop-As-A-Service_Cloud_Computing

I have been meeting with METI (Japanese Ministry of Economy, Trade, and Industry) for the past three years to advise them on data management and cloud computing. Initially this was in my capacity as the EPA Senior Enterprise Architect and Data Scientist where I pioneered Desktop-As-A-Service and now because I continue to use four cloud systems (MindTouch, Amazon, Spotfire, and Be Infomed) for desktop, security, analytics (big data), and dynamic case management.

Most importantly, I was amazed and delighted at what they said: "METI has now started the procurement process of the Next Personal Computers Network System, which will begin operation in November 2012. In this system the whole of METI will adopt cloud computing technology and all METI offices will have a thin-client PC System (Desktop-As-A-Service). This system will realize reduced system costs and enhanced security as well as other benefits."

I feel deeply honored by their words to me and others they have consulted with on this: "Since adopting a thin-client system over the whole Ministry is the first attempt to do this in the national government, METI would like to gain sufficient information regarding know-how and hear experiences of managing and controlling information systems that have introduced cloud computing technology, preferably before November 2012, when METI will begin to operate the Next Personal Computer Network System."

Data.gov Goes To India - But It Still Needs More Work

http://semanticommunity.info/AOL_Government/Data.gov_Goes_To_India_-_But_It_Still_Needs_More_Work

Data.gov evangelist Jeanne Holm emailed and tweeted today: "I wanted you to be among the first to hear about an open source release for an Open Government Platform" that among things, shares Data.gov with India. 
The action is part of the recently launched the U.S. National Action Plan on Open Government, announced by President Obama. It represents another step under the U.S.-India Strategic Dialogue to produce "Data.gov-in-a-Box," an open source version of the U.S.'s Data.gov data portal and India's India.gov.in document portal. In fact, according to the Data.gov site, 28 countries have now adopted open data sites to share information.

The U.S. and India are working together to produce an open source version available for implementation by countries globally, encouraging governments around the world to stand up open data sites that promote transparency, improve citizen engagement, and engage application developers in continuously improving these efforts.

Technical teams from the governments of the U.S. and India have been working together since August of this year, with a planned launch of a complete open source product (which is now called the Open Government Platform (OGPL) to reflect its broad scope) in early 2012.

It's less clear what is new here. You can find out more about the evolution of this project from the U.S. CIO Steven VanRoekel and Chief Technology Officer Aneesh Chopra in a joint announcement they made on a White House blog post today. And more about the Open Government Platform repository is on Github. You'll find here a growing set of open source, open government platform code that allows any city, organization, or government to create an open data site.

In reviewing this site, I essentially found only: Create a new database in MySQL and Login using the default Drupal administration username and password. I also went to India.gov.inand found something that had been copyrighted in 2005. Is there something new I am missing here? The announcement goes on to say: The first module released is the Data Management System, which provides the tools and capabilities for an automated process for publishing data in the Open Government Platform, an open source product designed to facilitate governments around the world to stand up their own open government data sites.

Our next planned release will be from India and related to the web site for the Open Government Platform. The U.S. and India will be providing additional modules in the future, and developers are encouraged to participate, provide feedback, and create new modules and capabilities! The teams working on this project are the National Informatics Centre in India and Data.gov in the U.S.

I asked Jeanne for an interview to get more details and she responded: "The best place to get an interview is through the White House Media Office. You are welcome to contact them directly at media@omb.eop.gov and they are ready to respond!" I did and heard back there were no officials to interview. When I asked where I could see what this would look like, she said: The code release is on GitHub, which is where we and others can provide additional modules as they come up. So I am wondering where is the platform and the real rationale for doing this?

I know that Data.gov has experimented with several platforms (as I have written previously) trying to evolve from catalog-to-repository-to-platform to actually find and access data and build apps, but the latest experiment with Socrata has been criticized as not being an open procurement and an open source platform. So maybe that is what this is all about - trying to straighten that out while looking like providing a service to the world.

I just wrote about how Data.gov.uk provides a real service to the UK and how data.gov would do well to emulate that as a concrete service to the US taxpayers that have been paying, expecting, and even demanding it for several years now.

It is hard not to think that when our leaders make mistakes (which we all do), they are prone to try things that are even bigger mistakes rather that admit them and ask for help, which in this case is right next door - the UK!

U.S.-India Joint Commission on Science and Technology Cooperation Announces Accomplishments

http://semanticommunity.info/HealthData.gov#Story

Today, Dr. John P. Holdren, Assistant to the President for Science and Technology and Director of the White House Office of Science and Technology Policy, and Minister Shri Vilasrao Deshmukh from the India Ministry of Science, Technology and Earth Sciences, led the second U.S.-India Joint Commission Meeting on Science and Technology Cooperation in Washington, D.C., at the US State Department's George Marshall Center.

The principal accomplishments announced were:

  • Establishment of the Monsoon Desk at the National Oceanic and Atmospheric Administration (NOAA)
  • Presentation by the Endowment Board of certificates to three grant winners from the first round, Sorin Grama and Sam White, Co-founders of Promethean Power Systems (US) and Rustom Irani, Manageing Director, Icelings (India)
  • Announcement by Chris Vein, White House Deputy Chief Technology Officer, of the Third Country Open Government Platform Partnerships (OGPL), and brief demonstration by Marion Royal (US GSA) and Samir Mitra (India PM Advisor's Office)

The Open Government Platform (OGPL) is a bilateral effort to promote transparency and greater citizen engagement by making government data, documents, tools and processes publicly available.

The idea is that making this information available on an open-source platform in machine-readable format will allow developers, analysts, the media, and academics an opportunity to develop new applications and insights, which will ultimately give citizens more information to facilitate better decisions.

I have expressed reservations about this in a previous story (Data.gov Goes To India - But It Still Needs More Work) because in essence: technology and data people speak a different language, to me it is not about what one does to the data (technology), but what one does with the data (science, statistics, and visualizations).

So here is the situation: Data.gov was not built on open source software, but needed to be if anyone else was going to use it - especially poor third world countries that cannot afford their own developers or commercial software. But Data.gov needed a first rate team of developers that could convert old, complex software code into simplier, new simplier to use open source code. Enter the Government of India's National Informatics Centre that produced an open source version of Data.gov that was made available on the third anniversary of Data.gov (May 2012). The open source product, called the Open Government Platform (OGPL), can be downloaded and evaluated by any national Government or state or local entity as a path toward making their data open and transparent.

Now this OGPL is based on Drupal, an open source platform, already used by Data.gov.uk (see my Data.gov.uk - What's Not to Like), and many others, including the new HealthData.gov launched by US Federal CTO Todd Park at his Health Datapalooza last week.

So where does this all leave us? We have Todd Park, the Federal CTO, already using Drupal for his new HealthData.gov and announcing a series of developer challenges over the next year to build it out. We have Chris Vein, the Deputy Federal CTO, announcing that India has developed an open source version of Data.gov based on Drupal that Data.gov will upgrade to and Riwanda will use. So now we are converging on a platform that does the first of three things that we need: Data Catalog, Actual Data, and Data Results.

To illustrate my point, I took the challenge that Todd Park gave me at last week's Health Datapalooza and made the new HealthData.gov do all three things in one portal where one sees the Data Catalog, the Actual Data, and the Data Results. This implements the 7 challenges that Todd Park announced to further develop HealthData.gov over the next year and my recommendations at the recent Data.gov Developer Community meeting. It is also an example of Building a Digital Government by Example.

So I say enough with putting old wine (Data.gov) in new bottles (Open Source Drupal), and on to the real needs of citizens everywhere, namely to go from Data Catalog, to Actual Data, to Data Results, so they can use it to make informed decisions.

Data.gov.uk - What's Not to Like

http://semanticommunity.info/AOL_Government/Data.gov.uk_-_What's_Not_to_Like

 
This week at the SemTech Biz DC Conference, Jim Hendler, advisor to Data.gov, explained the history of the "friendly competition" betwwen data.gov.us and data.gov.uk and said that the latter had about 6000 data sets that were in better shape than the former so I decided to take another look and was very impressed. Hendler also said that the UK Government has designed and made great use of standard Web address practices in their linked data and moved even further ahead of the US in open data with creation of the Open Data Institute.
 
First I decided to help myself and my readers by building a sitemap of the data.gov.uk site because the topics it includes are just what people have been asking the US data.gov to provide, namely: meetings, business plans, contracts, forums, blogs, etc. Then I downloaded a few of their key datasets to see how easy it was to work with and understand them. I downloaded their Data CatalogCOINS, and Performance Data and created a dashboard shown elsewhere.
 

So my goal was to integrate all of this (three data sets and their data dictionaries and metadata) into one dashboard. The dashboard I created is shown elsewhere and convinced me that it was very easy to access, use, and understand their Data Catalog, COINS, and Performance Data Sets. This is what we need the US data.gov and other administration open government web sites to be.

DoD Seeks IT Interoperability With Enterprise Information Web

http://semanticommunity.info/Build_DoD_in_the_Cloud/Enterprise_Information_Web_for_Semantic_Interoperability_at_DoD

The DoD Deputy Chief Management Officer (DCMO) has just released a Request for Information (RFI) that reminded me of an earlier AOL Government Story I did about 4 months ago - Cartwright, McGrath say semantic interoperability will drive DoD's information environment. I was asked how this RFI about the semantic web can help DOD in particular, and perhaps the federal government on a broader scale as well, because I have worked on semantic interoperability for the  past 10 years and on a DOD Enterprise Information Web the past 6 months.

My Build the DoD DCMO in the Cloud Spotfire Dashboard is shown elsewhere along with the 15 other dashboards like the DoD FY 2011 Budget. My goal is to show how DoD data and the RFI can be a semantic web (with semantic technologies), like the EIW solution pattern shown in the RFI, and be done much faster, than the notional schedule of EIW shown in the RFI. This is like my recent Federal News Radio Interview: Lessons for Managing Dashboards, November 10th, reporting on 7 of the 11 dashboards for the Federal government.

Build The NIEM Information Exchange Clearinghouse In The Cloud

http://semanticommunity.info/AOL_Government/Build_the_NIEM_IEPD_Clearinghouse_in_the_Cloud

 
The National Information Exchange Model, with its XML Schema for Information Exchange Package Description messages three years ago, has become the <NIEM> Community according to Donna Roy, Executive Director, at their recent national training event with about 500 in-person attendees and about 200 remote attendees. <NIEM> is a community that is trying to conect the dots betweens its members like Linkedin does for its members according to Ellen Levy, Vice President Strategic Initiatives, LinkedIn Corporation. While the <NIEM> Community views itself as a significant player in the standardization of messaages for interoperability, it realizes it is only a small island in the sea of social messages that people use to connect the dots between themselves and world events using message formts and tools like Twitter. In addition, I understand whyEPA, my former employer, was reluctant to endorse NIEM, because it had already done this type of activity in building itsNational Environmental Information Exchange Network.
 
DHS CIO Richard Spears recently praised <NIEM> Community in an AOL Government article that was reprinted from CIO.gov and said: "NIEM is now the DHS enterprise architecture standard for how we interconnect systems" and that he has not seen a better return on investment for our taxpayer dollars than in supporting NIEM. However, I found the <NIEM> content itself to be difficult to access so I decided to apply data science to samples of <NIEM> Community content to create an interoperabilty interface for it as follows:
 
The NIEM IEPD Clearinghouse is a Web Database; The NIEM IEPD Submission Form is a Word Document; The NIEM IEPD Clearinghouse Help is a PDF File; and the NIEM Training Event Agenda is a PDF File, and NIEM Exchange Partners is a Text File 

I am advocating that NIEM take the next steps of moving its clearinghouse to the cloud and implementing dynamic case management to better connect the dots than it does presently and showing that with four different kinds of their content in an interoperability interface (which happens to be a Spotfire dashboard).

Recent Research

Introducing Alpha.Data.gov

MY NOTE: I sent a tweet to them. See Wiki version

Source: http://www.whitehouse.gov/blog/2013/01/28/introducing-alphadatagov

When the White House Office of Science and Technology Policy announced its call for 18 Presidential Innovation Fellows last summer, US Chief Technology Officer Todd Park also asked folks across the country to support these Fellows with great ideas and valuable feedback.

Over the past few months, through video chats, conference calls, and in-person meetings, thousands of Americans have connected with us to learn and share ideas about our work—and this Administration’s commitment—to unleash data from the vaults of the government as fuel for innovation. Time and again, we were asked why more people weren’t aware of these “Open Data” efforts, their numerous benefits for Americans, and how to get engaged.

After hearing this feedback, we had an idea: create an online showcase, highlighting the very best Open Data resources and how they are already being used by private-sector entrepreneurs and innovators to create new products and services that benefit people in all kinds of ways—from empowering patients to find the best healthcare right when they need it; to helping consumers detect credit card fraud; to keeping kids safe by notifying parents when products in their home are recalled. 

 

Alpha.data.gov_20130128

Screenshot from the new alpha.data.gov experimental website, created by the 2012 Presidential Innovation Fellows.

On scrap paper, we sketched out a simple one-page website that would tell the story of Open Data:Alpha.Data.gov. As the name suggests, this is an experimental release. Over time, it will grow and evolve to help catalyze future improvements to the design, content, and infrastructure of Data.gov.

In the meantime, think of Alpha.Data.gov as a first draft. To make it better, we need your help. We’ve seen firsthand that your feedback, ideas, and stories can spur new Open Data innovations. So please send your feedback to @ProjectOpenData on Twitter. And if you’re a front-end designer or front-end developer, we’d love to get your feedback directly on GitHub, so that we can design this collaboratively.

2013 promises to be a busy year for Open Data efforts at The White House and across government. But this story isn’t just about us. It’s about what we can all do together to spur game-changing innovation through the application of Open Data.

To learn more about the Presidential Innovation Fellows, please visit: WhiteHouse.gov/InnovationFellows

To learn more about Open Data resources currently available, please visit:  Alpha.Data.gov and Data.gov

Danny Chapman is a Presidential Innovation Fellow working on MyGov at the General Services Administration.

Ryan Panchadsaram is a Presidential Innovation Fellow working on Blue Button for America at the Department of Health and Human Services.

John Paul Farmer is a Senior Advisor at the White House Office of Science & Technology Policy.

@todd_park

Source: https://twitter.com/todd_park

Todd Park

U.S. Chief Technology Officer and Assistant to the President. Tech entrepreneur-in-residence at the White House

Department of Commerce Open House RSVP

Source: http://action.2013pic.org/page/s/dep...-commerce-rsvp

“Building it Here, Selling it Everywhere”

The U.S. Department of Commerce will host an open house panel discussion on “Building it Here, Selling it Everywhere.” The program will be built around Commerce’s key priorities, including manufacturing, innovation and exports. Department officials will be on hand to talk about how our work on these initiatives plays a key role in creating jobs here at home and making us more competitive abroad.

Where: U.S Department of Commerce Auditorium
Address: 1401 Constitution Ave NW
Directions: Enter on the Main Entrance on 14th Street between Constitution and Pennsylvania
When: 1:00pm – 2:30pm

“Technological Innovation and Job Creation”

Learn more about Administration initiatives that drive technological innovation and job creation at an open house hosted by the U.S. Department of Commerce. The White House’s Office of Science and Technology Policy (OSTP) and agencies from the U.S. Department of Commerce (the National Telecommunications and Information Administration, the National Institute of Standards and Technology and the US Patent and Trademark Office) will hold a panel discussion on key issues that help bolster the economy, including tech transfer, patent reform and internet policy.

Where: U.S Department of Commerce Auditorium
Address: 1401 Constitution Ave NW
Directions: Enter on the Main Entrance on 14th Street between Constitution and Pennsylvania
When: 3:00pm – 4:30pm

President’s Council of Advisors on Science and Technology (PCAST) Subcommittees and Plenary Meeting Agenda

Source: http://www.tvworldwide.com/events/pc...mber_202233077


Public Session Webcast, January 4, 2013 - 9:30am to 12:00pm

 

 
   

 SUBMIT A PUBLIC COMMENT

EmailEmail


Now Playing: Open Government
Todd Park, U.S. Chief Technology Officer 

WEBCAST ARCHIVES

 

What Do You Think About Open Government Video of Todd Park, U.S. Chief Technology Officer?

Source: http://www.linkedin.com/groupAnswers...3ihwclzYRcClA1

Owen Ambur • It is good to hear OMB will be issuing a policy to make open, machine-readable data the default for U.S. federal agencies.

The requirement to provide data in machine-readable format is already referenced in the U.S. Code in about 40 places. http://uscode.house.gov/search/criteria.shtml

One of those references stems from section 10 of the GPRA Modernization Act (GPRAMA), which requires agencies to publish their strategic and performance plans and reports in machine-readable format. http://xml.fido.gov/stratml/references/PL111-532StratML.htm#SEC10

It was also good to hear Todd speak publicly about the need for data standards. When I spoke with him at the International Open Government Data Conference at the World Bank, he said agencies know they should publish their plans and reports not merely in any machine-readable they choose but, rather, in an open, standard format. However, since OMB's guidance is not exactly clear in that regard in Circular A-11, it will be good to have a policy making the point more explicitly.http://www.whitehouse.gov/sites/default/files/omb/assets/a11_current_year/s200.pdf

I look forward to seeing OMB's new policy statement and considering whether it might lend itself to rendition as a performance plan in open, standard, machine-readable StratML format, for inclusion in our collection athttp://xml.fido.gov/stratml/drybridge/index.htm#OMB

When agencies are publishing their goals, objectives, and performance indicators in open, standard, machine-readable format, it will be interesting to see what data entrepreneurs can make of it.

For example, it will be possible for agencies to comply with the requirement of the eGov Act to work together to link their performance goals to key stakeholder groups, including citizens, businesses, and other governments, as well as internal Federal Government operations. http://xml.fido.gov/documents/completed/eGovXML.htm#202b

February 12-14 2013 Meetings

METI: Ministry of Economy, Trade and Industry

MIC: Ministry of Internal Affairs and Communications

Mr. Kenji Hiramoto, Executive Advisor for CIO at METI
Mr. Shuichi Tashiro, Head of International Standardization Promotion Center at IPA (IT Promotion Agency),  METI's IT agency
Mr. Hajime Horiuchi, Former Professor at TIU, and
Mr. Seiichi Nobuhara, CEO & President at IBT

Tuesday, February 12, 2013

9:00 am – 11:00 am

U.S. Department of Health and Human Services

Location: 200 Independence Ave SW Washington, DC (Room 305A)

1-2:30 p.m.

US General Services Administration, Office of Citizen Services and Innovative Technologies Slides

1275 First St, NE, Washington, DC  20417

Location: WASHINGTON HILTON, 1919 Connecticut Avenue, NW  I  Washington, DC 20009

 

3:00-5:00 p.m.

Oracle (Slides and Slides), Model-Driven Solutions (Slides), and Semantic Community (Slides)

Location: WASHINGTON HILTON, 1919 Connecticut Avenue, NW  I  Washington, DC 20009

David Webber: EU Joinup project now officially listing CAM Editor as one of its OSS tools: https://joinup.ec.europa.eu/software/camed/home

Wednesday, February 13, 2013

TBD

U.S. Department of Justice, Bureau of Justice Assistance

Location: To Be Determined

1:00 pm – 3:00 pm

NIEM Program Management Office, PM-ISE & Department of the Navy (Maritime Domain)

Location: 2100 K St NW Washington, DC (Suite 300)

 

Thursday, February 14, 2013

10:00 am – 11:00 am

Mr. Richard Soley, Object Management Group

Location: 2100 K St NW, Washington DC

2:00 pm – 3:00 pm

NIEM Virtual Town Hall

Location: Hotel or 2100 K St NW Washington, DC

NIEM Town Hall February 14th!
 
1/9/2013, By: NIEM PMO

We’re kicking off the new year with a Town Hall, and you’re invited! Please mark your calendars for Thursday, February 14, 2013 at 2:00 p.m. EST.

The Town Hall is virtual (online) and will focus on the community’s hard work and successes that have helped elevate NIEM to the next level. Agenda includes:

  • Donna Roy, NIEM Executive Director: Preview of 2013 NIEM highlights.
  • Andrew Owen, NTAC Co-Chair: Progress on the NIEM Version 3.0 Release.
  • Joe Bodmer and David Tabler, NIEM Human Services Domain Leaders: Community engagement and growth of the Human Services domain.
  • Doug Robinson, NASCIO Executive Director: Overview of formal NIEM adoption efforts across states and territories.
  • Joseph Grubbs, VA Commonwealth Data Governance Service Lead: Achieving interoperability across the Commonwealth of Virginia through the use of NIEM.
  • Community Q&A: We’ll wrap things up by answering your NIEM questions! Questions are first come, first serve, so be sure to email questions ahead of time to information@niem.gov. Please include "Town Hall" in the subject line.

NIEM Town Halls are free and open to everyone. Please RSVP promptly so we can accommodate all who wish to participate!

To RSVP, please click the URL below or copy and paste it into your browser. Be sure to add the Town Hall to your calendar--you won't want to miss it!

http://a3.acteva.com/orderbooking/bookEvent/A330978

We look forward to "seeing" you there.

Community Gathers for a NIEM Town Hall
 
2/15/2013

By: NIEM PMO

Once again, NIEM community members came together for a NIEM Town Hall. In total, 279 community members—from federal, state, local, international, and the private sector—tuned in to hear about an array of exciting topics, ranging from program and domain updates to state success stories.

NIEM Executive Director, Donna Roy, hosted the Town Hall and led a lively discussion between the panelists and the NIEM community. Andrew Owen, NIEM Technical Architecture Committee (NTAC) Co-Chair, who helps lead the development of the 3.0 technical architecture, discussed the NIEM 3.0 progress and the community’s success in wrapping up the Pre-Alpha phase of the release cycle.

Joe Bodmer and David Tabler, NIEM Human Services Domain Stewards, touched on the ways community engagement has helped accelerate NIEM adoption within their domain as well as next steps for establishing domain governance.

Doug Robinson, NASCIO Executive Director, discussed the importance of NASCIO’s partnership with NIEM and helped shed light on the various NIEM adoption efforts currently underway across states.

The final panelist was the Commonwealth of Virginia’s Data Governance Service Lead, Joseph Grubbs. Grubbs discussed Virginia’s progress in its effort to adopt NIEM, including use of the NIEM Engagement Process and Cost Model.

The Town Hall came to a close with a Question & Answer session that allowed the general community to submit questions to the panelists in real time.

Town Halls are essential for the success of the NIEM program because they provide a platform for community members to inform and engage each other and to share their experiences.

We look forward to the next Town Hall! In the meantime, be sure share how you’ve implemented NIEM within your organization on our map.

NIEM 3.0 on schedule for fall release, say architecture committee members

Source: http://www.fiercegovernmentit.com/story/niem-30-schedule-fall-release-say-architecture-committee-members/2013-02-19?utm_medium=nl&utm_source=internal

By David Perera

A beta release of the third version of the National Information Exchange Model should be ready by this summer with release candidates complete by this August or September, said Andrew Owen, NIEM technical architecture committee co-chair, while speaking Feb. 15 during an online meeting of NIEM stakeholders.

NIEM is a set of standardized XML schemas built on a core of commonly defined data components, and is used as a data exchange method by federal, state and local governments. Its governance model minimizes top-down mandates in favor of permitting communities of interest to control for themselves standards for non-overlapping data components. Existing NIEM communities of interest include maritime, law enforcement, and infrastructure protection. Work on the third version of NIEM began in July 2012. Its program management office resides within the Homeland Security Department.

Among the changes that NIEM 3.0 will incorporate are intelligence community security markings. The new version, set for a final release this fall, will also "better accommodate local terminology and acronyms," Owen said.

"Until 3.0 there were some rules and practices that weren't as welcoming to local terminology and acronyms, and we're making that a much easier thing to do," Owen said.

Also slated for release with NIEM 3.0 is a new unified modeling language profile for NIEM, Owens said. There is a UML profile aligned with version 2.1 of NIEM, but it will be updated--along with an approach for keeping NIEM and the UML profile constantly synchronized as future versions of NIEM are developed, he added.

For more:
- go to the NIEM 3.0 webpage

Related Articles:
Roy: Big data reveals gaps in standards and federal human capital
DoD adopts NIEM, will no longer support UCore development
ISE set to play larger role in cybersecurity info sharing, says Paul

Upcoming Meeting Questions for NIEM and ODG Leaders

Preface

We should have refrained from casting a lot of questions, but these could be essential for us to conduct an in-depth survey on the NIEM and its adaptation into Japan.

For your information, we will be forming a delegation to meet and discuss with all of you at DHS, a few city/state governments which have adopted NIEM and some private companies in the US, with its schedule in February next year. We will officially ask for appointments and some help from you to set up meetings with other city and or state government/Federal agencies, once our schedule is fixed. we would say in advance that It would be appreciated if you could help us somehow.

It is probable that an upcoming meeting in February would be for in-depth discussions to cover many topics, and then we would proceed into a next stage if we find it a must to sign on any kind of LOI or MOU during a further visit to Washington DC.

1. Please clarify the current status and outlook for the convergence of DoD's UCore into NIEM.

* Following a recent meeting with the intelligence community's Information Sharing Environment program office, the Defense Department drafted a memo specifying the National Information Exchange Model as the basis for its data exchange strategy. According to a meeting summary provided on condition of the sender's anonymity, the Defense Department office of the chief information officer no longer supports further development of UCore as a DoD-unique data exchange model. The summary states that NIEM and UCore are not being converged. "You join or adopt NIEM, you do not converge with NIEM," it says. As a result, the DoD will adopt a data exchange strategy in which NIEM "will be considered first and used where practical." So Data.gov will become more semantic while DoD/IC NIEM will become less semantic!

* Excerpts from recent story:
http://semanticommunity.info/AOL_Government/Big_Data_Reveals_Gaps_in_Standards_and_Federal_Human_Capital#Story

2. Provide us a scheme of your collaboration of the Government of Canada (and Mexico), if possible with a MOU framework

I just did a story on the Canada Shared Services in the Cloud with the following goals:
Moving 43 partner organizations from separate email services to a consolidate, secure, and reliable and

cost-effective email platform for the Government of Canada.
To move from more than 300 Government of Canada data centres to fewer than 20.
To move the Government of Canada to a single, shared telecommunications network infrastructure.

So if a government moves to shared services like these, the old (non-shared services) architectural model that

NIEM was designed to deal with is obsolete and governments can both save moey on infrastructure and get to

interoperability much easier!

http://semanticommunity.info/Emerging_Technology_SIG_Big_Data_Committee/Cloud_Computing_AND_Big_Data_Forum_and_Workshop_January_15-17_2013#Story

3. How do you think of EU's ISA project, in terms of your collaboration, what is a major difference between NIEM and ISA, and their interoperability, etc.

Brand, Just had some good news today - EU Joinup project now officially listing CAM Editor as one of its OSS tools: https://joinup.ec.europa.eu/software/camed/home David Webber, Oracle Information Architect

4. The following question could be related the question No.3, but please specify if you have a different approach to the classified information/date that the Federal Agencies/the Public Administration hold, or to the open data to be disclosed to the public. As for the queries raised in October, what approach have you taken in the NIEM for the classified data and the open data?
5. Are there any functionality of dictionary not to repeat collecting the same information/data?
6. How do you prepare for the Global standardization of information sharing platform such as NIEM, ISA, etc. to assure their interoperability?
7. How do you talk with NIST for its standardization?

I covered the recent NIST Conference and did not hear a NIEM presentation or mention of NIEM:

http://semanticommunity.info/Emerging_Technology_SIG_Big_Data_Committee/Cloud_Computing_AND_Big_Data_Forum_and_Workshop_January_15-17_2013

8. Please show us examples of domains such as disaster prevention, legal documents/juridical database including criminal data, social insurance/tax data, etc.
9. What is your relationship with private IT vendors such as IBM, Oracle, MS, etc. How are these private IT vendors planning to sell NIEM related products?

* Donna Roy, executive director of the information sharing environment office which does NIEM within the Homeland Security Department, made the astute observation recently: "The biggest gap at the federal level is in the recruiting and in the business case around staffing up the human support cadre and that DHS lacks data scientists at the headquarters level." This data scientist and semantic web expert would tell her NIEM is not a network data model while the semantic web is!

*  Roy also decried a lack of standards in commercial products around business rule portability and entity resolution. My research suggests that Oracle, thanks to David R.R. Webber, may be a larger and better implementer of NIEM than “NIEM” itself!

* Excerpts from recent story:
http://semanticommunity.info/AOL_Government/Big_Data_Reveals_Gaps_in_Standards_and_Federal_Human_Capital#Story

10. Other

I just wrote a story about how the DHS wanted a data sharing network, but got NIEM (National Information Exchange Model-an XML-based format for Information Exchange Packages-IEP) instead. Now they realize they really need a network with database technology with cell-level security (Accumulo) and row-level metadata.
See: http://semanticommunity.info/DataTransparencyCoalition.org#Story_2

My slides for presentation to the Federal Big Data Senior Steering Group on Thursday are at: http://semanticommunity.info/@api/deki/files/21041/BrandNiemann01242013.pptx

Our Federal government is not talking about using NIEM for big data (it does not scale for that), but a Semantic Web Strategy does!

Summary of February 12 2013 Meetings

U.S. Department of Health and Human Services

7 people (2 on the phone)

I was told that this meeting was about big data.

Data.gov and NIEM

Marion Royal, Program Director - Data.gov (Slides) and Hyon Kim, Deputy Program Director - Data.gov

Data.gov is an aplication, platform, and portal with many data sets (400,000). NIEM is a good format.

MY COMMENT: Only about 6,000 data sets in the Catalog spreadsheet - the rest are geospatial files.

Data.gov supports facted search, visualizations, but discovery is the primary purpose. It has tried to make use of Semantic Standards and Technologies with the help of Brand Niemann and others.

Data.gov users are the ppublic and developers who have done some work on the relationships between multiple data sets.

Data.gov is part of the US Action Plan and has the Open Government Platfrom that is being used by Ghana and possibly Riwanda. Japan is not part of the OG Partnership and Canada has just joined and Mexico is interested.

The Digital Government Strategy is about data anyweher, anytime, on any device. and needs agency participation to make data useful to citizens. The DGS has a timeline for Data.gov and agenices to have APIs.

Question from Shuichi Tashiro: How do you unlock data value to drive innovation? and distinguish between tyoes of data (public, confidential, and calssified)?

Answer by Marion Royal: Open data attracts innovators, especially college students to the Challenges the government sponsors.

Answer by Hyon Kim: Publishing data empowers citizens like the Department of Labor private pension plans comparsions which spawned a new small company to provide that service.

Answer by Marion Royal: Agency's first response was whay, but White HOuse response was why not - all should be publkic unless real justification.

Question from Shuichi Tashiro: are the APIS standardized?

Answer by Marion Royal: No, Data.gov is just a catalog now and we are not mandating them, just encouraging them.

MY COMMENT: Every page of MindTouch is an API and the entire MindTough Knowledge Base has an API.

Mr. Hajime Horiuchi, Former Professor at TIU: Are you a member of OMG?

Answer by Marion Royal: No, but I have worked with them and mostly with UNCEFACT

Mr. Hajime Horiuchi, Former Professor at TIU: How many apps does Data.gov have (e.g. Apple has 400,000)

Answer by Marion Royal: About a 100 or so.

Mr. Hajime Horiuchi, Former Professor at TIU: How does an agency decide what data to be released.

Answer by Hyon Kim: Agency's have made this decision long before. Data.gov does not decide this, but just checks because one agency may not know what another agency has.

Brand Niemann: Provide EPA experience with wanting a data network for environmental data as follows:

EPA pays the states to collect about 30 different types of pollution data that is provided in different formats to different legacy systems.

States suggested to Congress that EPA standards on XML formats and Web Services for a Central Data Exchange (CDX) that would improve efficiency and interoperability.

EPA agreed and formed the National Enironmental Information Network (NEIM) with a governance structure years before NIEM started.

NEIM created an XML Schema for about 30 data flows and each state extablished Web Services to make those data flows to CDX.

Each standardized data flow was validated against the XML Schema and the states got paid on that basis going forward.

The goal of eliminating the legacy systems and providing ready access back to the states has not been fully realized and still is a work in progress.

EPA did not see a need to adopt NIEM since it already had NEIM when the Federal CIO Council asked each agency to justify why it was not using NIEM.

Question from Mr. Hajime Horiuchi, Former Professor at TIU: How do you analyze big data and do you have guidelines?

Answer by Marion Royal: No guidlines and more discovery than analytics for data and especially big data.

MY COMMENT: I provide Guidelines in my presentation.

Question from Kenjii Hiramoto: We are using CKAN. Are you?

Answer by Hyon Kim: Yes, we are staring to convert the Data.gov catalog to CKAN.

MY Comment: MindTouch, Spotfire, and Be Informaed are more mature tools for Open Government data as I show in my presentation.

Question from Kenjii Hiramoto: What is te extent of your use of visualizations?

Answer by Marion Royal: We mainly provide the raw data and rely on Socrata, CKAN, map services at Geodata.gov to provide visualizations.

Marion Royal: Congratulations to METI on your work with Open Government Data and we salute your efforts.

Kenjii Hiramoto and All: Thank you for your presentation and answers to our questions.

METI Open Government Data

Kenjii Hiramoto, Executive Advisor for CIO (Slides) (New Slides to be Sent)

Handout of New Slides - To be included with notes when received.

NIEM OMG

Cory Casanave, President Model-Driven Solution, and OMG Board of Directors (Slides) and Handout of Example of Modeling.

NIEM-PMO contract to elevate NIEM to higher level of abstraction.

OMG Taxomony and Viewpoints: Content, Process, Service, and Policy (Rules)

The 9000 some concelts in NIEM are its core asset, reuse of them is the key value proposition, and ovr 300 rules to sturcutre NIEM properly.

Like to inlcude RDF and Linked Open Data in NIEM.

MY COMMENT: See for example Build the NIEM IEPD Clearinghouse in the Cloud.

Demo using Magic Draw.

Still need to integrate the services and policies in this.

It was a pleasure speaking with you yesterday in support of your forward thinking initiative to invigorate industry and make government more efficient through better information sharing. Thank you for the opportunity  I hope I was able to help communicate the concepts and advantages of a model driven and standards based approach to information sharing across communities, nations and technologies.  As we saw, NIEM-UML is already implementing this approach based on the substantial information sharing vocabulary defined in NIEM. In this way embracing NIEM as well as other standards becomes practical and can then enable international information sharing as well as provide a foundation for internal sharing. 

The combined advantages of ease of understanding for stakeholders, quicker development, easier maintenance and technology independence should surely be importance factors for a program to scale to the level you are anticipating.

It should also be noted that the tooling I showed briefly from Nomagic is standards based, general and mainstream.  It can be used for all phases of the information sharing and application development life-cycle.  Please consider the importance of such scope and vendor independence in comparison to other tooling which may be more proprietary.  Certainly the UML family of standards is well understood, well supported and well respected.

Perhaps the next step would be a small pilot project to validate the approach as well as to overcome any language or technology issues that may exist. Please feel free to contact me should I be able to offer further assistance.

MY COMMENT: This is what Be Informed does in major business applications like Dutch Immigation System (90,000 some rules), Dutch One Stop for Citizens, and EU Patent Office where the Knowledge Model is the Architecture is the Documentation is the Appilcation.

NIEM Oracle

David Webber, Oracle Information Architect and NIEM NTAC Member  (Slides)

Likes Kenjii Hiramoto slide on page 23. Brand Niemann's mention of EPA experience reminded him of EDI work and two trips to Japan.

US Digital Government Strategy says APIs everywhere.

MY COMMENT: I can provide my examples for the data science/data jrunalism stories I have done.

Caveat: Not intended for unstructured data.

MY COMMENT: I include the integration of unstructured and structured data in my work. See for example Build the NIEM IEPD Clearinghouse in the Cloud.

Caveat: Also gap with semantic technology integration and no acutal logical models of information.

MY COMMENT: I include this in my Guidelines and use of Be Informed.

MY COMMENT: The two biggest problems the US Intelligecn community has with information sharing and exchange are integration of unstructured and structured data (see my use of well defined URLs in metadata that supports facted search) and cell-level security in databases (NAS Accumulo Project and now Sqrrl). Also Exploiting Linked Data with BI Tools (Kingsley Idehen) and A Semantic Web Strategy for Big Data (Cray Graph Computer).

Demo

The Kanji certainly provides some interesting aspects of the puzzle for providing localized "NIEM-style" ISO and CCTS component dictionaries for Japan industry projects.

I realize now that the current component Renamer automation tool we have is highly English language centric.

Could be a project for someone in Japan to develop a Kanji variant of the code - by replacing the English language patterns and key words.  Since everything is open source - we could certainly collaborate on that. Plus we could look to the 
UN/CEFACT terms dictionary for equivalent core terms already.

I wanted to also point out some more important areas we did not have time to cover in the meeting. Particularly the XML exchange template evaluation tool.  This inspects the exchange template for patterns and potential interoperability issues.  Again this is using English language constructs.  It provides a score out of 10 on NIEM design aspects.  Also it highlights errors and issues in design along with allowing a spell check of words used.

The other piece I forgot was to show the modelling - that makes visual models of the exchange components, and then also UML models - from the XML.  I think this is especially useful for people familiar with XML and SQL, allowing them to build models of their designs without knowing specialized UML.

Online demonstrations of open data tools in action: http://www.niemtrainingvideos.org

 
Semantic Community

Brand Niemann, Director and Senior Data Scientist (Slides) (Word answers to questions)

Abbreviated Presentation due to time limitation

 

Slides

e-Government and Open Government Data In Japan

Kenji Hiramoto  Executive adviser for CIO, Ministry of Economy, Trade and Industry   Feb, 2013 Slides

130215e-gov&opendatafinalSlide0.PNG


E-GOVERNMENT IN JAPAN

130215e-gov&opendatafinalSlide1.PNG

Basic Act for IT

130215e-gov&opendatafinalSlide2.PNG

Transition of Japanese IT Strategy

130215e-gov&opendatafinalSlide3.PNG

Overview of Japanese Government Information Systems

130215e-gov&opendatafinalSlide4.PNG

The Government Portal Site “e-Gov”

130215e-gov&opendatafinalSlide5.PNG

Projects

130215e-gov&opendatafinalSlide6.PNG

Local government

130215e-gov&opendatafinalSlide7.PNG

Organization for Promoting e-Government

130215e-gov&opendatafinalSlide8.PNG

Information Security Policy Council, National Information Security Center (NISC)

130215e-gov&opendatafinalSlide9.PNG

OPEN GOVERNMENT IN JAPAN

130215e-gov&opendatafinalSlide10.PNG

Open Government Lab

130215e-gov&opendatafinalSlide11.PNG

Services in the lab

130215e-gov&opendatafinalSlide12.PNG

Participation

130215e-gov&opendatafinalSlide13.PNG

Information Analysis

130215e-gov&opendatafinalSlide14.PNG

OPEN GOVERNMENT DATA STRATEGY

July 4, 2012, IT Strategic Headquarters, Japan (Director-General: The Prime Minister)

130215e-gov&opendatafinalSlide15.PNG

 

Significance and Objectives

130215e-gov&opendatafinalSlide16.PNG

Basic Direction

130215e-gov&opendatafinalSlide17.PNG

Specific Measures 1

130215e-gov&opendatafinalSlide18.PNG

Specific Measures 2

130215e-gov&opendatafinalSlide19.PNG

Implementation Structures

130215e-gov&opendatafinalSlide20.PNG

OPEN DATA HISTORY & DIRECTION

130215e-gov&opendatafinalSlide21.PNG

Creation of "Leading-Edge Integrated Industries"

130215e-gov&opendatafinalSlide23.PNG

Open data and architecture

130215e-gov&opendatafinalSlide24.PNG

Data catalogue in Japan

130215e-gov&opendatafinalSlide25.PNG

Open Data Ideabox

130215e-gov&opendatafinalSlide26.PNG

E-GOV BEST PRACTICES

130215e-gov&opendatafinalSlide27.PNG

Making Spots Where Hard Braking Occurs Frequently Safer

130215e-gov&opendatafinalSlide28.PNG

Pension-Net: Provision of pension data for each citizen

http://www.nenkin.go.jp

130215e-gov&opendatafinalSlide29.PNG

Information Analysis

130215e-gov&opendatafinalSlide32.PNG

“Shorting items” daily ranking

130215e-gov&opendatafinalSlide33.PNG

OPEN DATA BEST PRACTICES

130215e-gov&opendatafinalSlide34.PNG

e-Stat (Ministry of Internal Affairs and Communications)

http://www.stat.go.jp/english/

http://www.nstac.go.jp/en/

130215e-gov&opendatafinalSlide35.PNG

Traffic and Road Closure  Information after the earthquake

http://www.its-jp.org/saigai

http://www.mapion.co.jp/feature/eq2011/traffic.html

130215e-gov&opendatafinalSlide37.PNG

Support civic participation in energy conservation after the earthquake

http://setsuden.go.jp/

130215e-gov&opendatafinalSlide39.PNG

Public appeal for greater public engagement in energy conservation

130215e-gov&opendatafinalSlide40.PNG

Recovery and Reconstruction Support Program Database

130215e-gov&opendatafinalSlide41.PNG

Recovery and Reconstruction Support Program Database To FSnavi

http://www.r-assistance.go.jp
http://www.fsnavi.jp/

130215e-gov&opendatafinalSlide42.PNG

Book search service “Calil”

http://calil.jp/

130215e-gov&opendatafinalSlide43.PNG

Tokyo Amesh, Protecting people from rain disasters

http://tokyo-ame.jwa.or.jp/en/index.html

130215e-gov&opendatafinalSlide44.PNG

Environmental Information “Kankyo Tenbodai”

130215e-gov&opendatafinalSlide47.PNG

The nature of the soil and ground information database

http://www.asahigs.co.jp/gspace/dataservice.html

130215e-gov&opendatafinalSlide48.PNG

Garbage day Information “Kamakura Gomi Busters”

https://itunes.apple.com/jp/app/id49...ign-mpt=uo%3D4

130215e-gov&opendatafinalSlide49.PNG

Smart phone app “Fishing guide”

130215e-gov&opendatafinalSlide50.PNG

Future e-Government model from best practices

130215e-gov&opendatafinalSlide51.PNG

CHALLENGES

130215e-gov&opendatafinalSlide52.PNG

Cabinet secretariat

130215e-gov&opendatafinalSlide53.PNG

METI Ministry of Economy, Trade and Industry

130215e-gov&opendatafinalSlide54.PNG

MIC Ministry of Internal Affairs and Communications

130215e-gov&opendatafinalSlide55.PNG

NPO & Group

130215e-gov&opendatafinalSlide56.PNG

LATEST PROJECT

130215e-gov&opendatafinalSlide57.PNG

Open data analysis drill for disaster management

https://www.youtube.com/watch?v=C5E1M3xMmFo

130215e-gov&opendatafinalSlide58.PNG

Combine data on crowed area with local voices

130215e-gov&opendatafinalSlide59.PNG

Image: how it works

130215e-gov&opendatafinalSlide60.PNG

But!! The Drill postponed by heavy snow

130215e-gov&opendatafinalSlide61.PNG

THANK YOU

130215e-gov&opendatafinalSlide62.PNG

PIES Title Slide

Slides

130205PIES final2Slide0.PNG

Background

130205PIES final2Slide1.PNG

Basic concept of PIES

130205PIES final2Slide2.PNG

Overview

130205PIES final2Slide3.PNG

Image of PIES vocabulary

130205PIES final2Slide4.PNG

Interoperability

130205PIES final2Slide5.PNG

Problems and issues

130205PIES final2Slide6.PNG

Similar project(Japanese Character set Project “IPAmj”

130205PIES final2Slide7.PNG

Schedule

130205PIES final2Slide8.png

Page statistics
7744 view(s) and 139 edit(s)
Social share
Share this page?

Tags

This page has no custom tags.
This page has no classifications.

Comments

You must to post a comment.

Attachments