Table of contents
  1. Story
  2. Slides
    1. Slide 1 Title
    2. Slide 2 Preface 1
    3. Slide 3 Preface 2
    4. Slide 4 Preface 3
    5. Slide 5 Preface 4
    6. Slide 6 My Process
    7. Slide 7 Open DATA METI: WordPress & CKAN
    8. Slide 8 Open DATA METI: MindTouch
    9. Slide 9 Open DATA METI: Excel Spreadsheet 1 Knowledge Base
    10. Slide 10 Open DATA METI: Data Set List
    11. Slide 11 Open DATA METI: Excel Spreadsheet 2 Data Set List
    12. Slide 12 Open DATA METI: Comprehensive Energy Statistics
    13. Slide 13 Open DATA METI: Genral Energy Statistics (FY 2011)
    14. Slide 14 Open DATA METI: Source
    15. Slide 15 Open DATA METI: Link to Excel Spreadsheet
    16. Slide 16 Open DATA METI: Excel Spreadsheet
    17. Slide 17 Open DATA METI: Excel Spreadsheet in Spotfire
    18. Slide 18 Open DATA METI: Excel Spreadsheet 3 Data Sets Metadata
    19. Slide 19 Open DATA METI: Excel Spreadsheet 1-3 in Spotfire
    20. Slide 20 Open DATA METI: Excel Spreadsheet 4 Merged Data Sets
    21. Slide 21 Open DATA METI: Merged Data Sets in Spotfire
    22. Slide 22 Summary
  3. Spotfire Dashboard
  4. Research Notes
  5. Open DATA METI
    1. Introduction
    2. Ministry of Economy, Trade and Industry statistics
    3. White papers and reports
    4. About DATA METI
    5. Section
  6. Terms of use
    1. 1. Use of Service
    2. 2. For links
    3. 3. Handling of personal information
    4. 4. Handling of intellectual property rights
    5. 5. Disclaimer
    6. 6. Compensation to the Ministry of the art
    7. 7. Liaison notice to users
    8. 8. Response to Terms of Use violation
    9. 9. Other
  7. Privacy Policy
    1. 1. Basic concept
    2. 2. Range of information to be collected
    3. 3. Restriction of the use of information and provide the collected
    4. 4. Scope of application
  8. Notation of Credit
    1. When used directly without modification to duplicate copyrighted material that are licensed, please describe the following credit.
    2. When used to modify the works that are licensed, please describe the following credit.
    3. In addition, URL of the license is not to claim with a letter, and it can also be provided in such a way to put a hyperlink in the text portion of the "Creative Commons Attribution 2.1 License."
    4. "Other copyright holders" are as follows.
  9. For Partners leverage DATAMETI
    1. Partners for the application of leverage DATA METI
      1. Participation procedures
  10. Inquiry
  11. API
  12. The Action API
    1. Making an API Request
    2. API Versions
    3. Authentication and API Keys
    4. GET-able API Functions
    5. JSONP Support
    6. Action API Reference
  13. Tag
  14. Statistics
    1. Number of datasets
    2. Revision of the data set for each week
    3. Dataset Highest Rated
    4. Data set that has been edited the most
    5. Maximum group
    6. Top Tags
    7. The user who owns the data set most
  15. Revision
  16. Login Open DATA METI
  17. DATA METI
    1. Public forum IT Working Group data fusion
  18. Data
    1. Search the data set
    2. Data set list
    3. Group of data sets
      1. What is a group?
    4. Download Ranking Data
      1. Number of data set access
      2. Resource downloads
  19. Case Utilization
  20. Tool
    1. Open Data idea box
      1. Ideas and box
      2. Examples of past ideas box
      3. List of past posts are made ideas (excerpt)
      4. Screen image
  21. Inquiry
  22. Link
  23. NEXT

Open DATA METI

Last modified
Table of contents
  1. Story
  2. Slides
    1. Slide 1 Title
    2. Slide 2 Preface 1
    3. Slide 3 Preface 2
    4. Slide 4 Preface 3
    5. Slide 5 Preface 4
    6. Slide 6 My Process
    7. Slide 7 Open DATA METI: WordPress & CKAN
    8. Slide 8 Open DATA METI: MindTouch
    9. Slide 9 Open DATA METI: Excel Spreadsheet 1 Knowledge Base
    10. Slide 10 Open DATA METI: Data Set List
    11. Slide 11 Open DATA METI: Excel Spreadsheet 2 Data Set List
    12. Slide 12 Open DATA METI: Comprehensive Energy Statistics
    13. Slide 13 Open DATA METI: Genral Energy Statistics (FY 2011)
    14. Slide 14 Open DATA METI: Source
    15. Slide 15 Open DATA METI: Link to Excel Spreadsheet
    16. Slide 16 Open DATA METI: Excel Spreadsheet
    17. Slide 17 Open DATA METI: Excel Spreadsheet in Spotfire
    18. Slide 18 Open DATA METI: Excel Spreadsheet 3 Data Sets Metadata
    19. Slide 19 Open DATA METI: Excel Spreadsheet 1-3 in Spotfire
    20. Slide 20 Open DATA METI: Excel Spreadsheet 4 Merged Data Sets
    21. Slide 21 Open DATA METI: Merged Data Sets in Spotfire
    22. Slide 22 Summary
  3. Spotfire Dashboard
  4. Research Notes
  5. Open DATA METI
    1. Introduction
    2. Ministry of Economy, Trade and Industry statistics
    3. White papers and reports
    4. About DATA METI
    5. Section
  6. Terms of use
    1. 1. Use of Service
    2. 2. For links
    3. 3. Handling of personal information
    4. 4. Handling of intellectual property rights
    5. 5. Disclaimer
    6. 6. Compensation to the Ministry of the art
    7. 7. Liaison notice to users
    8. 8. Response to Terms of Use violation
    9. 9. Other
  7. Privacy Policy
    1. 1. Basic concept
    2. 2. Range of information to be collected
    3. 3. Restriction of the use of information and provide the collected
    4. 4. Scope of application
  8. Notation of Credit
    1. When used directly without modification to duplicate copyrighted material that are licensed, please describe the following credit.
    2. When used to modify the works that are licensed, please describe the following credit.
    3. In addition, URL of the license is not to claim with a letter, and it can also be provided in such a way to put a hyperlink in the text portion of the "Creative Commons Attribution 2.1 License."
    4. "Other copyright holders" are as follows.
  9. For Partners leverage DATAMETI
    1. Partners for the application of leverage DATA METI
      1. Participation procedures
  10. Inquiry
  11. API
  12. The Action API
    1. Making an API Request
    2. API Versions
    3. Authentication and API Keys
    4. GET-able API Functions
    5. JSONP Support
    6. Action API Reference
  13. Tag
  14. Statistics
    1. Number of datasets
    2. Revision of the data set for each week
    3. Dataset Highest Rated
    4. Data set that has been edited the most
    5. Maximum group
    6. Top Tags
    7. The user who owns the data set most
  15. Revision
  16. Login Open DATA METI
  17. DATA METI
    1. Public forum IT Working Group data fusion
  18. Data
    1. Search the data set
    2. Data set list
    3. Group of data sets
      1. What is a group?
    4. Download Ranking Data
      1. Number of data set access
      2. Resource downloads
  19. Case Utilization
  20. Tool
    1. Open Data idea box
      1. Ideas and box
      2. Examples of past ideas box
      3. List of past posts are made ideas (excerpt)
      4. Screen image
  21. Inquiry
  22. Link
  23. NEXT

  1. Story
  2. Slides
    1. Slide 1 Title
    2. Slide 2 Preface 1
    3. Slide 3 Preface 2
    4. Slide 4 Preface 3
    5. Slide 5 Preface 4
    6. Slide 6 My Process
    7. Slide 7 Open DATA METI: WordPress & CKAN
    8. Slide 8 Open DATA METI: MindTouch
    9. Slide 9 Open DATA METI: Excel Spreadsheet 1 Knowledge Base
    10. Slide 10 Open DATA METI: Data Set List
    11. Slide 11 Open DATA METI: Excel Spreadsheet 2 Data Set List
    12. Slide 12 Open DATA METI: Comprehensive Energy Statistics
    13. Slide 13 Open DATA METI: Genral Energy Statistics (FY 2011)
    14. Slide 14 Open DATA METI: Source
    15. Slide 15 Open DATA METI: Link to Excel Spreadsheet
    16. Slide 16 Open DATA METI: Excel Spreadsheet
    17. Slide 17 Open DATA METI: Excel Spreadsheet in Spotfire
    18. Slide 18 Open DATA METI: Excel Spreadsheet 3 Data Sets Metadata
    19. Slide 19 Open DATA METI: Excel Spreadsheet 1-3 in Spotfire
    20. Slide 20 Open DATA METI: Excel Spreadsheet 4 Merged Data Sets
    21. Slide 21 Open DATA METI: Merged Data Sets in Spotfire
    22. Slide 22 Summary
  3. Spotfire Dashboard
  4. Research Notes
  5. Open DATA METI
    1. Introduction
    2. Ministry of Economy, Trade and Industry statistics
    3. White papers and reports
    4. About DATA METI
    5. Section
  6. Terms of use
    1. 1. Use of Service
    2. 2. For links
    3. 3. Handling of personal information
    4. 4. Handling of intellectual property rights
    5. 5. Disclaimer
    6. 6. Compensation to the Ministry of the art
    7. 7. Liaison notice to users
    8. 8. Response to Terms of Use violation
    9. 9. Other
  7. Privacy Policy
    1. 1. Basic concept
    2. 2. Range of information to be collected
    3. 3. Restriction of the use of information and provide the collected
    4. 4. Scope of application
  8. Notation of Credit
    1. When used directly without modification to duplicate copyrighted material that are licensed, please describe the following credit.
    2. When used to modify the works that are licensed, please describe the following credit.
    3. In addition, URL of the license is not to claim with a letter, and it can also be provided in such a way to put a hyperlink in the text portion of the "Creative Commons Attribution 2.1 License."
    4. "Other copyright holders" are as follows.
  9. For Partners leverage DATAMETI
    1. Partners for the application of leverage DATA METI
      1. Participation procedures
  10. Inquiry
  11. API
  12. The Action API
    1. Making an API Request
    2. API Versions
    3. Authentication and API Keys
    4. GET-able API Functions
    5. JSONP Support
    6. Action API Reference
  13. Tag
  14. Statistics
    1. Number of datasets
    2. Revision of the data set for each week
    3. Dataset Highest Rated
    4. Data set that has been edited the most
    5. Maximum group
    6. Top Tags
    7. The user who owns the data set most
  15. Revision
  16. Login Open DATA METI
  17. DATA METI
    1. Public forum IT Working Group data fusion
  18. Data
    1. Search the data set
    2. Data set list
    3. Group of data sets
      1. What is a group?
    4. Download Ranking Data
      1. Number of data set access
      2. Resource downloads
  19. Case Utilization
  20. Tool
    1. Open Data idea box
      1. Ideas and box
      2. Examples of past ideas box
      3. List of past posts are made ideas (excerpt)
      4. Screen image
  21. Inquiry
  22. Link
  23. NEXT

Story

Slides

Open DATA METI as Big Data

I have been working to help the Japan METI (Ministry of Economy, Trade and Industry) start Open Government Data in Japan. Recently, they launced a new data portal site with WordPress and CKAN.

The reason for asking for my help was to benefit from my experience with US Government Handling of Open Government Data which was summaraized by Tomasz Janowski for the W3C eGov Special Interest Group recently as shown below.

TomaszJanowski03182013.png

I decided to audit the new METI data portal site and apply the latest big data concepts and technology as follows:

  • All the work with Data Catalogs does not really help with data integration.
  • Big Data Spells New Architecture.
  • Big Data is the new software.
  • New Digital Government Strategy is treating all content as data.
 
The first concept stems for a question I had recently about the W3C eGov Special Interest Group's work to standardize data catalogs: Does this deal with the data elements themselves in the data sets, so you can search for data elements that you want to integrate with other data elements and find their definitions (metadata) to know if they are the same or similar enough to be semantically integrated?
 
The excellent answer I got from John Erickson, Director, Web Science Operations, Tetherless World Constellation (RPI) was:
  • No. DCAT deals with the initial problems of where dataset catalogs and datasets themselves are from and what they contain. Loosely speaking, it does for catalogs and datasets what Dublin Core did for publications: it provides a succinct vocabulary that providers can rely on for describing their datasets, and consumers can rely on for finding. DCAT has already been used as the basis for the schema.org "datasets" extension as a way to make discovery of datasets easier using popular search engines.
  • Articulating the actual vocabularies used in published datasets is way beyond the scope of DCAT, in part because DCAT is not restricted to datasets published as linked data. Some work including http://healthdata.tw.rpi.edu are looking at ways to communicate standard vocabularies used in published linked data...

The second concept of Big Data Spells New Architecture says: "The data warehouse does what it does well and is not going to go anywhere. But it is not architected very well for the future. Our job, as IT, revolves entirely around one thing -- data integration”.

The third concept comes from Tim O'Reilly in articles about the importance of data to software development and our economy

The fourth concept comes from Dominic Sale, OMB CIO Staff's new Chief of Data Analytics & Reporting who said recently that the Digital Government Strategy is "treating all content as data."

My process for making the new METI WordPress and CKAN data portal site all big data was as follows:

  • Open DATA METI Web Site to MindTouch Knowledge Base to an Excel Spreadsheet
  • Open DATA METI Data Set List by File Type to an Excel Spreadsheet
  • Open DATA METI Data Sets by Metadata to an Excel Spreadsheet
  • Import the Above (3) and Selected Open DATA METI Data Sets Into Spotfire
  • Get Visualizations and Beginning of a Unified Big Data Architecture and Ecosystem for Big Data Integration

The detailed steps and results are provide in a series of tutorial slides below and a Spotfire dashboard.

Of particluar note is the cross-table fo the 9763 files by File Type (10 ) and Data Set List Name (19) which helps the data scientist to decide where next to work on semantic data integration and the data element level.

A summary of this work is as follows:

  • The Open DATA METI Data Catalog has been turned into data in spreadsheets and statistical visualizations in Spotfire.
  • This simplifies the complex WordPress & CKAN interface which requires lots of extra mouse clicks and provides no faceted search.
  • Google Chrome provides Japanese language translation of the metadata, but not of the data columns in the spreadsheets.
  • This process provides the beginning of a Unified Data Architecture and Ecosystem for Data Integration using the View Data function in Spotfire 5.
 
Now the Open DATA METI can be described: All Content As (and Is) Big Data!

Slides

Slides

Slide 1 Title

http://semanticommunity.info/
http://gov.aol.com/bloggers/brand-niemann/
http://semanticommunity.info/A_Japan_METI_Open_Data_Dashboard/Open_DATA_METI

BrandNiemann03152013Slide1.PNG

Slide 2 Preface 1

http://healthdata.tw.rpi.edu

BrandNiemann03152013Slide2.PNG

Slide 5 Preface 4

http://semanticommunity.info/Big_Data_Symposia#Speaker_Bio_for_Dominic_Sale

BrandNiemann03152013Slide5.PNG

Slide 6 My Process

BrandNiemann03152013Slide6.PNG

Slide 7 Open DATA METI: WordPress & CKAN

http://datameti.go.jp/

BrandNiemann03152013Slide7.PNG

Slide 8 Open DATA METI: MindTouch

http://semanticommunity.info/A_Japan_METI_Open_Data_Dashboard/Open_DATA_METI

BrandNiemann03152013Slide8.PNG

Slide 9 Open DATA METI: Excel Spreadsheet 1 Knowledge Base

http://semanticommunity.info/@api/deki/files/21577/METI2013.xlsx

BrandNiemann03152013Slide9.PNG

Slide 10 Open DATA METI: Data Set List

http://datameti.go.jp/data/

BrandNiemann03152013Slide10.PNG

Slide 11 Open DATA METI: Excel Spreadsheet 2 Data Set List

http://semanticommunity.info/@api/deki/files/21577/METI2013.xlsx

BrandNiemann03152013Slide11.PNG

Slide 12 Open DATA METI: Comprehensive Energy Statistics

http://datameti.go.jp/data/group/sta...s_sougouenergy

BrandNiemann03152013Slide12.PNG

Slide 13 Open DATA METI: Genral Energy Statistics (FY 2011)

http://datameti.go.jp/data/dataset/s...gouenergy_2011

BrandNiemann03152013Slide13.PNG

Slide 15 Open DATA METI: Link to Excel Spreadsheet

http://datameti.go.jp/data/dataset/s...3-65e081c6daab

BrandNiemann03152013Slide15.PNG

Slide 16 Open DATA METI: Excel Spreadsheet

http://www.enecho.meti.go.jp/info/st...1fysokuhou.xls

BrandNiemann03152013Slide16.PNG

Slide 17 Open DATA METI: Excel Spreadsheet in Spotfire

Web Player

BrandNiemann03152013Slide17.PNG

Slide 18 Open DATA METI: Excel Spreadsheet 3 Data Sets Metadata

http://semanticommunity.info/@api/deki/files/21577/METI2013.xlsx

BrandNiemann03152013Slide18.PNG

Slide 19 Open DATA METI: Excel Spreadsheet 1-3 in Spotfire

Web Player

BrandNiemann03152013Slide19.PNG

Slide 20 Open DATA METI: Excel Spreadsheet 4 Merged Data Sets

http://semanticommunity.info/@api/deki/files/21577/METI2013.xlsx

BrandNiemann03152013Slide20.PNG

Slide 21 Open DATA METI: Merged Data Sets in Spotfire

Web Player

BrandNiemann03152013Slide21.PNG

Slide 22 Summary

BrandNiemann03152013Slide22.PNG

Spotfire Dashboard

For Internet Explorer Users and Those Wanting Full Screen Display Use: Web Player Get Spotfire for iPad App

Error: Embedded data could not be displayed. Use Google Chrome


Research Notes

 

Open DATA METI

Source: http://datameti.go.jp/

 

 

The test site was established in the Ministry of Economy, Trade and Industry in order to practice this site is an open data (version β). You can get the various opinions from people companies that are interested in the use of data, NPO, such as individuals, on with going to the site user-friendly, even a little, he was friendly, such as personal information on this site, only the Ministry of Economy We believe you will be also be utilized to study the promotion of open data in government as a whole not. Therefore, as one of the mechanisms to get opinions and requests various Kara people in user, you and requests various opinions for, on this site, we have established the "Partners leverage DATA METI". For an overview and application of the "Partners leverage DATA METI" is this page as it will be, please come visit us are those who are interested.

In addition, I believe that the light of the comments that we receive, we will successively modify flexible. Therefore, the terms of use may also include, this site is subject to change without notice. For damage that occurs to everyone who influences and use of any other defect caused by this change, Please note that the Department shall not be liable in the art.

 

Terms of use

Source: http://datameti.go.jp/user-policy

(Hereinafter website., Which is developed in the following directory http://datameti.go.jp/,. Referred to as "Site") "(version β) Open DATA METI site" has been published regarding these Terms of Use on this page.

This site is engaged in providing information services to the Ministry of Economy, Trade and Industry (. Called "Ministry of the art" hereinafter) under the jurisdiction of (. Referred to as "Services").We ask that you according to this Agreement when you use our site. Also, I shall be deemed acceptance of the contents of this Agreement who have been with the use of the service. The contents of this Agreement, as it may, if necessary, are subject to change without notice, upon use of the service, please check the contents of the latest of these Terms of Use on this page.

1. Use of Service

Based on the strategy "Open Data e-government" (decision of the Strategic Headquarters for the Promotion of Information and Telecommunications Network Society degree Hidaka, July 04, 24, 2003), promote the development of an environment of public data subject to data retention own ministry in the art, the Ministry of In our opinion, the fact It will prepare the infrastructure is expanded business to proceed with a disclosure, the utilization of public data, we are to promote economic revitalization through open data. 
In this site, we are providing a service to advance this initiative. Through these services, I expect results similar to the following example.

  • You can specify the conditions of use of the information provided by the individual, the realization of rapid secondary use of information to be
  • By introducing the use case, the contribution to the creation of new businesses and the efficiency of the current business

2. For links

  1. Link to this site is free principle. However, it this is not the limit, such as if there is a note of the information in each link. In addition, if it is found that with content that may violate or violations of the laws and regulations laws and (2) what the content of the original site link would be contrary to public policy (1), we will refuse the link.
  2. When it is the setting of the link (you do not need permission or contact) Please indicate the fact that it is a link to our site.
  3. Please do not set this site as incorporated in any other website when you are configuring the link.

3. Handling of personal information

User name obtained from the Terms of Use of the service, e-mail address and other personal information will be handled in accordance with the "Privacy Policy" of this site is provided for separately.

4. Handling of intellectual property rights

By understanding the following issues concerning the information provided in this site is intended to respect the intellectual property rights of third parties, users of the service, for the handling of such information makes a conscious deliberate Please do.

  • Individual information contained on this website (text, photos, illustrations, etc.) are subject to copyright. In addition, as the editing work, has been the subject of copyright throughout the site.Copyright is protected by international copyright laws and treaties.
  • Except those that have Note, copyrighted work that exists in the (. Including the information listed) The contents of this site, 2.1 (http://creativecommons.org/licenses/ Creative Commons License It is licensed under the by/2.1/jp /). Terms of Use each of copyrighted material, please refer to "notation of credit" in this site is provided for separately.

5. Disclaimer

  1. The Ministry of the art, but we are on care of various information to be posted on this site, etc. safety usefulness, completeness or accuracy of its contents, it is not intended to guarantee any kind. Be part of the information about the Department's activities, the information contained on this website, it does not cover all of them also. It was services that were not available, even if the result of any occurs by action caused judgment and the user is made based on the information listed in the service, the Ministry of skill in the art to assume responsibility Please note no.
  2. Is information at the time published the last, published information on all the site, that information posted for all on this site, make alteration or deletion of such content and name, to stop the service without notice in advance there. The address of this site are subject to change without prior notice, including the home page. For damage that occurs to everyone who use effects or any other defects that affect the display, such as broken links generated by the change of address of this site deletes, and modification of information posted on this website, the Ministry offers shall not be liable Please note.
  3. For the damage caused to a user due to the fact that the service by This site has been stopped due to force majeure maintenance of this site, due to sabotage or third party virus other natural disasters power failure, fire, saving our responsibility I shall not take.
  4. For sites that are linked from this website (. Hereinafter referred to as the "Linked Sites"), the Ministry of skill in the art, it does not guarantee the accuracy of the information posted, and legality. we ask that you please deal with user's own responsibility In the unlikely event that there is a problem for every use of the linked site, that responsibility because it bears any Linked Site.

6. Compensation to the Ministry of the art

For all complaints and claims the use of the service by the user, the connection to the service, arising from or related to infringement of third party rights by the user or the user's violation of this Agreement, the cost and the users themselves shall be the responsibility, the Ministry of Company will not be held responsible. In addition, the occurrence of compensation, including the payment (the cost to the Ministry of the art in relation to responding to complaints and claims arising from or related to infringement of third party rights by the user or the user's violation of this Agreement. If you), the user is assumed to compensate for the costs.

7. Liaison notice to users

If it becomes necessary to contact, notify the user that provide e-mail addresses to the Ministry of the art, it is assumed that the contact notified by e-mail, in principle.

8. Response to Terms of Use violation

If you know of any such act in a manner that violates the Terms of Service, please contact e-gov@meti.go.jp.

9. Other

  1. Terms shall be interpreted and applied in accordance with the laws of Japan.
  2. Although we do not charge a fee at the moment with respect to use of the service, the future, the Ministry of In our opinion, there is a possibility that these services for a fee.
  3. If the user between the Ministry of our site, services, or any dispute regarding this Agreement shall be able to respond in good faith to ensure the mutual satisfactory resolution. In addition, the resolution is not made by the above-mentioned support, when obtaining a judicial decision, the court and the exclusive jurisdiction of the Tokyo District Court of Japan in the first instance.

Privacy Policy

Source: http://datameti.go.jp/privacy-policy

(Hereinafter website., Which is developed in the following directory http://datameti.go.jp/,. Referred to as "Site") "(version β) Open DATA METI site" giving consideration to the protection of your privacy, I have to define the privacy policy.

1. Basic concept

Upon operation of the Site, the Ministry of Economy, Trade and Industry, we have been giving consideration to the protection of the privacy of the user. We are doing the appropriate management based on the "Law on the Protection of Personal Information Held by Administrative Organs" personal information provided by the users also everyone.

2. Range of information to be collected

In this site, you will automatically get the information regarding Internet domain name query information, IP address, Site Search, browse our site to others. (In order to identify the user on the server side, the information is sent to the user's browser from a server and stored in the user's computer) Cookies, we are only used to improve the usability of the viewer. 
If such inquiries, e-mail address of the sender will be displayed to the recipient. 
When you get your personal information, and other on our site, it shall do so by lawful and fair means.

3. Restriction of the use of information and provide the collected

The information collected on this site, use the analysis and improvement for the smooth operation of our site, such as communication and delivery of information and answers to queries. As for the comments, we used as a reference for future policy planning. 
If there is a request for disclosure based on the law, if there is consent of the person, except if you have other special reasons, the information collected on this site will not provide to any third party.

4. Scope of application

This Privacy Policy applies only to the Site.

Notation of Credit

Source: http://datameti.go.jp/credits

(Hereinafter website., Which is developed in the following directory http://datameti.go.jp/,. Referred to as "Site") "(version β) Open DATA METI site" containing the contents of the information has been published ( . except those that have Note, copyrighted work that exists), the 2.1 (Creative Commons License http://creativecommons.org/licenses/by/2.1/jp/ licensed under the) are. Terms of Use each of copyrighted material, please see below.

When used directly without modification to duplicate copyrighted material that are licensed, please describe the following credit.

[Other copyright holders] [Title of a work that has been licensed, Ministry of Economy, Trade and Industry, 2.1 (Creative Commons License Http://Creativecommons.Org/licenses/by/2.1/Jp/ )

When used to modify the works that are licensed, please describe the following credit.

We use the following modification of this copyrighted material [such as database apps work. [Other copyright holders] [Title of a work that has been licensed, Ministry of Economy, Trade and Industry, 2.1 (Creative Commons License Http://Creativecommons.Org/licenses/by/2.1/Jp/ )

In addition, URL of the license is not to claim with a letter, and it can also be provided in such a way to put a hyperlink in the text portion of the "Creative Commons Attribution 2.1 License."

"Other copyright holders" are as follows.

Group name of the data set Name of the copyright holder
White Paper on Small and Medium Enterprises Small and Medium Enterprise Agency

For Partners leverage DATAMETI

Source: http://datameti.go.jp/partners

My Note: Need English translation of this graphic

  • You can get an opinion different users color, "Open DATA METI" site, we also consider that with going to the site user-friendly and more, we will leverage to promote open data for the entire government and the Ministry of Economic Affairs.
  • Therefore, as one of the mechanisms to collect opinions and requests from users, we will set up a "Partners leverage DATA METI".
  • Thank you to those who register to take advantage of Partners, I provide services such as contact-related events. In addition, we make suggestions for stories and opinions and take advantage of the individual, we will continue to reflect and operation of the site.

DATAMETI_Partners

Partners for the application of leverage DATA METI

If you would like to participate in the Partners leverage DATA METI, please procedure along the procedure "participation", have agreed on the following conditions.

  • Or comments that we receive, it will be considered as a reference on the initiative will be conducted DATA METI. In addition, by checking the contents, such as Open DATA METI published on the site, we receive feedback, etc. Sometimes you will be introduced externally.
  • About "Accepting or opinions" and "provision of information", you will be carried out through e-mail for the time being. Carried out through the e-mail address you registered when they are applying for participation in the exchange DATA METI Partners take advantage of this mail. Or comments that we receive by e-mail address registered, please acknowledge regardless of the actual sender, so we determined that feedback from subscribers.
  • Linking this will be a temporary condition at this time. Therefore, it may continue through the trial, add or modify conditions is performed. If you want to make changes you make to the participants seek approval again.

Participation procedures

Described above, please submit the application form by e-mail to the following matters e-gov@meti.go.jp.

  1. Name, organization name
  2. (. Mentions the name of the participating groups, if relevant organization. Described organization name, department, title, the name of the participating groups, if relevant personal, etc.) belong
  3. Contact (E-mail, phone number, HP)
  4. According to whether or not you want to expose to the subscriber list (listed. However "only one name, organization name", the list of individual cases. Negotiable if there is hope. Describe the organization name and title)

By checking the contents, we receive about membership request, we will send you the purport of approval.

Information Project Office, Commerce and Information Policy Bureau, Ministry of Economy, Trade and Industry 
TEL :03-3501-2964 
Mail E-govattometi.Go.Jp

API

Source: http://datameti.go.jp/data/api/1

{"version": 1}

The Action API

Source: http://docs.ckan.org/en/latest/api.html

CKAN’s Action API is a powerful, RPC-style API that exposes all of CKAN’s core features to API clients. All of a CKAN website’s core functionality (everything you can do with the web interface and more) can be used by external code that calls the CKAN API. For example, using the CKAN API your app can:

Making an API Request

To call the CKAN API, post a JSON dictionary in an HTTP POST request to one of CKAN’s API URLs. The parameters for the API function should be given in the JSON dictionary. CKAN will also return its response in a JSON dictionary.

One way to post a JSON dictionary to a URL is using the command-line HTTP client HTTPie. For example, to get a list of the names of all the datasets in the data-explorer group on demo.ckan.org, install HTTPie and then call the group_list API function by running this command in a terminal:

http http://demo.ckan.org/api/3/action/group_list id=data-explorer

The response from CKAN will look like this:

{
    "help": "...",
    "result": [
        "data-explorer",
        "department-of-ricky",
        "geo-examples",
        "geothermal-data",
        "reykjavik",
        "skeenawild-conservation-trust"
    ],
    "success": true
}

The response is a JSON dictionary with three keys:

  1. "sucess"true or false.

    The API aims to always return 200 OK as the status code of its HTTP response, whether there were errors with the request or not, so it’s important to always check the value of the"success" key in the response dictionary and (if success is False) check the value of the"error" key.

Note

If there are major formatting problems with a request to the API, CKAN may still return an HTTP response with a 409400 or 500 status code (in increasing order of severity). In future CKAN versions we intend to remove these responses, and instead send a 200 OK response and use the "success" and "error" items.

  1. "result": the returned result from the function you called. The type and value of the result depend on which function you called. In the case of the group_list function it’s a list of strings, the names of all the datasets that belong to the group.

    If there was an error responding to your request, the dictionary will contain an "error" key with details of the error instead of the "result" key. A response dictionary containing an error will look like this:

    {
        "help": "Creates a package",
        "success": false,
        "error": {
            "message": "Access denied",
            "__type": "Authorization Error"
            }
     }
    
  2. "help": the documentation string for the function you called.

The same HTTP request can be made using Python’s standard urllib2 module, with this Python code:

#!/usr/bin/env python
import urllib2
import urllib
import json
import pprint

# Use the json module to dump a dictionary to a string for posting.
data_string = urllib.quote(json.dumps({'id': 'data-explorer'}))

# Make the HTTP request.
response = urllib2.urlopen('http://demo.ckan.org/api/3/action/group_list',
        data_string)
assert response.code == 200

# Use the json module to load CKAN's response into a dictionary.
response_dict = json.loads(response.read())

# Check the contents of the response.
assert response_dict['success'] is True
result = response_dict['result']
pprint.pprint(result)

API Versions

The CKAN APIs are versioned. If you make a request to an API URL without a version number, CKAN will choose the latest version of the API:

http://demo.ckan.org/api/action/package_list

Alternatively, you can specify the desired API version number in the URL that you request:

http://demo.ckan.org/api/3/action/package_list

Version 3 is currently the only version of the Action API.

We recommend that you specify the API number in your requests, because this ensures that your API client will work across different sites running different version of CKAN (and will keep working on the same sites, when those sites upgrade to new versions of CKAN). Because the latest version of the API may change when a site is upgraded to a new version of CKAN, or may differ on different sites running different versions of CKAN, the result of an API request that doesn’t specify the API version number cannot be relied on.

Authentication and API Keys

Some API functions require authorization. The API uses the same authorization functions and configuration as the web interface, so if a user is authorized to do something in the web interface they’ll be authorized to do it via the API as well.

When calling an API function that requires authorization, you must authenticate yourself by providing your API key with your HTTP request. To find your API key, login to the CKAN site using its web interface and visit your user profile page.

To provide your API key in an HTTP request, include it in either an Authorization or X-CKAN-API-Key header. (The name of the HTTP header can be configured with theapikey_header_name option in your CKAN configuration file.)

For example, to ask whether or not you’re currently following the user markw on demo.ckan.org using HTTPie, run this command:

http http://demo.ckan.org/api/3/action/am_following_user id=markw Authorization:XXX

(Replacing XXX with your API key.)

Or, to get the list of activities from your user dashboard on demo.ckan.org, run this Python code:

request = urllib2.Request('http://demo.ckan.org/api/3/action/dashboard_activity_list')
request.add_header('Authorization', 'XXX')
response_dict = json.loads(urllib2.urlopen(request, '{}').read())

GET-able API Functions

Functions defined in ckan.logic.action.get can also be called with an HTTP GET request. For example, to get the list of datasets (packages) from demo.ckan.org, open this URL in your browser:

http://demo.ckan.org/api/3/action/package_list

Or, to search for datasets (packages) matching the search query spending, on demo.ckan.org, open this URL in your browser:

http://demo.ckan.org/api/3/action/package_search?q=spending

Tip

Browser plugins like JSONView for Firefox or Chrome will format and color CKAN’s JSON response nicely in your browser.

The search query is given as a URL parameter ?q=spending. Multiple URL parameters can be appended, separated by & characters, for example to get only the first 10 matching datasets open this URL:

http://demo.ckan.org/api/3/action/package_search?q=spending&rows=10

When an action requires a list of strings as the value of a parameter, the value can be sent by giving the parameter multiple times in the URL:

http://demo.ckan.org/api/3/action/term_translation_show?terms=russian&terms=romantic%20novel

JSONP Support

To cater for scripts from other sites that wish to access the API, the data can be returned in JSONP format, where the JSON data is ‘padded’ with a function call. The function is named in the ‘callback’ parameter. For example:

http://demo.ckan.org/api/3/action/package_show?id=adur_district_spending&callback=myfunction

Action API Reference

Functions for getting data from CKAN: ckan.logic.action.get.

Functions for adding data to CKAN: ckan.logic.action.create.

Functions for updating existing data in CKAN: ckan.logic.action.update.

Functions for deleting data from CKAN: ckan.logic.action.delete.

Functions for working with the CKAN DataStore: The DataStore API.

Tag

Source: http://datameti.go.jp/data/tag


0 result for the tag

Statistics

Source: http://datameti.go.jp/data/stats

Number of datasets

<canvas class="base" height="300" width="950"/><canvas class="overlay" height="300" width="950"/>
2012-Dec
2013-Jan
2013-Jan
2013-Feb
2013-Feb
2013-Mar
2013-Mar
2013-Apr
0
25
Fifty
75
Hundred
125
150
175

Revision of the data set for each week

<canvas class="base" height="300" width="950"/><canvas class="overlay" height="300" width="950"/>
2012-Dec
2013-Jan
2013-Jan
2013-Feb
2013-Feb
2013-Mar
2013-Mar
2013-Apr
0
25
Fifty
75
Hundred
125
150
 
 
All package revisions
 
New datasets

Dataset Highest Rated

No Ratings

The user who owns the data set most

htc_crl 171
adminuser One

Page last updated: Wed Mar 13 18:38:48 2013

Revision

Source: http://datameti.go.jp/data/revision

直近のシステムへの変更順に追う

リビジョン タイムスタンプ 作成者 エンティティ ログメッセージ
9b4c4efb-41c2-456a-adec-564a130e804d Mar 12, 2013, 05:45 htc_crl statistics_chuushoukihon_s_2010 リソースが編集されました。
976a387e-bdcc-4141-9c25-2e523ed0b374 Mar 12, 2013, 01:11 htc_crl statistics_kigyoukatsudou_2011 設定が編集されました。
1712b6ff-7b2b-4d3a-b433-fb6938cfb8d5 Feb 20, 2013, 17:33 htc_crl whitepaper_tsuushou_2008 REST API: オブジェクト更新: whitepaper_tsuushou_2008
44bd4728-525c-4f67-9d00-71bc6a3449bb Feb 20, 2013, 17:32 htc_crl whitepaper_tsuushou_2008 REST API: オブジェクト更新: whitepaper_tsuushou_2008
7b3a9a4d-ab93-40c7-99c6-a01e99a5ff9c Feb 20, 2013, 17:32 htc_crl whitepaper_tsuushou_2008 REST API: オブジェクト更新: whitepaper_tsuushou_2008
7c9f1b70-d4be-4094-a974-0ded598a8bff Feb 20, 2013, 17:32 htc_crl whitepaper_tsuushou_2008 REST API: オブジェクト更新: whitepaper_tsuushou_2008
3ae87962-788c-4ece-9e4c-3dfd544dc10d Feb 20, 2013, 17:31 htc_crl whitepaper_tsuushou_2008 REST API: オブジェクト更新: whitepaper_tsuushou_2008
1153060e-61f6-4749-9c9f-d046d47c2500 Feb 20, 2013, 17:31 htc_crl whitepaper_tsuushou_2008 REST API: オブジェクト更新: whitepaper_tsuushou_2008
51e2518f-cf04-4226-9796-0956c78af1d5 Feb 20, 2013, 17:31 htc_crl whitepaper_tsuushou_2008 REST API: オブジェクト更新: whitepaper_tsuushou_2008
306a953c-1dfc-4562-9487-cbb06787da01 Feb 20, 2013, 17:31 htc_crl whitepaper_tsuushou_2008 REST API: オブジェクト更新: whitepaper_tsuushou_2008
f054b129-b002-4638-91f2-00d420bd9a05 Feb 20, 2013, 17:30 htc_crl whitepaper_tsuushou_2008 REST API: オブジェクト更新: whitepaper_tsuushou_2008
67b0fda2-7f03-4c72-b062-0f03083422e6 Feb 20, 2013, 17:30 htc_crl whitepaper_tsuushou_2008 REST API: オブジェクト更新: whitepaper_tsuushou_2008
68b179c6-160f-4367-8037-2a87510f9888 Feb 20, 2013, 17:30 htc_crl whitepaper_tsuushou_2008 REST API: オブジェクト更新: whitepaper_tsuushou_2008
ca823181-4114-4d02-84fe-329f410d1443 Feb 20, 2013, 17:29 htc_crl whitepaper_tsuushou_2008 REST API: オブジェクト更新: whitepaper_tsuushou_2008
becd7350-c419-456d-804f-1ff8ce8f5759 Feb 20, 2013, 17:29 htc_crl whitepaper_tsuushou_2008 REST API: オブジェクト更新: whitepaper_tsuushou_2008
e0c8b586-4e7c-4e09-8e00-01287da0e353 Feb 20, 2013, 17:29 htc_crl whitepaper_tsuushou_2008 REST API: オブジェクト更新: whitepaper_tsuushou_2008
7c582ca7-4183-46a0-97c2-ecaa6fc762ad Feb 20, 2013, 17:29 htc_crl whitepaper_tsuushou_2008 REST API: オブジェクト更新: whitepaper_tsuushou_2008
10cccb4a-c7db-4fbb-abf6-0a6b6fd6f300 Feb 20, 2013, 17:28 htc_crl whitepaper_tsuushou_2008 REST API: オブジェクト更新: whitepaper_tsuushou_2008
5eff45c2-69bc-480b-936b-ff137c66455b Feb 20, 2013, 17:28 htc_crl whitepaper_tsuushou_2008 REST API: オブジェクト更新: whitepaper_tsuushou_2008
62bdbc54-42a0-4528-8a45-207b2b650527 Feb 20, 2013, 17:28 htc_crl whitepaper_tsuushou_2008 REST API: オブジェクト更新: whitepaper_tsuushou_2008

Login Open DATA METI

Source: http://datameti.go.jp/data/user/logi...ata/ckan-admin

DATA METI

Source: http://datameti.go.jp/datameti

My Note: Need English translation of this graphic

Trimmed the social infrastructure to expand the business to promote the development of an environment of public data to the target data holdings (including the independent administrative institution under the jurisdiction), together with promoting public fact, it was utilization of public data itself Ministry of Economy, Trade and Industry You can go, I will promote economic revitalization through open data.

Overall picture of the concept DATA METI (draft)

Public forum IT Working Group data fusion

Description - Data Working Group public

August 30, Heisei 24 First round     Handout Part 1
Heisei 24 April '10 2nd     Handout Part 2
November 29, Heisei 24 3rd     Handout 3rd   machine-readable file of some
January 28, 2013 4th     Handout 4th

Data

Source: http://datameti.go.jp/data/

Search the data set

Group of data sets

Source:http://datameti.go.jp/data/group

Case Utilization

My Note: No page

Open Data idea box

My Note: Need English translation of this graphic

Open data IDEABOX

Ideas and box

  • Electronic bulletin board with voting function. It will consolidate the opinions that can be gathered from the participants.
  • Can aggregate opinions extraction and ideas popular, many people agree, are utilized such as collecting ideas for e-government, the Cabinet Secretariat, Ministry of Economy, Trade and Industry, the Ministry of Education, Culture, Sports, Science, etc. Tourism Agency in the past are.

Examples of past ideas box

Name Period Theme
Ministry of Economy, Trade and Industry e- H21.10/14 ~ 11/14 E-Government
Ministry of Economy, Trade and Industry H22 2/23 ~ 3/15 IT policy
Decentralization vacation H22 6/22 ~ 7/12 Decentralized get vacation

List of past posts are made ideas (excerpt)

  • Clarity of the home page for national and local governments
  • Insufficient recognition of security measures. You should be more PR
  • We should enhance assistance to small and medium-sized enterprises more
  • You should work more to save energy in the office with the IT
  • We should be able to also get a certificate of residence from the net
  • For 24 hours, and the required certificates should be made available in convenience stores and home
  • "Visualization" of their information that is submitted to the country

Such as

Screen image

Screen image

Inquiry

Source: http://datameti.go.jp/contact

My Note: Same as before

Information Project Office, Commerce and Information Policy Bureau, Ministry of Economy, Trade and Industry 
TEL :03-3501-2964 
: Mail E-govattometi.Go.Jp

NEXT

Page statistics
8834 view(s) and 16 edit(s)
Social share
Share this page?

Tags

This page has no custom tags.
This page has no classifications.

Comments

You must to post a comment.

Attachments