Click here to register!
Difference between revisions of "Google Dataset Search Engine"
From energypedia
***** (***** | *****) (Created page with " = Introduction = Gathering and organizing as much information as possible, and easing the access for everybody around the world, has always been Google’s goal<ref name="Vi...") |
***** (***** | *****) m |
||
| (10 intermediate revisions by 2 users not shown) | |||
| Line 10: | Line 10: | ||
<br/> | <br/> | ||
| − | To better serve scientists and researchers, on September 5<sup>th</sup>, 2018, Google has launched a service called '''''Dataset Search''''', which is a search engine just for finding datasets on the internet<ref name="Lahoti, S. (2018). Google Launches a Dataset Search Engine for Finding Datasets on the Internet. Retrieved From: https://hub.packtpub.com/google-launches-a-dataset-search-engine-for-finding-datasets/">Lahoti, S. (2018). Google Launches a Dataset Search Engine for Finding Datasets on the Internet. Retrieved From: https://hub.packtpub.com/google-launches-a-dataset-search-engine-for-finding-datasets/</ref><ref name="Vincent, J. (2018). Google Launches New Search Engine to Help Scientists Find the Datasets They Need: Dataset Search Could Be a Scientist’s Best Friend. Retrieved From: https://www.theverge.com/2018/9/5/17822562/google-dataset-search-service-scholar-scientific-journal-open-data-access">Vincent, J. (2018). Google Launches New Search Engine to Help Scientists Find the Datasets They Need: Dataset Search Could Be a Scientist’s Best Friend. Retrieved From: https://www.theverge.com/2018/9/5/17822562/google-dataset-search-service-scholar-scientific-journal-open-data-access</ref>. This search engine will act as an additional search tool for scientific communities, along with the company’s '' | + | To better serve scientists and researchers, on September 5<sup>th</sup>, 2018, Google has launched a service called '''''<u>[https://toolbox.google.com/datasetsearch Dataset Search]</u>''''', which is a search engine just for finding datasets on the internet<ref name="Lahoti, S. (2018). Google Launches a Dataset Search Engine for Finding Datasets on the Internet. Retrieved From: https://hub.packtpub.com/google-launches-a-dataset-search-engine-for-finding-datasets/">Lahoti, S. (2018). Google Launches a Dataset Search Engine for Finding Datasets on the Internet. Retrieved From: https://hub.packtpub.com/google-launches-a-dataset-search-engine-for-finding-datasets/</ref><ref name="Vincent, J. (2018). Google Launches New Search Engine to Help Scientists Find the Datasets They Need: Dataset Search Could Be a Scientist’s Best Friend. Retrieved From: https://www.theverge.com/2018/9/5/17822562/google-dataset-search-service-scholar-scientific-journal-open-data-access">Vincent, J. (2018). Google Launches New Search Engine to Help Scientists Find the Datasets They Need: Dataset Search Could Be a Scientist’s Best Friend. Retrieved From: https://www.theverge.com/2018/9/5/17822562/google-dataset-search-service-scholar-scientific-journal-open-data-access</ref>. This search engine will act as an additional search tool for scientific communities, along with the company’s ''[https://scholar.google.de Google Scholar], which is the company’s most popular search engine for academic studies and reports<ref name="Lahoti, S. (2018). Google Launches a Dataset Search Engine for Finding Datasets on the Internet. Retrieved From: https://hub.packtpub.com/google-launches-a-dataset-search-engine-for-finding-datasets/">Lahoti, S. (2018). Google Launches a Dataset Search Engine for Finding Datasets on the Internet. Retrieved From: https://hub.packtpub.com/google-launches-a-dataset-search-engine-for-finding-datasets/</ref>.'' |
<br/> | <br/> | ||
| − | [[File:GD | + | [[File:GD 05.PNG|thumb|center|850px|alt=GD 05.PNG|link=https://toolbox.google.com/datasetsearch]] |
<br/> | <br/> | ||
| Line 24: | Line 24: | ||
<br/> | <br/> | ||
| − | Google Dataset Search will allow its users to search through enormous amount of datasets across tens of thousands of repositories on the web, whether they exist on a governmental database, public sources, publisher’s site, a digital library or an author’s personal web page<ref name="Lahoti, S. (2018). Google Launches a Dataset Search Engine for Finding Datasets on the Internet. Retrieved From: https://hub.packtpub.com/google-launches-a-dataset-search-engine-for-finding-datasets/">Lahoti, S. (2018). Google Launches a Dataset Search Engine for Finding Datasets on the Internet. Retrieved From: https://hub.packtpub.com/google-launches-a-dataset-search-engine-for-finding-datasets/</ref><ref name="Mehta, I. (2018). Google’s New Search Engine Reveals Public Datasets for Research and Journalism Projects. Retrieved From: https://thenextweb.com/google/2018/09/06/google-launches-dataset-search/">Mehta, I. (2018). Google’s New Search Engine Reveals Public Datasets for Research and Journalism Projects. Retrieved From: https://thenextweb.com/google/2018/09/06/google-launches-dataset-search/</ref>. It applies the usual Google’s approach and design for search, but to datasets published across the web<ref name="Mehta, I. (2018). Google’s New Search Engine Reveals Public Datasets for Research and Journalism Projects. Retrieved From: https://thenextweb.com/google/2018/09/06/google-launches-dataset-search/">Mehta, I. (2018). Google’s New Search Engine Reveals Public Datasets for Research and Journalism Projects. Retrieved From: https://thenextweb.com/google/2018/09/06/google-launches-dataset-search/</ref>. For an example: the searcher can use a typical research words “''''' | + | Google Dataset Search will allow its users to search through enormous amount of datasets across tens of thousands of repositories on the web, whether they exist on a governmental database, public sources, publisher’s site, a digital library or an author’s personal web page<ref name="Lahoti, S. (2018). Google Launches a Dataset Search Engine for Finding Datasets on the Internet. Retrieved From: https://hub.packtpub.com/google-launches-a-dataset-search-engine-for-finding-datasets/">Lahoti, S. (2018). Google Launches a Dataset Search Engine for Finding Datasets on the Internet. Retrieved From: https://hub.packtpub.com/google-launches-a-dataset-search-engine-for-finding-datasets/</ref><ref name="Mehta, I. (2018). Google’s New Search Engine Reveals Public Datasets for Research and Journalism Projects. Retrieved From: https://thenextweb.com/google/2018/09/06/google-launches-dataset-search/">Mehta, I. (2018). Google’s New Search Engine Reveals Public Datasets for Research and Journalism Projects. Retrieved From: https://thenextweb.com/google/2018/09/06/google-launches-dataset-search/</ref>. It applies the usual Google’s approach and design for search, but to datasets published across the web<ref name="Mehta, I. (2018). Google’s New Search Engine Reveals Public Datasets for Research and Journalism Projects. Retrieved From: https://thenextweb.com/google/2018/09/06/google-launches-dataset-search/">Mehta, I. (2018). Google’s New Search Engine Reveals Public Datasets for Research and Journalism Projects. Retrieved From: https://thenextweb.com/google/2018/09/06/google-launches-dataset-search/</ref>. For an example: the searcher can use a typical research words “'''''<span style="font-size: 13.6px">Solar photovoltaics deployment statistics</span>'''''” to look for statistics and reports on the deployment situation<ref name="Mehta, I. (2018). Google’s New Search Engine Reveals Public Datasets for Research and Journalism Projects. Retrieved From: https://thenextweb.com/google/2018/09/06/google-launches-dataset-search/">Mehta, I. (2018). Google’s New Search Engine Reveals Public Datasets for Research and Journalism Projects. Retrieved From: https://thenextweb.com/google/2018/09/06/google-launches-dataset-search/</ref>. |
<br/> | <br/> | ||
| − | [[File:GD | + | [[File:GD 06.PNG|thumb|center|850px|alt=GD 06.PNG|link=https://toolbox.google.com/datasetsearch]]<br/> |
| − | [[File:GD | + | [[File:GD 07.PNG|thumb|center|850px|alt=GD 07.PNG|link=https://toolbox.google.com/datasetsearch]]<br/> |
| − | + | The initial Dataset Search covers: environmental & social sciences, governmental data and datasets from news organizations, and is expected to expand to include more sources shortly<ref name="Lahoti, S. (2018). Google Launches a Dataset Search Engine for Finding Datasets on the Internet. Retrieved From: https://hub.packtpub.com/google-launches-a-dataset-search-engine-for-finding-datasets/">Lahoti, S. (2018). Google Launches a Dataset Search Engine for Finding Datasets on the Internet. Retrieved From: https://hub.packtpub.com/google-launches-a-dataset-search-engine-for-finding-datasets/</ref><ref name="Vincent, J. (2018). Google Launches New Search Engine to Help Scientists Find the Datasets They Need: Dataset Search Could Be a Scientist’s Best Friend. Retrieved From: https://www.theverge.com/2018/9/5/17822562/google-dataset-search-service-scholar-scientific-journal-open-data-access">Vincent, J. (2018). Google Launches New Search Engine to Help Scientists Find the Datasets They Need: Dataset Search Could Be a Scientist’s Best Friend. Retrieved From: https://www.theverge.com/2018/9/5/17822562/google-dataset-search-service-scholar-scientific-journal-open-data-access</ref>.<br/> | |
<br/> | <br/> | ||
| − | The | + | The tool already supports multiple languages, and will be able to support more languages soon, and it is also expected to be used by scientists, journalists, data geeks, and basically anyone who is using data behind a specific topic<ref name="Mehta, I. (2018). Google’s New Search Engine Reveals Public Datasets for Research and Journalism Projects. Retrieved From: https://thenextweb.com/google/2018/09/06/google-launches-dataset-search/">Mehta, I. (2018). Google’s New Search Engine Reveals Public Datasets for Research and Journalism Projects. Retrieved From: https://thenextweb.com/google/2018/09/06/google-launches-dataset-search/</ref><ref name="Schwarz, B. (2018). Google Dataset Search: A New Search Service to Find Data from Sciences, Government, Some News Organizations – Using Dataset Schema, You Can Mark Up Your Data to get it Included in the New Google Dataset Search Engine. Retrieved From: https://searchengineland.com/google-dataset-search-a-new-search-service-to-find-data-from-sciences-government-some-news-organizations-304968">Schwarz, B. (2018). Google Dataset Search: A New Search Service to Find Data from Sciences, Government, Some News Organizations – Using Dataset Schema, You Can Mark Up Your Data to get it Included in the New Google Dataset Search Engine. Retrieved From: https://searchengineland.com/google-dataset-search-a-new-search-service-to-find-data-from-sciences-government-some-news-organizations-304968</ref>. |
<br/> | <br/> | ||
| − | The tool | + | == Relevance for Renewable Energy Community == |
| + | |||
| + | The importance of this tool for the energy community is clear: | ||
| + | |||
| + | *you can easily allocate all available public datasets | ||
| + | *you have easy access to as many possible datasets as possible | ||
| + | *you can see which format the respecitve dataset it (e.g. XLS) | ||
| + | *you can detect reliable information by identifying the publisher (e.g. the respective department of a Government) | ||
| + | *you can access the most recent dataset, as it always displays the last update (e.g. Sept, 27 2018). | ||
| + | |||
| + | It is expected that more datasets will be provided in the future. | ||
| + | |||
| + | {| style="width:100%" cellspacing="1" cellpadding="1" border="1" | ||
| + | |- | ||
| + | | | ||
| + | '''Tip''': you can also search only for data from one publisher. e.g. the World Bank by searching on their site only. | ||
| + | |||
| + | site:worldbank.org energy | ||
| + | |||
| + | |} | ||
<br/> | <br/> | ||
| − | = Commentary = | + | = Commentary<br/> = |
Here are couple of comments from people either working on the project or working with it:<br/> | Here are couple of comments from people either working on the project or working with it:<br/> | ||
| Line 55: | Line 74: | ||
*“This type of search has long been the dream for many researchers in the open data and science communities.” Ed Kearns, chief data office at NOAA<ref name="Lahoti, S. (2018). Google Launches a Dataset Search Engine for Finding Datasets on the Internet. Retrieved From: https://hub.packtpub.com/google-launches-a-dataset-search-engine-for-finding-datasets/">Lahoti, S. (2018). Google Launches a Dataset Search Engine for Finding Datasets on the Internet. Retrieved From: https://hub.packtpub.com/google-launches-a-dataset-search-engine-for-finding-datasets/</ref>.<br/> | *“This type of search has long been the dream for many researchers in the open data and science communities.” Ed Kearns, chief data office at NOAA<ref name="Lahoti, S. (2018). Google Launches a Dataset Search Engine for Finding Datasets on the Internet. Retrieved From: https://hub.packtpub.com/google-launches-a-dataset-search-engine-for-finding-datasets/">Lahoti, S. (2018). Google Launches a Dataset Search Engine for Finding Datasets on the Internet. Retrieved From: https://hub.packtpub.com/google-launches-a-dataset-search-engine-for-finding-datasets/</ref>.<br/> | ||
| + | |||
| + | <br/> | ||
| + | |||
| + | = Further Information = | ||
| + | |||
| + | *<span style="font-size: 13.6px">[https://toolbox.google.com/datasetsearch https://toolbox.google.com/datasetsearch]</span><br/> | ||
| + | |||
| + | <br/> | ||
| + | |||
| + | = References = | ||
| + | |||
| + | <references /><br/> | ||
[[Category:Help]] | [[Category:Help]] | ||
[[Category:Research]] | [[Category:Research]] | ||
[[Category:Tools]] | [[Category:Tools]] | ||
Latest revision as of 13:13, 12 October 2018
Introduction
Gathering and organizing as much information as possible, and easing the access for everybody around the world, has always been Google’s goal[1].
This goal’s first target was the commercial web, yet, the company has recently changed its usual target, and has shifted a bit towards the scientific community[1].
To better serve scientists and researchers, on September 5th, 2018, Google has launched a service called Dataset Search, which is a search engine just for finding datasets on the internet[2][1]. This search engine will act as an additional search tool for scientific communities, along with the company’s Google Scholar, which is the company’s most popular search engine for academic studies and reports[2].
Google Dataset Search Engine
Researchers have usually relied on sources like: the World Bank, NASA, ProPublica, IEA, IRENA or other search engines, but this new tool should make their work much easier, as it is dedicated to help journalists and researchers to easily reach the available public data[3].
Google Dataset Search will allow its users to search through enormous amount of datasets across tens of thousands of repositories on the web, whether they exist on a governmental database, public sources, publisher’s site, a digital library or an author’s personal web page[2][3]. It applies the usual Google’s approach and design for search, but to datasets published across the web[3]. For an example: the searcher can use a typical research words “Solar photovoltaics deployment statistics” to look for statistics and reports on the deployment situation[3].
The initial Dataset Search covers: environmental & social sciences, governmental data and datasets from news organizations, and is expected to expand to include more sources shortly[2][1].
The tool already supports multiple languages, and will be able to support more languages soon, and it is also expected to be used by scientists, journalists, data geeks, and basically anyone who is using data behind a specific topic[3][4].
Relevance for Renewable Energy Community
The importance of this tool for the energy community is clear:
- you can easily allocate all available public datasets
- you have easy access to as many possible datasets as possible
- you can see which format the respecitve dataset it (e.g. XLS)
- you can detect reliable information by identifying the publisher (e.g. the respective department of a Government)
- you can access the most recent dataset, as it always displays the last update (e.g. Sept, 27 2018).
It is expected that more datasets will be provided in the future.
|
Tip: you can also search only for data from one publisher. e.g. the World Bank by searching on their site only. site:worldbank.org energy |
Commentary
Here are couple of comments from people either working on the project or working with it:
- “The aim is to unify the tens of thousands of different repositories for datasets online. We want to make the data discoverable, but keep it where it is.” Natasha Noy, a research scientist at Google AU who helped create Dataset Search[2].
- “This type of search has long been the dream for many researchers in the open data and science communities.” Ed Kearns, chief data office at NOAA[2].
Further Information
References
- ↑ 1.0 1.1 1.2 1.3 Vincent, J. (2018). Google Launches New Search Engine to Help Scientists Find the Datasets They Need: Dataset Search Could Be a Scientist’s Best Friend. Retrieved From: https://www.theverge.com/2018/9/5/17822562/google-dataset-search-service-scholar-scientific-journal-open-data-access
- ↑ 2.0 2.1 2.2 2.3 2.4 2.5 Lahoti, S. (2018). Google Launches a Dataset Search Engine for Finding Datasets on the Internet. Retrieved From: https://hub.packtpub.com/google-launches-a-dataset-search-engine-for-finding-datasets/
- ↑ 3.0 3.1 3.2 3.3 3.4 Mehta, I. (2018). Google’s New Search Engine Reveals Public Datasets for Research and Journalism Projects. Retrieved From: https://thenextweb.com/google/2018/09/06/google-launches-dataset-search/
- ↑ Schwarz, B. (2018). Google Dataset Search: A New Search Service to Find Data from Sciences, Government, Some News Organizations – Using Dataset Schema, You Can Mark Up Your Data to get it Included in the New Google Dataset Search Engine. Retrieved From: https://searchengineland.com/google-dataset-search-a-new-search-service-to-find-data-from-sciences-government-some-news-organizations-304968
