Can big data deliver on its promise?

Did you know that, according to the UN Global Pulse, more data was created in 2011 than in the whole of human history, or at least, since the invention of the alphabet?

Technological and social innovations are resulting in huge flows of new data every day. This proliferation of so-called “big data” has the potential to change the way information is collected and used to inform policymaking.

New sources of data are increasingly providing real-time information to analysts and policy-makers. For example, it is now possible to collect price data on a wide range of goods and services with smartphones, and then calculate a daily price index. Similarly, job offers posted online provide a new source for analysing labour market trends, while data on Internet financial transactions and sales are increasingly used to forecast world output. At the same time, social networks such as Facebook and Twitter have already revolutionised the way policymakers interact with civil society. Governments use these networks both to push their messages out and to pull information in that may influence the design and targeting of policies as people place more of their personal information on social networking sites.

International organisations are getting involved too, the creation of UN Global Pulse being a case in point. The OECD has also been harnessing the potential of big data. Collecting statistics and understanding trends are the daily bread of our organisation, and we have built innovative, interactive tools to draw in more and better information from the public. This, in turn, feeds into improving the policy recommendations we give to governments. The OECD Better Life Index is a good example of this. Launched in 2011, it is a user-friendly web application that members of the public can use to compare the quality of life in different countries and to develop their own indexes based on their tastes and preferences. They can then share their indexes far and wide, including with us at the OECD. Since 2008, the OECD has also been employing its Wikigender and Wikiprogress platforms in the area of gender equality and societal progress to engage in, and facilitate, policy dialogue with governments, civil society and citizens in all the countries in the world.

In OECD countries, national statistics offices are beginning to use big data to improve the timeliness and cost-effectiveness of their statistical production, too.

But big data does not automatically mean bigger and better information, and an increasingly important function of national statistics offices in the future will be to help users separate high quality statistical information from low quality data coming from all kinds of new sources.

There are other challenges too. One is Internet privacy, which is at risk of being undermined by relentless hunting for greater and more detailed information. And another is finding innovative ways to communicate and present the stories that the flood of new data generates. These are all challenges the OECD is addressing, so that, like the alphabet, the age of big data brings clear benefits to policymakers and citizens alike.

Visit www.oecd.org/statistics and www.oecdbetterlifeindex.org

O’Reilly, Marie, (2012), “Interview with Robert Kirkpatrick, Director of UN Global Pulse, on the Value of Big Data”, 5 November, available at www.theglobalobservatory.org

©OECD Observer No 293 Q4 November 2012




Economic data

GDP : +0.5%, Q4 2014
Employment rate: 65.9%, Q4 2014
Annual inflation : 0.57% Feb 2015
Trade : -3.0% exp, -3.7 imp, Q4 2014
Unemployment : 7.022% Feb 2015
More moderate expansion ahead? Composite leading indicators
Updated: 23 Apr 2015

E-Newsletter

Stay up-to-date with the latest news from the OECD by signing up for our e-newsletter :

Twitter feed

Suscribe now

<b>Subscribe now!</b>

To receive your exclusive print editions delivered to you directly


Online edition
Previous editions

Don't miss

  • Today, after three years of drought, California is in the midst of a full-blown political and environmental crisis, with restrictions imposed across the state, reports the Financial Times.
  • Why is the gap between rich and poor growing despite rises in GDP? Do benefits help? Does aid work? (The Guardian)
  • Lack of water holding back Asian growth In Asia, the world’s most dynamic region with the fastest economic growth, 75% of countries face serious water shortages.
  • ADB water
  • Greek finance minister Yanis Varoufakis expressed its scepticism towards the Eurozone’s institutions and gave ideas for ways forward. "Greece must become reformable again", Yanis Varoufakis said.
  • Business brief: Israel's water
  • #OECD360: Your country in figures.
  • How to ensure transparency in public procurement? Read Cobus de Swardt's article on OECD Insights.
  • Asia to maintain a strong 6.3% growth rate in 2015 and 2016, according to the Asian Development Bank
  • After three decades of extraordinary economic development, China is shifting to a slower and more sustainable growth path, according to the OECD's latest Economic Survey of China.
  • In pursuit of the American Dream
  • Iceland's strong recovery stems from the good use of its natural resources, the energy sector and tourism according to Peter Dohlman, IMF Mission Chief for Iceland.
  • cyclone
  • Government representatives and experts from around the world are gathering in Japan this week to develop a post-2015 framework for global disaster risk reduction. The World Bank and the Global Facility for Disaster Reduction and Recovery (GFDRR) will share expertise at the conference.
  • Switzerland’s recent moves towards greater tax transparency were welcomed by the Global Forum on Transparency and Exchange of Information for Tax Purposes, based at the OECD, as a boost to international efforts to end tax evasion. Work will continue with Switzerland, notably on implementation, in 2015.
  • Help bridge the gap between business integrity policies & practices:participate in this new OECD survey by clicking on the image.
  • What can we do to promote better literacy skills for all? Read Andreas Schleicher's latest blog on oecdeducationtoday.
  • pisa
  • Secretary General Angel Gurría describes the Programme for International Student Assessment (PISA) as a useful tool to enhance educational systems but states that improving a country's ranking should not be a goal per se. Article in Spanish by El País.
  • [VIDEO] Although many countries have made great progress in narrowing gender gaps in education, new challenges are looming.
  • 5 things you might not know about the state of Amazonas. The World Bank identifies the main colossal challenges Brazil's biggest state is facing.
  • Gender mainstreaming: young French lady working in an engine assembly plant. Women and men in the same boat when it comes to job insecurity. © Raphaël Helle / Signatures / La France VUE D'ICI
  • The Asian Development Bank together with the International Labour Organization challenge the concept of women's work in Asia and the Pacific.
  • Visit the OECD Gender Data Portal. Selected indicators shedding light on gender inequalities in education, employment and entrepreneurship.
  • The 5th Anti-corruption conference for G20 governments and business in Istanbul on 6 March will address how all businesses can play their part in contributing to growth and investment, and can operate with clean hands in a safe environment.
  • Success story. Discover the story of this young Ethiopian woman who launched a successful business in the footwear industry and became a UN Goodwill Ambassador for Entrepreneurship.
  • Transports in Asia. The Asian Development Bank advocates sustainable transport in a continent where vehicle ownership is perceived as a sign of social success.
  • Vote for your favourite photograph! This World Bank #EachDayISee photo contest aims to display visual stories from all over the world through which people express what they would like to see changed and improved.
  • Why is investment so low in the euro area? This short IMF blog post gives you an insight into the causes of the euro-zone's drastic decline in investment.
  • Have your say! The UN wants to know what matters most to you: pick six global issues in the list and send it to the United Nations.
  • Tim Harcourt Video
  • G20 and Australia: Bestselling economist Tim Harcourt speaks to the BBC about how Australia has gone from "Down Under to Down Wonder".
  • Clear air and healthy lungs: how to better tackle air pollution. From New Delhi to Accra, millions of people breathe polluted air. A new report examines the World Bank’s experience working to improve air quality.

Most Popular Articles

Poll

What issue are you most concerned about in 2015?

Euro crisis
Unemployment
Global warming
International conflict
Other

OECD Insights Blog

NOTE: All signed articles in the OECD Observer express the opinions of the authors
and do not necessarily represent the official views of OECD member countries.

All rights reserved. OECD 2015