Promising Practices Promising PracticesPromising Practices
A forum for government's best ideas and most innovative leaders.

Be Prepared: Big Data Is Not a Passing Fad


In the next few years, nearly all government agencies will grapple with how to integrate their dispa­rate data sources, build analytical capacities and move toward a data-driven decision-making environment. Big data is increasing in importance for the public sector, and big data programs are expected to become more prominent in the near future.  Through the use of big data, ana­lytics now holds great promise for increasing the efficiency of operations and increasing citizen engagement.

A new report from the IBM Center for the Business of Government, “Realizing the Promise of Big Data: Implementing Big Data Projects,” provides a clear and useful introduction to the concept of big data, which is receiving increasing attention as a term, but also lacks a commonly understood definition. “Big data is an evolving concept that refers to the growth of data and how it is used to optimize business processes, create customer value and miti­gate risks,” Kevin Desouza of Arizona State University writes in the report, which describes the differences in the use of big data in the public and private sectors.

The report includes descriptions of how big data is being used in federal, state and local govern­ment. Examples include the Internal Revenue Service, the state of Massachusetts, and the New York City Business Integrity Commission.

Desouza conducted inter­views with chief information officers across the United States at the federal, state and local levels to better understand the implementation challenges their organizations face as they undertake big data projects. Here are 10 key findings from his interviews:

  1. Public agencies are in the early days of their big data efforts.
  2. Many CIOs fight the perception that big data is a passing fad.
  3. Most CIOs are now primarily dealing with the issue of managing large volumes of data, integrating data across database systems and building an analytical capacity to mine data.
  4. CIOs report that some big data projects are now focused on streamlining business processes.
  5. CIOs do not anticipate significant investments in technology.
  6. CIOs report a need to bolster their human capital, including their analytical capability.
  7. CIOs are now exploring approaches to data governance.
  8. CIOs do not recommend IT units as owners of big data projects.
  9. CIOs believe that collaborative leadership is crucial for the success of big data projects and recommend the creation of working groups to oversee projects.
  10. CIOs are becoming champions of analytics and evidence-driven decision-making.

Big data is a new frontier for the public sector and has captured the attention of public manag­ers across the globe. Agencies realize that their datasets represent critical resources that need to be managed and leveraged. Public sector use of big data and analytics is wide-ranging. Some organizations have no experience with big data, while others have taken on small to moderate-sized projects. Drawing on the CIO interviews, the report details the three key steps public man­agers should consider as they embark on big data projects -- planning, execution and implementation.

The report continues the IBM Center’s interest in the concepts of big data and analytics. In cooperation with the Partnership for Public Service, the IBM Center for The Business of Government recently issued its third report on analytics: From Data to Decisions III: Lessons from Early Analytics ProgramThe use of analytics in agency program management and decision-making relies on big data, and these reports provide a roadmap for federal leaders as they continue their quest to better use data that they collect on an ongoing basis.

(Image via takasu/

Close [ x ] More from GovExec

Thank you for subscribing to newsletters from
We think these reports might interest you:

  • Sponsored by G Suite

    Cross-Agency Teamwork, Anytime and Anywhere

    Dan McCrae, director of IT service delivery division, National Oceanic and Atmospheric Administration (NOAA)

  • Data-Centric Security vs. Database-Level Security

    Database-level encryption had its origins in the 1990s and early 2000s in response to very basic risks which largely revolved around the theft of servers, backup tapes and other physical-layer assets. As noted in Verizon’s 2014, Data Breach Investigations Report (DBIR)1, threats today are far more advanced and dangerous.

  • Sponsored by One Identity

    One Nation Under Guard: Securing User Identities Across State and Local Government

    In 2016, the government can expect even more sophisticated threats on the horizon, making it all the more imperative that agencies enforce proper identity and access management (IAM) practices. In order to better measure the current state of IAM at the state and local level, Government Business Council (GBC) conducted an in-depth research study of state and local employees.

  • Sponsored by Aquilent

    The Next Federal Evolution of Cloud

    This GBC report explains the evolution of cloud computing in federal government, and provides an outlook for the future of the cloud in government IT.

  • Sponsored by LTC Partners, administrators of the Federal Long Term Care Insurance Program

    Approaching the Brink of Federal Retirement

    Approximately 10,000 baby boomers are reaching retirement age per day, and a growing number of federal employees are preparing themselves for the next chapter of their lives. Learn how to tackle the challenges that today's workforce faces in laying the groundwork for a smooth and secure retirement.

  • Sponsored by Hewlett Packard Enterprise

    Cyber Defense 101: Arming the Next Generation of Government Employees

    Read this issue brief to learn about the sector's most potent challenges in the new cyber landscape and how government organizations are building a robust, threat-aware infrastructure

  • Sponsored by Aquilent

    GBC Issue Brief: Cultivating Digital Services in the Federal Landscape

    Read this GBC issue brief to learn more about the current state of digital services in the government, and how key players are pushing enhancements towards a user-centric approach.


When you download a report, your information may be shared with the underwriters of that document.