Why Big Data is a Big Deal for Government Leaders

A new study shows how real-time analysis is informing decision-making.

Professor Alfred Ho, at the University of Kansas, recently surveyed 65 mid-size and large cities to learn what is going on, on the frontline, with the use of big data. He found that it has made it possible to “change the time span of a decision-making cycle by allowing real-time analysis of data to instantly inform decision-making.” This decision-making occurs in areas as diverse as program management, strategic planning, budgeting, performance reporting, and citizen engagement.

So just what is big data?  According to Ho: “Big data refers to the use of a massive amount of data to conduct analyses so that the data patterns and relationships can be used for classification, clustering, anomaly detection, prediction and other needs in decision making.”  Information sources increasingly include mobile devices, digital cameras, RFID tags, and embedded sensors.

Ho says that while the sources are important, the key is how these data are collected, organized, analyzed and used. He outlines a two-part framework detailing both the data cycle and the decision-making cycle. He writes: “The framework for big data initiatives challenges the departmental silos of data ownership and processing so that a more integrated and holistic perspective is used to gain new insights.” In addition: “There should be two-way communication between the data cycle and the decision-making cycle.” This helps ensure that policymakers’ priorities inform the priorities of the data and analytics team.

Natural Repositories of Data

Cities are already repositories of rich amounts of data that can be potentially integrated and analyzed for policy and program management purposes. These include data from public safety, education, health and social services, environment and energy, culture and recreation, and community and business development. This includes both structured data (e.g., financial and tax transactions) and unstructured data (e.g., recorded sounds from gun shots, videos of pedestrian movement patterns, and social media data that assess citizen sentiments during an emergency situation). Based on these repositories, Ho notes: “One of the fundamental building blocks of a big data system in local government is the organization’s ability to collect and integrate many forms of data from multiple sources.”

Ho says that “user patterns can provide useful information about what services the public wants most, who wants the services, and where and when those services are used or needed.” He found that a number of local governments are using website traffic data to identify public priorities and concerns. Albuquerque, Dallas and Nashville examine patterns of how citizens use municipal websites and then use the analyses to inform departments about which services are most popular. Other cities, such as Kansas City, puts these kinds of results on their public website so citizens can also see use patterns.

Cities have an affinity for mobile phone users. For example, Boston residents use a phone app to measure road quality and can send real-time data to the city about needs for specific street fixes and to plan longer-term investments. And New York, Los Angeles, Seattle and other cities have mobile apps that allow users to check the schedules of subway trains and buses.  Detroit has an app that allows users to report maintenance issues for water main breaks, potholes, damaged street signs, etc.

“Among the 65 cities examined in this report,” Ho writes, “49 have some form of data analytics initiatives or projects, 30 have established a multi-departmental team structure to do strategic planning for these data initiatives, and 28 have worked with Code for America to launch some pilot analytics programs.”

He found that 75 percent of cities in the survey reported having some form of initiative around the use of data analytics. Most were led by the cities’ IT departments, but in some cities, their initiatives were led out of the mayor’s office or via existing performance management units. Almost a quarter of the 65 cities had designated chief data officers to lead their initiatives. More than half of the cities with active initiatives had established multi-departmental coordinating committees. Interestingly, more than half of the cities with active initiatives also partnered with Code for America to jumpstart their initiatives.

How Cities Are Using Big Data in Decision-Making 

In the course of his research, Ho identified a series of cases where cities told him they were using big data in making operational decisions:

  • Chicago developed partnerships with universities, non-profits, foundations, state and federal agencies, and other local governments. “It has used analytics to examine citizen complaints from its 311 center and various services at the neighborhood level . . . It has also deployed predictive analytics to analyze resident complaints of rodent problems over 12 years, and it found that rodent problems are significantly related to trash overflow and cases of food poisoning in restaurants. This prompted the city in 2015 to deploy special sanitation teams more strategically and cost- effectively.”

  • Kansas City “has partnered with different university researchers to analyze crime data, nuisance complaint data, quarterly resident survey data, and census population and housing data.” This has helped local officials “understand how local resident perceptions of public safety and quality of life are related to service outcomes” and other city initiatives. These insights, in turn, help improve the planning and delivery of city services.

  • Los Angeles is a proponent of CompStat, a data-intensive crime-tracking program first pioneered in New York City. It has since adapted the “Stat” model to apply the use of big data in other initiatives, such as its “Clean Streets Initiative,” which uses multiple sources of data to develop a “street-by-street cleanliness assessment system.” These data are used to more effectively deploy resources by the city’s Bureau of Sanitation.

Based on these and other cases, Ho observes that most cities’ analytics initiatives are organized on a project by project basis. One way cities first engaged in the use of analytics was by tapping into issues that affect quality of life in a city, such as illegal dumping, abandoned houses, potholes. The key was that, while these were specific issues, many required multi-departmental collaborations to address them effectively.

Developing a Larger Vision 

Ho concludes that: “Big Data initiatives provide a new platform for policymakers, key stakeholders, and individual citizens to use data to understand these problems more holistically.” He says that these data can lead to dialogs that cut across school district, city, county, business, nonprofit sector boundaries. But, in the longer term, he sees that: “Cities need to develop a larger vision of Big Data and see data analytics as part of a smart city movement, not just as data management and statistical programming.” To this end, his report offers 10 recommendations to city political and career leaders based on the promising practices that he observed during his survey and interviews. These recommendations can help those interested in launching big data initiatives as well as help those with existing initiatives to create that broader vision that Ho offers.

X
This website uses cookies to enhance user experience and to analyze performance and traffic on our website. We also share information about your use of our site with our social media, advertising and analytics partners. Learn More / Do Not Sell My Personal Information
Accept Cookies
X
Cookie Preferences Cookie List

Do Not Sell My Personal Information

When you visit our website, we store cookies on your browser to collect information. The information collected might relate to you, your preferences or your device, and is mostly used to make the site work as you expect it to and to provide a more personalized web experience. However, you can choose not to allow certain types of cookies, which may impact your experience of the site and the services we are able to offer. Click on the different category headings to find out more and change our default settings according to your preference. You cannot opt-out of our First Party Strictly Necessary Cookies as they are deployed in order to ensure the proper functioning of our website (such as prompting the cookie banner and remembering your settings, to log into your account, to redirect you when you log out, etc.). For more information about the First and Third Party Cookies used please follow this link.

Allow All Cookies

Manage Consent Preferences

Strictly Necessary Cookies - Always Active

We do not allow you to opt-out of our certain cookies, as they are necessary to ensure the proper functioning of our website (such as prompting our cookie banner and remembering your privacy choices) and/or to monitor site performance. These cookies are not used in a way that constitutes a “sale” of your data under the CCPA. You can set your browser to block or alert you about these cookies, but some parts of the site will not work as intended if you do so. You can usually find these settings in the Options or Preferences menu of your browser. Visit www.allaboutcookies.org to learn more.

Sale of Personal Data, Targeting & Social Media Cookies

Under the California Consumer Privacy Act, you have the right to opt-out of the sale of your personal information to third parties. These cookies collect information for analytics and to personalize your experience with targeted ads. You may exercise your right to opt out of the sale of personal information by using this toggle switch. If you opt out we will not be able to offer you personalised ads and will not hand over your personal information to any third parties. Additionally, you may contact our legal department for further clarification about your rights as a California consumer by using this Exercise My Rights link

If you have enabled privacy controls on your browser (such as a plugin), we have to take that as a valid request to opt-out. Therefore we would not be able to track your activity through the web. This may affect our ability to personalize ads according to your preferences.

Targeting cookies may be set through our site by our advertising partners. They may be used by those companies to build a profile of your interests and show you relevant adverts on other sites. They do not store directly personal information, but are based on uniquely identifying your browser and internet device. If you do not allow these cookies, you will experience less targeted advertising.

Social media cookies are set by a range of social media services that we have added to the site to enable you to share our content with your friends and networks. They are capable of tracking your browser across other sites and building up a profile of your interests. This may impact the content and messages you see on other websites you visit. If you do not allow these cookies you may not be able to use or see these sharing tools.

If you want to opt out of all of our lead reports and lists, please submit a privacy request at our Do Not Sell page.

Save Settings
Cookie Preferences Cookie List

Cookie List

A cookie is a small piece of data (text file) that a website – when visited by a user – asks your browser to store on your device in order to remember information about you, such as your language preference or login information. Those cookies are set by us and called first-party cookies. We also use third-party cookies – which are cookies from a domain different than the domain of the website you are visiting – for our advertising and marketing efforts. More specifically, we use cookies and other tracking technologies for the following purposes:

Strictly Necessary Cookies

We do not allow you to opt-out of our certain cookies, as they are necessary to ensure the proper functioning of our website (such as prompting our cookie banner and remembering your privacy choices) and/or to monitor site performance. These cookies are not used in a way that constitutes a “sale” of your data under the CCPA. You can set your browser to block or alert you about these cookies, but some parts of the site will not work as intended if you do so. You can usually find these settings in the Options or Preferences menu of your browser. Visit www.allaboutcookies.org to learn more.

Functional Cookies

We do not allow you to opt-out of our certain cookies, as they are necessary to ensure the proper functioning of our website (such as prompting our cookie banner and remembering your privacy choices) and/or to monitor site performance. These cookies are not used in a way that constitutes a “sale” of your data under the CCPA. You can set your browser to block or alert you about these cookies, but some parts of the site will not work as intended if you do so. You can usually find these settings in the Options or Preferences menu of your browser. Visit www.allaboutcookies.org to learn more.

Performance Cookies

We do not allow you to opt-out of our certain cookies, as they are necessary to ensure the proper functioning of our website (such as prompting our cookie banner and remembering your privacy choices) and/or to monitor site performance. These cookies are not used in a way that constitutes a “sale” of your data under the CCPA. You can set your browser to block or alert you about these cookies, but some parts of the site will not work as intended if you do so. You can usually find these settings in the Options or Preferences menu of your browser. Visit www.allaboutcookies.org to learn more.

Sale of Personal Data

We also use cookies to personalize your experience on our websites, including by determining the most relevant content and advertisements to show you, and to monitor site traffic and performance, so that we may improve our websites and your experience. You may opt out of our use of such cookies (and the associated “sale” of your Personal Information) by using this toggle switch. You will still see some advertising, regardless of your selection. Because we do not track you across different devices, browsers and GEMG properties, your selection will take effect only on this browser, this device and this website.

Social Media Cookies

We also use cookies to personalize your experience on our websites, including by determining the most relevant content and advertisements to show you, and to monitor site traffic and performance, so that we may improve our websites and your experience. You may opt out of our use of such cookies (and the associated “sale” of your Personal Information) by using this toggle switch. You will still see some advertising, regardless of your selection. Because we do not track you across different devices, browsers and GEMG properties, your selection will take effect only on this browser, this device and this website.

Targeting Cookies

We also use cookies to personalize your experience on our websites, including by determining the most relevant content and advertisements to show you, and to monitor site traffic and performance, so that we may improve our websites and your experience. You may opt out of our use of such cookies (and the associated “sale” of your Personal Information) by using this toggle switch. You will still see some advertising, regardless of your selection. Because we do not track you across different devices, browsers and GEMG properties, your selection will take effect only on this browser, this device and this website.