Philadelphia Eagles' Jay Ajayi celebrates after scoring a touchdown during the second half of an NFL football game against the Atlanta Falcons on Sept. 6, 2018, in Philadelphia.

Philadelphia Eagles' Jay Ajayi celebrates after scoring a touchdown during the second half of an NFL football game against the Atlanta Falcons on Sept. 6, 2018, in Philadelphia. Michael Perez/AP

Metrics Are for Playmakers

Despite continuous attention, the use of metrics in government has declined, not improved, over the past decade.

The General Accountability Office reconfirmed a pervasive management problem in its new report in the Managing for Results series. The title defines the problem: “Governmentwide Actions Needed to Improve Agencies' Use of Performance Information in Decision Making.” This is not a new theme for GAO but apparently their past recommendations have had minimal impact. Despite what seems to be continuous attention, the use of metrics has declined, not improved, over the past decade.

As recently as 2016, a column on the Federal News Radio website focused on efforts by the Performance Improvement Council “to bring together tools and people to take better advantage of technology and data” and to “start to think about putting real-time performance data in the hands of federal managers in more of a more customizable and user-friendly ways?” Creating “opportunities to use performance data, especially for program managers” was described as “really the sweet spot.”

Those quotes are damning.  Metrics have been required since 1993 when the Government Performance and Results Act required agencies to develop performance plans with measurable goals. In 1997, John Koskinen, then the Deputy Director for Management in the Office of Management and Budget, testified that experience under GPRA “confirmed that virtually every activity done by government can be measured in some manner.” But agencies are still working “to bring together tools and people” and only now starting “to think about putting real-time performance data in the hands of federal managers.” And the worst is that agencies are still working to create “opportunities to use performance data.”  The column’s headline referred to the use of metrics as “a compliance exercise.”

For anyone who has worked in business that is eye-opening. In successful companies, metrics have for decades been the basis for decision making. In manufacturing and sales, new data are reported daily.  Financial data have been central to business management for centuries. In the 1980s quality metrics opened the door to the empowerment of frontline workers.

The quality movement exemplified the use of metrics at its best. As the work day unfolded, new data was posted and decisions made by frontline workers to improve results. Quality for a time was a religion. Frontline workers were responsible for results. That prompted articles like, “Listen to Your Frontline Employees.”  Later there were articles like “How to Engage the Front Line in Process Improvement.” In healthcare there were articles like, “Redesigning the Care Team: The Critical Role of Frontline Workers and Models for Success.”  

Government is like a football game. Games are won or lost on the field by frontline workers. But regardless of how well they play, there are spectators who feel free to criticize. There are also observers high up in a booth, away from the field, who compile metrics. Coaches spend time game planning but once a game begins the best make adjustments and provide feedback to help players improve.  

It’s Not the Numbers

Metrics document the past and are central to improving performance. That involves far more than compliance—change is essential for improved results. The numbers have little value unless they influence work day decisions. Too often performance data are generated, reported to agency leaders, included in budget proposals or posted on scoreboards but then not used in managing performance. This has been a documented problem at all levels of government.  

Another football analogy is the importance of the run-pass-option play in the success of my Philadelphia Eagles. The quarterback has discretion in running the play. That works when there is mutual trust.  Managers need similar discretion and the trust to make day to day operational decisions.

Two core issues stand out in comparing the GAO methodology with the survey used in the Census Bureau’s “Management in America” study. Both ask how metrics are used and rely on responses by managers.  

The most important difference is the purpose of the Management in America study—to understand the impact of management practices, including the use of metrics, on an organization’s performance. In the Census survey, the phrase “key performance indicators” is used in several questions but that phrase is not used by GAO. The research highlighted the practices that are linked to better results. The same practices have proven to be important in global studies.

A second difference in the comparison is reflected in the report’s references to who uses the data. The GAO report repeatedly refers to senior leaders or agency leaders (as in “the use of performance information by senior leaders”). That’s a common thread in columns or reports on metrics and evidence-based decision making in government.

In contrast, the Census study includes several questions asking about the involvement of non-managers—the playmakers: their role in using data, rewarding their performance with bonuses, and the impact of performance on their careers (i.e., promotions, reassignment and dismissal).

The Census questions also look at how frequently key indicators are reviewed by managers and non-managers. The survey options include monthly, weekly, daily and hourly in addition to annual and quarterly. At lower levels weekly meetings are common.

Agencies should look to the city of Baltimore as a model. The mayor created an office, CitiStat, in 1999 to track and manage performance. Support for the office has waned at times but today “there are regular performance management sessions between the Mayor’s Office, the CitiStatSMART team and department leaders using data analysis to discuss performance, identify problems, diagnose causes and direct resources to solve problems.”  

Key people from the Bureau of the Budget and Management Research, Human Resources and Information technology attend the meetings. Apparently, Baltimore has knocked down the silos.

Corporate leaders hold similar meetings, typically monthly, to discuss developments and modify plans to improve performance. Business executives know they need to have answers to resolve problems. They have significant rewards riding on achieving or exceeding planned results.

Those meetings are led by chief executive officers. The intensity of the meetings has been discussed in business media reports. The individuals who reach the executive ranks know what to expect. Investors demand improved results. Similar discussions occur at every level.  

The Barrier: Fixed Mindsets

When people work in a static environment for an extended period, they develop behavioral habits and a disposition to interpret and respond to new ideas or suggestions as unnecessary or unwarranted. When the work group is stable, their attitudes and assumptions are shared by co-workers. The common beliefs and attitudes are effectively the culture.  

Large organizations do not have a uniform culture, but if there is one trait in common across government it’s at least passive resistance to change. For successful change, thousands of employees will need to accept the argument for change. For that they will need to understand how planned changes will better serve their agency’s mission along with how it will affect their careers. Revised goals and behavioral changes should be reinforced with financial and nonfinancial rewards. That would be true in the private sector. New skills may be needed as well.

Important also, according to Harvard’s Robert Behn, is to plan on incremental, “doable” goals. Then those responsible can celebrate small wins that build commitment for raising the bar.

The track record shows clearly that increased investments in technology or in developing new metrics is not the answer. That‘s been tried for two decades. It’s also clear that the solution is not additional legislation.  The essential changes come under the reform umbrella but the real problem is the culture and that is not directly related to the changes proposed in the president’s management agenda.

X
This website uses cookies to enhance user experience and to analyze performance and traffic on our website. We also share information about your use of our site with our social media, advertising and analytics partners. Learn More / Do Not Sell My Personal Information
Accept Cookies
X
Cookie Preferences Cookie List

Do Not Sell My Personal Information

When you visit our website, we store cookies on your browser to collect information. The information collected might relate to you, your preferences or your device, and is mostly used to make the site work as you expect it to and to provide a more personalized web experience. However, you can choose not to allow certain types of cookies, which may impact your experience of the site and the services we are able to offer. Click on the different category headings to find out more and change our default settings according to your preference. You cannot opt-out of our First Party Strictly Necessary Cookies as they are deployed in order to ensure the proper functioning of our website (such as prompting the cookie banner and remembering your settings, to log into your account, to redirect you when you log out, etc.). For more information about the First and Third Party Cookies used please follow this link.

Allow All Cookies

Manage Consent Preferences

Strictly Necessary Cookies - Always Active

We do not allow you to opt-out of our certain cookies, as they are necessary to ensure the proper functioning of our website (such as prompting our cookie banner and remembering your privacy choices) and/or to monitor site performance. These cookies are not used in a way that constitutes a “sale” of your data under the CCPA. You can set your browser to block or alert you about these cookies, but some parts of the site will not work as intended if you do so. You can usually find these settings in the Options or Preferences menu of your browser. Visit www.allaboutcookies.org to learn more.

Sale of Personal Data, Targeting & Social Media Cookies

Under the California Consumer Privacy Act, you have the right to opt-out of the sale of your personal information to third parties. These cookies collect information for analytics and to personalize your experience with targeted ads. You may exercise your right to opt out of the sale of personal information by using this toggle switch. If you opt out we will not be able to offer you personalised ads and will not hand over your personal information to any third parties. Additionally, you may contact our legal department for further clarification about your rights as a California consumer by using this Exercise My Rights link

If you have enabled privacy controls on your browser (such as a plugin), we have to take that as a valid request to opt-out. Therefore we would not be able to track your activity through the web. This may affect our ability to personalize ads according to your preferences.

Targeting cookies may be set through our site by our advertising partners. They may be used by those companies to build a profile of your interests and show you relevant adverts on other sites. They do not store directly personal information, but are based on uniquely identifying your browser and internet device. If you do not allow these cookies, you will experience less targeted advertising.

Social media cookies are set by a range of social media services that we have added to the site to enable you to share our content with your friends and networks. They are capable of tracking your browser across other sites and building up a profile of your interests. This may impact the content and messages you see on other websites you visit. If you do not allow these cookies you may not be able to use or see these sharing tools.

If you want to opt out of all of our lead reports and lists, please submit a privacy request at our Do Not Sell page.

Save Settings
Cookie Preferences Cookie List

Cookie List

A cookie is a small piece of data (text file) that a website – when visited by a user – asks your browser to store on your device in order to remember information about you, such as your language preference or login information. Those cookies are set by us and called first-party cookies. We also use third-party cookies – which are cookies from a domain different than the domain of the website you are visiting – for our advertising and marketing efforts. More specifically, we use cookies and other tracking technologies for the following purposes:

Strictly Necessary Cookies

We do not allow you to opt-out of our certain cookies, as they are necessary to ensure the proper functioning of our website (such as prompting our cookie banner and remembering your privacy choices) and/or to monitor site performance. These cookies are not used in a way that constitutes a “sale” of your data under the CCPA. You can set your browser to block or alert you about these cookies, but some parts of the site will not work as intended if you do so. You can usually find these settings in the Options or Preferences menu of your browser. Visit www.allaboutcookies.org to learn more.

Functional Cookies

We do not allow you to opt-out of our certain cookies, as they are necessary to ensure the proper functioning of our website (such as prompting our cookie banner and remembering your privacy choices) and/or to monitor site performance. These cookies are not used in a way that constitutes a “sale” of your data under the CCPA. You can set your browser to block or alert you about these cookies, but some parts of the site will not work as intended if you do so. You can usually find these settings in the Options or Preferences menu of your browser. Visit www.allaboutcookies.org to learn more.

Performance Cookies

We do not allow you to opt-out of our certain cookies, as they are necessary to ensure the proper functioning of our website (such as prompting our cookie banner and remembering your privacy choices) and/or to monitor site performance. These cookies are not used in a way that constitutes a “sale” of your data under the CCPA. You can set your browser to block or alert you about these cookies, but some parts of the site will not work as intended if you do so. You can usually find these settings in the Options or Preferences menu of your browser. Visit www.allaboutcookies.org to learn more.

Sale of Personal Data

We also use cookies to personalize your experience on our websites, including by determining the most relevant content and advertisements to show you, and to monitor site traffic and performance, so that we may improve our websites and your experience. You may opt out of our use of such cookies (and the associated “sale” of your Personal Information) by using this toggle switch. You will still see some advertising, regardless of your selection. Because we do not track you across different devices, browsers and GEMG properties, your selection will take effect only on this browser, this device and this website.

Social Media Cookies

We also use cookies to personalize your experience on our websites, including by determining the most relevant content and advertisements to show you, and to monitor site traffic and performance, so that we may improve our websites and your experience. You may opt out of our use of such cookies (and the associated “sale” of your Personal Information) by using this toggle switch. You will still see some advertising, regardless of your selection. Because we do not track you across different devices, browsers and GEMG properties, your selection will take effect only on this browser, this device and this website.

Targeting Cookies

We also use cookies to personalize your experience on our websites, including by determining the most relevant content and advertisements to show you, and to monitor site traffic and performance, so that we may improve our websites and your experience. You may opt out of our use of such cookies (and the associated “sale” of your Personal Information) by using this toggle switch. You will still see some advertising, regardless of your selection. Because we do not track you across different devices, browsers and GEMG properties, your selection will take effect only on this browser, this device and this website.