Trump Budget’s Blessing of Program Evidence Could Cut Two Ways

Program evaluation specialists welcome effort but some worry it could simply be used to justify cuts.

The Trump administration’s fiscal 2018 budget released on Tuesday couples calls for sizable spending cuts with language encouraging agencies to engage in evidence-based evaluation of programs.

That discipline—embraced by the Obama administration and the subject of a new statutorily created  study commission—has bipartisan backing. It is designed to rely more heavily on continuous evaluation of objective data from multiple sources to measure a program’s effectiveness and outcomes, while relying less on “input” measures such as spending levels and numbers of people participating in a program.  

But some specialists fear that when applied alongside a shrink-the-government political agenda, the process might lead to distortions.

In a section titled “Building and Using Evidence to Improve Government Effectiveness,” the Trump budget expanded on a shorter version released in March and recommended that centralized agency evaluation offices play an “impor­tant role in an evidence infrastructure that can develop and sustain agency capacity to build and use evidence.”

It noted that a recent Government Accountability Office report found that “federal agencies with a centralized evaluation authority reported greater evaluation coverage of their performance goals and were more likely to use evaluation results in decision making.”

One example provided was the Education Department’s “signature tiered evidence program” called the Education Innovation and Research grant program for “private school choice.” Trump is requesting $370 million for that program, with $250 million reserved for building evidence. As another example, the administration “is requesting that Congress give the government’s disability programs authority to mandate participation in demonstration projects. With this author­ity the administration proposes to conduct an aggressive set of rigorous experiments to improve the labor force par­ticipation of people with disabilities.”

Overall, the budget encouraged agencies to adopt a “learning agenda, in which they collaboratively identify the critical ques­tions that, when answered, will help their programs to be more effective, and to plan to answer those questions using the most appropriate tools.” That should produce “questions that re­flect the priorities and needs of administration and agency leadership, policy and program offices, pro­gram partners at state and local levels, researchers” and other practitioners, the budget said.

The Trump team’s effort to build on the movement for evidence-based policy “is worth celebrating,” said Robert Shea, an Office of Management and Budget performance specialist during the George W. Bush administration and now a principal for public sector at Grant Thornton LLP.  “To ensure we build on past efforts to use evidence in our oversight, management, and budgeting of programs will take the concerted efforts of officials across all agencies and branches of government,” he told Government Executive.

Shelley Metzenbaum, a data and performance official at OMB under Obama, agreed that the Trump team’s sentiment is “sound. The question is: how will this administration translate those words into practice?” she wrote in an email. “Will agencies be supported in their efforts not just to strengthen their and their delivery partners' measurement, analytic, and evaluation capacity, but also to use data to set priorities, find ‘bright spots,’ test hypotheses, test to see if what works well in one place can be replicated in others, and promote broader adoption of increasingly effective and cost-effective practices? Will agencies be able and encouraged to share current and historic data, trends, and evaluation findings in open and easily accessed ways, or will efforts to generate the data needed for strong evidence-based decisions be squashed?”

Metzenbaum wondered whether the administration will ignore “robust evidence” that, for example, boosting Internal Revenue Service taxpayer compliance efforts can make the tax system fairer. “My fear is that claims of evidence without supporting credible documentation will be used primarily to justify program cuts, not to improve the effectiveness, efficiency, and understanding of government operations,” she said.

The thrust of Trump’s budget, said Patrick Lester, director of the nonprofit Social Innovation Research Center in Annapolis, Md., who writes frequently on program evidence for Government Executive, appears to be “drawing on evidence to justify cuts.” He said he would like to see a debate over budget increases and decreases in which evidence plays a role. “But rather than seeing evidence drive policy making in a nice and rational way, we are in danger of letting evidence be driven by politics,” he added. 

“At the end of the day, politics is about politics, and it’s not surprising that the administration might be cherry-picking evidence to justify its proposed cuts” in such programs as Medicaid, teacher quality, college aid and international food aid, Lester said. He added that narrower legislation advancing evidence-based reviews often passes quietly if no one makes a political issue of it.

He said he expects the administration to continue its consideration of reinstating the George W. Bush administration’s Program Assessment Rating Tool.

The Trump budget’s call for agencies to recommend efficiencies comes at a time when agencies are designating new program management officers under a law signed by President Obama late last year and designed, not simply to cut, but to reduce waste and improve performance.

One of that bill’s key backers, Mark Langley, president and CEO of the nonprofit Project Management Institute, told Government Executive:  “To the extent the administration seeks to promote the critical assessment of programs before they are formally undertaken to anticipate challenges, identify solutions and clearly establish their strategic value, we favor the effort. If the evidence-based approach is designed and implemented in a way that builds upon strong implementation of legislation such as the Program Management Improvement and Accountability Act, we believe Americans will benefit from more efficient investment of their tax dollars.”

X
This website uses cookies to enhance user experience and to analyze performance and traffic on our website. We also share information about your use of our site with our social media, advertising and analytics partners. Learn More / Do Not Sell My Personal Information
Accept Cookies
X
Cookie Preferences Cookie List

Do Not Sell My Personal Information

When you visit our website, we store cookies on your browser to collect information. The information collected might relate to you, your preferences or your device, and is mostly used to make the site work as you expect it to and to provide a more personalized web experience. However, you can choose not to allow certain types of cookies, which may impact your experience of the site and the services we are able to offer. Click on the different category headings to find out more and change our default settings according to your preference. You cannot opt-out of our First Party Strictly Necessary Cookies as they are deployed in order to ensure the proper functioning of our website (such as prompting the cookie banner and remembering your settings, to log into your account, to redirect you when you log out, etc.). For more information about the First and Third Party Cookies used please follow this link.

Allow All Cookies

Manage Consent Preferences

Strictly Necessary Cookies - Always Active

We do not allow you to opt-out of our certain cookies, as they are necessary to ensure the proper functioning of our website (such as prompting our cookie banner and remembering your privacy choices) and/or to monitor site performance. These cookies are not used in a way that constitutes a “sale” of your data under the CCPA. You can set your browser to block or alert you about these cookies, but some parts of the site will not work as intended if you do so. You can usually find these settings in the Options or Preferences menu of your browser. Visit www.allaboutcookies.org to learn more.

Sale of Personal Data, Targeting & Social Media Cookies

Under the California Consumer Privacy Act, you have the right to opt-out of the sale of your personal information to third parties. These cookies collect information for analytics and to personalize your experience with targeted ads. You may exercise your right to opt out of the sale of personal information by using this toggle switch. If you opt out we will not be able to offer you personalised ads and will not hand over your personal information to any third parties. Additionally, you may contact our legal department for further clarification about your rights as a California consumer by using this Exercise My Rights link

If you have enabled privacy controls on your browser (such as a plugin), we have to take that as a valid request to opt-out. Therefore we would not be able to track your activity through the web. This may affect our ability to personalize ads according to your preferences.

Targeting cookies may be set through our site by our advertising partners. They may be used by those companies to build a profile of your interests and show you relevant adverts on other sites. They do not store directly personal information, but are based on uniquely identifying your browser and internet device. If you do not allow these cookies, you will experience less targeted advertising.

Social media cookies are set by a range of social media services that we have added to the site to enable you to share our content with your friends and networks. They are capable of tracking your browser across other sites and building up a profile of your interests. This may impact the content and messages you see on other websites you visit. If you do not allow these cookies you may not be able to use or see these sharing tools.

If you want to opt out of all of our lead reports and lists, please submit a privacy request at our Do Not Sell page.

Save Settings
Cookie Preferences Cookie List

Cookie List

A cookie is a small piece of data (text file) that a website – when visited by a user – asks your browser to store on your device in order to remember information about you, such as your language preference or login information. Those cookies are set by us and called first-party cookies. We also use third-party cookies – which are cookies from a domain different than the domain of the website you are visiting – for our advertising and marketing efforts. More specifically, we use cookies and other tracking technologies for the following purposes:

Strictly Necessary Cookies

We do not allow you to opt-out of our certain cookies, as they are necessary to ensure the proper functioning of our website (such as prompting our cookie banner and remembering your privacy choices) and/or to monitor site performance. These cookies are not used in a way that constitutes a “sale” of your data under the CCPA. You can set your browser to block or alert you about these cookies, but some parts of the site will not work as intended if you do so. You can usually find these settings in the Options or Preferences menu of your browser. Visit www.allaboutcookies.org to learn more.

Functional Cookies

We do not allow you to opt-out of our certain cookies, as they are necessary to ensure the proper functioning of our website (such as prompting our cookie banner and remembering your privacy choices) and/or to monitor site performance. These cookies are not used in a way that constitutes a “sale” of your data under the CCPA. You can set your browser to block or alert you about these cookies, but some parts of the site will not work as intended if you do so. You can usually find these settings in the Options or Preferences menu of your browser. Visit www.allaboutcookies.org to learn more.

Performance Cookies

We do not allow you to opt-out of our certain cookies, as they are necessary to ensure the proper functioning of our website (such as prompting our cookie banner and remembering your privacy choices) and/or to monitor site performance. These cookies are not used in a way that constitutes a “sale” of your data under the CCPA. You can set your browser to block or alert you about these cookies, but some parts of the site will not work as intended if you do so. You can usually find these settings in the Options or Preferences menu of your browser. Visit www.allaboutcookies.org to learn more.

Sale of Personal Data

We also use cookies to personalize your experience on our websites, including by determining the most relevant content and advertisements to show you, and to monitor site traffic and performance, so that we may improve our websites and your experience. You may opt out of our use of such cookies (and the associated “sale” of your Personal Information) by using this toggle switch. You will still see some advertising, regardless of your selection. Because we do not track you across different devices, browsers and GEMG properties, your selection will take effect only on this browser, this device and this website.

Social Media Cookies

We also use cookies to personalize your experience on our websites, including by determining the most relevant content and advertisements to show you, and to monitor site traffic and performance, so that we may improve our websites and your experience. You may opt out of our use of such cookies (and the associated “sale” of your Personal Information) by using this toggle switch. You will still see some advertising, regardless of your selection. Because we do not track you across different devices, browsers and GEMG properties, your selection will take effect only on this browser, this device and this website.

Targeting Cookies

We also use cookies to personalize your experience on our websites, including by determining the most relevant content and advertisements to show you, and to monitor site traffic and performance, so that we may improve our websites and your experience. You may opt out of our use of such cookies (and the associated “sale” of your Personal Information) by using this toggle switch. You will still see some advertising, regardless of your selection. Because we do not track you across different devices, browsers and GEMG properties, your selection will take effect only on this browser, this device and this website.