Panel finds performance-based contracts implemented poorly

A review of performance-based contracts at 10 agencies found the acquisition strategy was used poorly or not at all in more than half the cases studied, lending support to a federal acquisition advisory panel's recommendation that governmentwide quotas for such contracts be dropped.

Laura Auletta, designated federal officer for the Services Acquisition Reform Act Advisory Committee, reported Thursday to the panel on data gathered to inform its recommendations on the use of performance-based acquisition strategies.

The panel in March requested documents on 80 contracts or task orders from 10 agencies, based on a random selection of high-value transactions labeled as performance-based in the Federal Procurement Data System. Auletta said the panel has received 48 valid responses to date, and found that 38 percent of those contracts correctly applied performance-based acquisition methodologies while 23 percent included some aspects of the strategy but showed serious flaws in its application, and 40 percent were completely without performance-based characteristics.

Four of the reporting agencies indicated that requested contracts, which had been labeled as performance-based in FPDS, had been mislabeled. In some cases, agencies withdrew the performance-based status of those contracts and declined to provide information on them to the panel; those were counted among the 40 percent of noncompliant contracts.

In other cases, agencies asked that they be permitted to substitute a different contract for the one requested but the panel did not acquiesce, Auletta said, and analysis showed the requested contract to be non-performance-based.

All of the transactions that were examined had been counted toward an Office of Management and Budget quota for 40 percent of agencies' contract dollars to be in performance-based acquisitions.

Of those reported as seriously flawed, Auletta said most were honest attempts at implementing the strategy that displayed a poor understanding by the agency of how to use it. She said common problems were inability to define appropriate performance standards and metrics to assess contractor performance, failure to link those metrics to desired contract outcomes and confusion in assuring and monitoring quality.

The results show it is premature to say whether performance-based acquisition strategies can work in the federal government, Auletta said. At a previous panel meeting, debate centered on whether the group should recommend expanding the strategy through "stretch" goals that would force agencies to embrace it, or restricting it in light of accounts of failure.

Carl DeMaio, president of The Performance Institute, an Arlington, Va.-based think tank and a co-chair of the panel's working group that developed the recommendations, said the results supported the group's tentative recommendation to drop the quota.

"Does this raise the issue that agencies are gaming the system?" he asked. "Maybe." But he said it also showed the need for more training for contracting officers, and more time for implementation before a decision is made on whether the strategy, which has proven successful in the private sector, can work for the government.

"This panel is recommending that we get it right ... that for five years we build a database and then we evaluate the data," DeMaio said.

He said the outstanding data could change the distribution of results but he was not optimistic that the overall picture would improve. Agencies that have not yet responded may be hesitating over contracts that reflect poorly, he suggested.

On the positive side, Auletta noted that some of the contracts -- especially some in information technology services -- showed very good use of the strategy. The contract review provides more concrete data than anything else the panel has seen on the topic, but was not designed to reflect statistical significance, she said.

COMMENTS

  • Specs are supposed to be complete and turned in with each Purchase Request. Why not either have specialists that are trained in writing PWSs or have an agency specifically set up to write and manage performance-based contracts, similar to the concept used in the creation of DCMC? With all the downsizing and budget cuts, procurement groups do not have the necessary and much needed time to devote for planning, testing and implementing performance-based metrics and surveillance documents.
  • "Does this raise the issue that agencies are gaming the system?" he asked. "Maybe." This simply is a PC way of saying they lie! If contracting officers are overworked and asked to perform to unrealistic goals, they should not lie but should show results where 98 percent of the dollar amount of contracts called performance are in fact performance. If they cannot meet the goals established in the scheduled time, that is too bad. Only then can we determine if the schedules are unrealistic or the contracting officers are doing a poor job. The DoD has had since 1990 to comply with the CFO Act and they are now saying that we are trying to meet an unrealistic schedule to comply in part by the end of fiscal 2008. That is 18 years guys! If DoD cannot comply within 18 years (and most others have complied) something seriously is wrong in DoD and it should be fixed immediately -- not in another three years!
  • Can you say "duh"? Did anyone ever really think that proper implementation of performance-based contracts would occur? A true performance-based contract changes the government mission from quality control to quality assurance. We have a lot of GS-12 through GS-15 "professionals" that feel quality assurance is beneath them. Do you really need a P.E. or MBA to perform quality assurance? If the answer is "no," then aren't we overstaffed at the top grade levels? So what are we now going to have all those highly paid "professionals" if we truly enforce the "performance-based" concept?