Results

U.S. Digital Service and OPM have now conducted 2 rounds of pilots over the previous 18 months:

  • 7 pilots
  • 15 agencies
  • 22 offices
  • 1843 applicants
  • 179 qualified
  • 65 selections

Pilots

Round One

What we set out to accomplish

Agencies can drastically improve hiring outcomes using current delegated examining rules and regulations by incorporating Subject Matter Experts into the process.

Through the spring of 2019, the team tested the SME-QA process with 2 agencies and focused on improving the quality of applicants who appear on certificates.

Initial pilot results

Round Two

What we set out to accomplish

These pilots were intended to discover if the SME-QA process could be more flexible to different assessment types and sped up through the use of better tools. This include the creation of a Resume Review Tool.

Over the course of 2020 the team refined the process with pilots at 4 agencies.

Flexibility with SME-QA

Government-wide

What we set out to accomplish

This pilot intended to prove that a government-wide hiring action could be conducted using the SME-QA process and result in many simultaneous hires of high quality across a number of agencies.

Gov-wide hiring

Assessment and Selection Summary

CMS: MULTIPLE OFFICES

Product Manager - GS-13 - 2210 series
8 Vacancies
238 Applicants
12 Passed assessments (5%)
10 Selections
6 Hired

CX: MULTIPLE OFFICES

Customer Experience Strategist - 0301 series
Vacancies at:
  • GS-13: 18
  • GS-14: 20
  • GS-15: 11
844 Applicants
63 Passed assessments (7%)
22 Selections
17 Hired

DOI: NATIONAL PARK SERVICE

IT Specialist - GS-13 - 2210 series
7 Vacancies
224 Applicants
25 Passed assessments (11%)
13 Selections
13 Hired

EPA: OFFICE OF MISSION SUPPORT

Personnel Security Specialist - GS-13 - 0800 series
4 Vacancies
112 Applicants
8 Passed assessments (7%)
4 Selections
4 Hired

GSA: TTS

UX Designer - GS-15 - 301 series
3 Vacancies
146 Applicants
8 Passed assessments (5%)
4 Selections
4 Hired

HHS: CIO AND CTO

IT Specialist - GS-13 - 2210 series
10 Vacancies
164 Applicants
36 Passed assessments (21%)
7 Selections
7 Hired

STATE: OFFICE OF MISSION SUPPORT

Grants Management Specialist - GS-12 - 1109 series
4 Vacancies
115 Applicants
27 Passed assessments (23%)
5 Selections
5 Hired

Time to Hire improvements

Initial pilots

The initial pilots focused on improving the quality of certificates, rather than reducing the time it takes an agency to hire applicants. However, to gather baseline information to inform future hiring actions that employ the SME-QA process, the team tracked time to hire data for the initial pilots.

HHS was the first to pilot the SME-QA process, and took 3.5 months from posting the job announcement to creating the certificates. Learning quickly from HHS, the team iterated on the SME-QA process during the DOI pilot by concurrently scheduling and conducting the first and second interviews and simplifying assessment ratings to remove the less decisive “borderline” score. These rapid iterations helped DOI complete the same hiring phases as HHS in only two months.

USDS played the role of project manager, which kept the SME-QA process moving and reduced the time to hire. As project managers, the USDS team enforced the structure and completion of the job analysis workshop, which created both a shared understanding of the SME-QA process among all participants and also built the necessary momentum to post the job announcement one week later.

When people got a cert in the past they had to hunker down for a long ugly slog. This cert came-in and was ready to go. Literally [we] can choose today.

— Hiring Manager at HHS

Diagram comparing time to hire statistics for 4 agencies who piloted SME-QA

Second round

The second round of pilots added a Resume Assessment Tool that allowed SMEs to conduct resume reviews, and for HR Specialists to audit those reviews, much faster than before. Also, written assessment reviews were used at CMS and EPA in lieu of a first round interview.