Round Two Pilots

In the second round of pilots the team focused on refining the SME-QA applicant funnel, how applicants move between assessment phases, by swapping the first interview out for written assessments and asynchronous interviews. The team also created a Resume Review Tool.

By the numbers

The team continues to focus on measuring the most important metric: the number of selections hiring managers made from the certificates, indicating the quality of the certificates.

CMS: MULTIPLE OFFICES

Product Manager - GS-13 - 2210 series
8 Vacancies
238 Applicants
12 Passed assessments (5%)
10 Selections
6 Hired

EPA: OFFICE OF MISSION SUPPORT

Personnel Security Specialist - GS-13 - 0800 series
4 Vacancies
112 Applicants
8 Passed assessments (7%)
4 Selections
4 Hired

GSA: TTS

UX Designer - GS-15 - 301 series
3 Vacancies
146 Applicants
8 Passed assessments (5%)
4 Selections
4 Hired

STATE: OFFICE OF MISSION SUPPORT

Grants Management Specialist - GS-12 - 1109 series
4 Vacancies
115 Applicants
27 Passed assessments (23%)
5 Selections
5 Hired

Private vs. Public Sector Applicants

In support of fair and open competition, the team worked to put private sector applicants on equal footing with applicants who are familiar with the strategies for successfully navigating the federal application process. USA Staffing doesn’t currently track whether applicants come from the private or public sector, limiting the availability of baseline data. The team did, however, review every resume received for both pilot hiring actions to learn whether SMEs found private sector applicants qualified throughout the applicant funnel.

Employment background comparison for CMS round two: 238 applicants, 22% contractors, 28% federal employees, 50% private sector
Employment background comparison for EPA round two: 112 applicants, 19% contractors, 70% federal employees, 12% private sector
Employment background comparison for CMS round two: 12 applicants qualified, 17% contractors, 17% federal employees, 67% private sector
Employment background comparison for EPA round two: 8 applicants qualified, 25% contractors, 75% federal employees, 0 private sector

Resume length

As another metric to gauge the success of private sector applicants in fair and open competition with federal employees and contractors, the team recognized differences in resume length between the two types of applicants. To redress the balance between the typical private sector guidance of very concise resumes and the government practice of long, comprehensive resumes, agencies clearly documented in the job announcements that SMEs would review a limited number of pages of work history on a submitted resume.

To measure this process change, the team sought to learn whether this limitation would either hurt applicants with federal-style resumes, or reinforce bias against private sector resumes from agency SMEs who are accustomed to longer documentation of work history. By tracking the length of resumes throughout the applicant funnel, the team found that resume review length did not significantly benefit or harm applicants. However, applicants with either one page resumes or resumes longer than 10 pages fared worse on average than those with resumes between two and nine pages in length.

Since the pilots began, OPM has updated the Delegated Examining Operations Handbook with new guidance that allows agencies to limit the number of work history pages reviewed during the qualifications process.

Resume length comparison for CMS round two Resume length comparison for EPA round two