SHRM Manager, Exam Scoring & Psychometrics in Alexandria, Virginia

Overview

The Role:

The Manager, Exam Scoring and Psychometrics is responsible for coordinating all data-related exam scoring activities for the SHRM's competency-based Human Resources certification based on the organization’s competency model. This includes responsibility for managing scoring data, analyzing scores, conducting quality assurance on scores, managing psychometric properties for test items, and for handing off score data to testing operations for dispersion to examinees. The position manages projects to analyze various test or item properties that contributes to raising the quality of the exams overall, and is responsible for all validation studies involving the SHRM Body of Competency and Knowledge and criterion validation of certification exams. This position works collaboratively with the item development team on test development as well as other stakeholders on projects stemming from examinee data outcomes.

Responsibilities

Your Day:

  • Serve as a key technical expert in test scoring; work with vendor(s) and staff to implement results of item-level reviews and calibration analyses. Implement decisions to create rules to guide form building parameters.

  • Lead all efforts to score all exams and assess the psychometric quality of all exam decisions.

  • Manage all rescoring and appeals to test results for all testing administrations.

  • Assure and maintain the quality of tests and standards for testing, using established industry standards and best practices; collaborate with other team members when contracting with vendors to ensure industry standards and best practices are reflected.

  • Develop and execute strategies to generate useful feedback for all examinees.

  • Conduct speededness and readability analyses and report results as needed.

  • Conduct research and analysis using examinee data in response to requests for information from other internal stakeholders or to elevate the overall stature of the certification exams.

  • Conduct and analyze results of differential item function studies; generate reports as needed.

  • Conduct data-based analysis of scoring data to support test security investigations.

  • Manage high-stakes assessment/certification projects.

  • Prepare reporting and related analyses to support certification accreditation.

  • Leads all validation studies related to certification and the Body of Competency and Knowledge.

  • Coach, develop and mentor direct reports to successfully support operations for certification exams.

  • Serves as a primary point of contact for test delivery vendors.

  • Provides analysis of and technical support on exam data to key stakeholders in the Certification ecosystem.

  • Provides occasional support to the Research team on key assessment and product development projects.

  • Leads all validation studies related to certification and the Body of Competency and Knowledge.

Qualifications

Must Haves:

  • Master’s degree in statistics, data science, industrial-organizational psychology or a related field; ABD or Ph.D. in similar disciplines preferred.

  • 5 years of experience in highly analytical test development or related roles; 7 years of experience, at least 3 of which are in psychometrics and management of test development, administration, and maintenance preferred.

  • Superior analyses skills, including knowledge of psychometrics.

  • R or SPSS programming skills

  • Strong verbal and written communication skills

  • Ability to manage multiple projects simultaneously

  • Advanced level EXCEL skills.

  • Strong writing and editing skills.

  • Detail oriented and focused on quality assurance.

Let us know if you also have:

  • Strong test development skills

  • Python programming skills

  • SQL skills

  • Vendor management skills

Physical Demands:

The physical demands described here are representative of those that must be met by an employee to successfully perform the essential functions of this job. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.

While performing the duties of this job, the employee is regularly required to sit; talk and hear, use hands to type, file, handle or feel. The employee is frequently required to reach with hands and arms. Occasionally required to stand; walk and stoop, kneel, crouch, or crawl. Visual acuity to use a keyboard, prepare and analyze data and figures; transcribing, viewing a computer terminal; extensive reading. May require ordinary ambulatory skills sufficient to visit other locations; or the ability to stand, walk, lift, carry and move light to medium weight. Requires good hand-eye coordination, arm, hand and finger dexterity, including ability to grasp, and visual acuity to use a keyboard, operate equipment and learn technical information.Moderate lifting is required. Exerting up to 50 pounds of force occasionally, and/or up to 30 pounds of force frequently, and/or up to 10 pounds of force to constantly move objects.

Work Environment:

The work environment characteristics described here are representative of those an employee encounters while performing the essential functions of this job. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions. Work is regularly performed in a professional office environment and routinely uses standard office equipment.

This job requires occasional travel 0-10%.

The Society for Human Resource Management is an equal opportunity employer (Minority/Female/Disabled/Veteran).

ACCESSIBILITY NOTICE: If you need a reasonable accommodation for any part of the employment process due to a physical or mental disability, please send an email to: accessibility@shrm.org or TDD (703) 548-6990.

Sorry the Share function is not working properly at this moment. Please refresh the page and try again later.

Category Certification