Principal Psychometrician The Principal Psychometrician for Market and Regulatory Services' Credentialing, Registration, Education & Disclosure (CRED) department provides expert measurement services in support of testing and continuing education programs, ensuring the delivery of valid, reliable assessments that comply with testing industry standards. The role requires conducting psychometric analyses across the full lifecycle of examination program operations, including job/practice analysis, item calibration, standard setting, and data forensics and serving as an internal subject matter expert on psychometric and data analytic methodologies. This position is an experienced individual contributor who works independently with minimal supervision.
Essential Job Functions:
Performs routine psychometric analyses on the performance of examinations and continuing education programs using Classical Test Theory, Rasch Measurement, and Item Response Theory. Manipulate, analyze, and maintain large data sets. Document results of examination and continuing education analyses. Leads and supports measurement activities across job analysis studies, test specification validation, standard setting, and test security, exercising independent judgment in methodology selection and execution. Conducts quality control of scoring processes for both computer-delivered and paper-and-pencil test administrations and contribute to the development of requirements and user acceptance testing for test-generation, scoring, and statistical systems. Serves as a subject matter expert and internal resource on assessment, psychometric, and data analytic methodologies, including proficient use of FINRA's proprietary item banking and test delivery system. Maintains deep, current knowledge of measurement theory and emerging developments in psychometric, proactively identifying innovations that may enhance test delivery, exam construction, measurement accuracy, and test security. Designs and conducts ad hoc and research-driven analyses with direct application to FINRA and client programs, translating complex findings into actionable insights for senior staff and management. Applies advanced analytical skills to support the full lifecycle of examination program operations, from test construction and scoring through ongoing program evaluation and continuous improvement. Demonstrates FINRA's values. Collaborates, both in-person and virtually, in furtherance of FINRA's mission of investor protection and market integrity. Education/Experience Requirements: Master's Degree in Psychology, industrial/organizational psychology, or Education, with an emphasis on psychometrics, measurement and assessment, or a related field (e.g., statistics, mathematics, or computer science).Minimum of three (3) years testing industry experience or equivalent combination of education and experience. Broad knowledge of industry-accepted measurement methodologies including job/practice analysis, item analysis/calibration, forms assembly, standard setting, and test security. Familiarity with Classical Test Theory, Rasch Measurement, and/or Item Response Theory. Strong quantitative skills and exemplary attention-to-detail with a demonstrated ability to produce accurate psychometric results under tight deadlines. Strong interpersonal and communication skills (oral and written) with demonstrated ability to work effectively with individuals who have varying levels of measurement expertise. Proficiency with software and statistical analysis and programming tools (e.g., R, SPSS,), and Rasch/IRT software (e.g., Winsteps, Xcalibre, Parscale).
Working Conditions:
Hybrid work environment, with defined in-person presence requirements. Infrequent travel may be required (less than 10%)
