Senior Programmer/Analyst (development of selection assessment tools)

A Public Sector client is seeking a Senior Programmer/Analyst to support developing selection assessment tools using modern testing methods and technology.

Mandatory requirements

• Education:
  • Option 1: A Doctor of Philosophy (PhD) in one of the following disciplines: Psychology with a specialization in Psychometrics or Quantitative Psychology; or Education with a specialization in Measurement, Evaluation, or Research Methodology.
  • Option 2: A master’s degree in psychology in one of the following disciplines: Psychology with a specialization in Psychometrics or Quantitative Psychology; or Education with a specialization in Measurement, Evaluation, or Research Methodology. AND a minimum of 5 years of experience in developing and evaluating standardized assessments or psychometric tools.
• Minimum 10 years of experience and have worked on at least 3 of the 5 following aspects of test development and evaluation, with a focus on their role and the impact of their work:
  • Computer Adaptive Testing (CAT) / Item Response Theory (IRT)
  • Psychometric Evaluation of Tests (test and item level)
  • Test Design and Assembly
  • Item Banking
  • Test Equating
• Minimum 10 years of experience leading or programming a test or an assessment system using statistical programming languages such as R, Python, or other similar languages (e.g., SAS, Matlab, SQL).
• Capability to draft documentation and to clearly articulate concepts in English both in writing and orally.

General Tasks

• Provide technical guidance and support in the design and conduct of quality assurance tests (e.g., integration testing, unit testing, system testing) to ensure the psychometric fidelity of a computer adaptive cognitive assessment.
• Analyze client requirements to provide advice and guidance regarding aspects of the adaptive cognitive assessment to support its effective functionality (e.g., norming, scoring, language equivalence, linking with earlier version of assessment).
• Develop or modify relevant software (e.g., R program code) to address any issues uncovered through quality assurance testing, or to support the deployment or integration of the assessment on other IT platforms (as determined by internal stakeholders).
• Develop materials (e.g., computer algorithms, item banks, scoring keys, test instructions) to support the effective functioning of the computer adaptive cognitive assessment (e.g., construct definition, content validation, test specifications, item development, test design/assembly, item banking, test administration, test scoring, passing scores, and reporting).
• Prepare technical reports and/or presentations to document findings and processes related to any of the aforementioned tasks. (Stream: Programmer/Analyst).