Exam Methodology - Council on Pharmacy Standards

Exam Methodology

Our rigorous, multi-stage process for developing and maintaining psychometrically sound, valid, and legally defensible credentialing examinations.

At the Council on Pharmacy Standards, our credibility is built upon a foundation of best practices in high-stakes testing. We are committed to a comprehensive, evidence-based methodology that ensures every CPS credential accurately and fairly assesses professional competence. Our process is aligned with the standards established by organizations such as the National Commission for Certifying Agencies (NCCA) and ISO/IEC 17024.

Phase 1: Practice Analysis & Blueprint Development

The validity of any credentialing exam begins with a deep understanding of the profession it represents. This foundational phase ensures that our exam content directly reflects the realities of current practice.

  • Job Task Analysis (JTA)We conduct a comprehensive study of the profession, surveying a large, diverse group of practitioners to identify the essential tasks performed and the knowledge, skills, and abilities (KSAs) required to perform them competently.
  • Exam Content BlueprintThe data from the JTA is used to develop a detailed blueprint. This critical document maps out the exam's structure, defining each content domain and assigning a specific percentage of questions to it, ensuring a balanced and representative assessment.

Phase 2: Item Development & Review

With a valid blueprint in place, we begin creating the individual exam questions, known as "items." This collaborative process is guided by trained experts and involves multiple layers of scrutiny.

  • Subject Matter Expert (SME) RecruitmentWe recruit a diverse panel of experienced practitioners who are experts in the certification area. All SMEs undergo rigorous training in best practices for writing and reviewing high-quality exam items.
  • Item Writing & Multi-Level ReviewSMEs write new items according to the exam blueprint. Each item then passes through a multi-stage review process, including peer review by other SMEs, editorial review for grammar and clarity, and a final check for fairness, cultural bias, and sensitivity.

Phase 3: Exam Assembly & Standard Setting

This phase involves constructing the exam form and establishing the defensible passing standard. The passing score is not arbitrary; it is determined through a systematic, criterion-referenced procedure.

  • Exam Form AssemblyUsing our secure item bank, a psychometrician assembles multiple exam forms. Each form is carefully constructed to be parallel in content and difficulty, matching the blueprint specifications precisely.
  • Standard Setting (Cut Score)We conduct a standard-setting study, where a new panel of SMEs uses a legally defensible methodology (such as the Angoff method) to determine the cut score. This score represents the level of knowledge required for minimum competence in the field.

Phase 4: Administration & Continuous Improvement

The exam lifecycle is a continuous process. After an exam is launched, we constantly monitor its performance to ensure its ongoing integrity, relevance, and fairness.

  • Secure, Continuous Test AdministrationExams are administered year-round through our secure, proctored testing platform. This continuous model offers candidates the flexibility to schedule their examination at their convenience while ensuring the integrity of the testing process is maintained at all times.
  • Item Analysis & MaintenanceAfter each administration, our psychometricians perform a statistical analysis of every item. This data helps us identify and remove poorly performing or outdated questions, ensuring the item bank remains robust and reliable.
  • Periodic JTA RecurrenceTo keep pace with the evolving profession, the entire Job Task Analysis is repeated on a regular cycle (typically every 5-7 years), ensuring the exam blueprint and content remain current and relevant.

Explore Further

View Our Credentials

See the results of our rigorous methodology. Explore our full portfolio of certifications designed for today's pharmacy professionals.

Browse Certifications

Become an SME

Contribute your knowledge and help shape the future of the profession by joining our team of Subject Matter Experts.

Learn About Volunteering

Have Questions?

If you have questions about our psychometric process or governance, our dedicated team is ready to provide the answers.

Contact Our Team