Standard setting is a critical step in developing a certification exam, yet it’s often one of the least understood. At its core, the standard setting determines the score candidates must achieve to pass, ensuring that those who earn a credential meet a defined level of competence. This process plays a central role in protecting the public and maintaining the integrity of a certification program.
What Standard Setting Really Means
Standard setting is the process used to establish the passing score for an exam. Rather than arbitrarily choosing a percentage, certification organizations use structured, research-based methods to define what “competent” performance looks like.
Without a formal standard-setting process, a passing score could be inconsistent, subjective, or even unfair. A defensible standard ensures that every certified professional has met the same expectation, regardless of when they took the exam.
How the Process Works
While there are several recognized approaches, NBHWS used a variation of the Angoff method, a widely accepted standard setting technique in professional testing (Cizek & Bunch, 2007). This process is facilitated by NBME psychometricians, measurement experts who guide the methodology, analyze the data, and ensure the results are statistically sound.
Standard setting is not a one-time decision made in isolation. It includes multiple rounds of discussion, data review, and validation. SMEs may review performance data, consider the impact of their recommendations, and adjust their judgments accordingly.
Standard-setting methods are grounded in decades of research and testing and are considered a cornerstone of high-quality credentialing programs. Organizations such as the Institute for Credentialing Excellence and the National Commission for Certifying Agencies emphasize the importance of using defensible, evidence-based approaches to establishing passing standards.
Who Is Involved
A strong standard-setting process depends on the right mix of perspectives. Subject matter experts are carefully selected to represent the field, bringing a range of experience, backgrounds, and practice settings.
Before participating, SMEs receive guidance on how to think about “minimal competence” and how to apply that lens consistently across exam content.
In addition to SMEs and psychometricians, certification staff play a key role in coordinating logistics, ensuring documentation is in order, and maintaining alignment with accreditation standards.
Standard setting is intentionally collaborative. Individual judgments are important, but the strength of the process comes from group discussion. SMEs challenge assumptions, share perspectives, and work toward a shared understanding of what competence looks like in practice.
Closing: Key Takeaways
Standard setting is a foundational part of exam development and a key driver of certification integrity. While it may happen behind the scenes, its impact is far-reaching.
- It defines the level of competence required to pass
- It relies on trained subject matter experts and structured methods
- It is guided by psychometric best practices and research
- It ensures fairness and consistency for all candidates
- It strengthens trust in the credential and the professionals who earn it
As part of a broader exam development process, standard setting reflects the rigor and care that go into building a high-quality certification. It ensures that when someone earns a credential, it represents more than a score; it represents competence.
