Overview

Senior Certification Exam Development Specialist (Psychometrician)

One Identity is an award-winning security software provider offering a broad selection of solutions that solve some of the most common and most challenging IT security problems. Part of the One Identity Software group, One Identity solutions eliminate the complexities and time-consuming processes often required to govern identities, manage privileged accounts and control access. Our solutions enhance business agility while addressing IAM challenges within on-premises, cloud and hybrid environments. The combined entity delivers a complete portfolio of market-leading Identity Access Management, Privileged Access Management, and Identity Governance solutions. Now, customers can achieve identity-centric security with trusted, proven technology in each major category.

We are seeking a certification exam development specialist with strong psychometric expertise to establish and maintain standards for our certification and credentialling program. This includes design, validate, and maintenance of certification exams for one identity’s software solutions.

This role is responsible for translating product knowledge and instructional content into high-quality assessments that accurately measure a learner’s understanding and ability to apply that knowledge. The focus is on creating exams that are rigorous, fair, and aligned to real-world product use.

This individual will partner closely with Product and instructional subject matter experts to ensure that assessments effectively validate the intended learning outcomes.

Responsibilities

Assessment Design and DevelopmentDesign and build certification exams that measure both knowledge and applied understandingTranslate product functionality and instructional content into structured, testable assessment itemsDevelop exam blueprints aligned to defined learning objectives and job-relevant skillsCreate and maintain item banks including multiple-choice, scenario-based, and case-based questionsMaintain consistency in the credentialling program across products

Psychometric Quality and RigorApply psychometric principles to ensure exams are valid, reliable, and fairDefine scoring models, passing thresholds, and exam structuresConduct item analysis including difficulty, discrimination, and effectiveness of distractorsContinuously calibrate exams to address variability in perceived difficulty

Curriculum Alignment (Non-Ownership Role)Partner with Product and instructional SMEs to understand the intent and outcomes of training contentEnsure exams accurately reflect what learners are expected to know and applyIdentify and resolve gaps where exams are perceived as too easy, too difficult, or misalignedEstablish clear linkage between learning objectives, curriculum content, and exam coverage

Lab-Based and Performance AssessmentDesign and introduce hands-on, lab-based assessment components to validate real-world applicationDefine scenarios, tasks, and scoring criteria for performance-based testingCollaborate with platform owners to integrate lab environments into certification examsEnsure hands-on assessments are measurable, repeatable, and scalable

Exam Lifecycle ManagementOwn the lifecycle of certification exams including creation, release, maintenance, and updatesEnsure exams remain current with product changes and evolving use casesManage versioning and periodic refresh of exam content

Data Analysis and Continuous ImprovementAnalyze exam performance data including pass rates, item performance, and learner outcomesIdentify trends related to exam difficulty and effectivenessUse data to refine exam quality, consistency, and alignmentProvide insights to improve overall certification credibility and effectiveness

Qualifications

5 - 10+ years of experience in assessment design, certification exam development, or psychometricsStrong understanding of psychometric principles including validity, reliability, and item analysisExperience developing technical or software-related certification examsProven ability to translate complex technical content into clear, measurable assessment itemsExperience developing exam blueprints and structured item banksStrong collaboration skills when working with SMEs and product teams

PreferredBackground in enterprise software, cybersecurity, or infrastructure technologiesExperience designing performance-based or hands-on assessmentsExperience with Lismus, Skytap, and Credly

Familiarity with platforms such as Mindtickle, Skillable, CloudLabs, or Pearson VUE

Company Description 

One Identity enables organizations of all sizes to better secure, manage, monitor, protect, and analyze information and infrastructure to help fuel innovation and drive their businesses forward. With team members around the globe, we intend to continue to grow revenues and add value to customers.

When you join our team, you will have the opportunity to build and develop products at a scale few others can provide. Our product portfolio serves a large base of customers, and we are addressing the strategic imperatives for enterprise businesses. Working with some of the most talented employees the industry has to offer, we provide enhanced career opportunities for team members to learn and grow in a rapidly changing environment.

Why work with us?

-Life at One Identity means collaborating with dedicated professionals with a passion for technology.

-When we see something that could be improved, we get to work inventing the solution.

-Our people demonstrate our winning culture through positive and meaningful relationships.

-We invest in our people and offer a series of programs that enable them to pursue a career that fulfills their potential.

-Our team members’ health and wellness are our priority, as well as rewarding them for their hard work.

One Identity is an Equal Opportunity Employer and Prohibits Discrimination and Harassment of Any Kind: One Identity is committed to the principle of equal employment opportunity for all employees and to providing employees with a work environment free of discrimination and harassment. All employment decisions at One Identity are based on business needs, job requirements and individual qualifications, without regard to race, color, religion or belief, national, social or ethnic origin, sex (including pregnancy), age, physical, mental or sensory disability, HIV Status, sexual orientation, gender identity and/or expression, marital, civil union or domestic partnership status, past or present military service, family medical history or genetic information, family or parental status, or any other status protected by the laws or regulations in the locations where we operate. One Identity will not tolerate discrimination or harassment based on any of these characteristics. One Identity encourages applicants of all ages.

Come join us. For more information, visit us on the web at One Identity Careers | Explore Opportunities with the OI Team

Job seekers should be aware of fraudulent job offers from online scammers and only apply to roles listed on quest.com/careers using our applicant system. Note: We do not use text messaging or third-party messaging apps like Telegram to communicate with applicants, so please exercise caution if you are approached in this way and only interact with people claiming to be Quest employees if they have an email address ending in @quest.com or @oneidentity.com

#LI-NM1

Technical Certification Program Sr. Advisor