Technical Certification Program Sr. Advisor

Overview Senior Certification Exam Development Specialist (Psychometrician) One Identity is an award-winning security software provider offering a broad selection of solutions that solve some of the most common and most challenging IT security problems. Part of the One Identity Software group, One Identity solutions eliminate the complexities and time-consuming processes often required to govern identities, manage privileged accounts and control access. Our solutions enhance business agility while addressing IAM challenges within on-premises, cloud and hybrid environments. The combined entity delivers a complete portfolio of market-leading Identity Access Management, Privileged Access Management, and Identity Governance solutions. Now, customers can achieve identity-centric security with trusted, proven technology in each major category. We are seeking a certification exam development specialist with strong psychometric expertise to establish and maintain standards for our certification and credentialling program. This includes design, validate, and maintenance of certification exams for one identity s software solutions. This role is responsible for translating product knowledge and instructional content into high-quality assessments that accurately measure a learner s understanding and ability to apply that knowledge. The focus is on creating exams that are rigorous, fair, and aligned to real-world product use. This individual will partner closely with Product and instructional subject matter experts to ensure that assessments effectively validate the intended learning outcomes. Responsibilities Assessment Design and DevelopmentDesign and build certification exams that measure both knowledge and applied understandingTranslate product functionality and instructional content into structured, testable assessment itemsDevelop exam blueprints aligned to defined learning objectives and job-relevant skillsCreate and maintain item banks including multiple-choice, scenario-based, and case-based questionsMaintain consistency in the credentialling program across products Psychometric Quality and RigorApply psychometric principles to ensure exams are valid, reliable, and fairDefine scoring models, passing thresholds, and exam structuresConduct item analysis including difficulty, discrimination, and effectiveness of distractorsContinuously calibrate exams to address variability in perceived difficulty Curriculum Alignment (Non-Ownership Role)Partner with Product and instructional SMEs to understand the intent and outcomes of training contentEnsure exams accurately reflect what learners are expected to know and applyIdentify and resolve gaps where exams are perceived as too easy, too difficult, or misalignedEstablish clear linkage between learning objectives, curriculum content, and exam coverage Lab-Based and Performance AssessmentDesign and introduce hands-on, lab-based assessment components to validate real-world applicationDefine scenarios, tasks, and scoring criteria for performance-based testingCollaborate with platform owners to integrate lab environments into certification examsEnsure hands-on assessments are measurable, repeatable, and scalable Exam Lifecycle ManagementOwn the lifecycle of certification exams including creation, release, maintenance, and updatesEnsure exams remain current with product changes and evolving use casesManage versioning and periodic refresh of exam content Data Analysis and Continuous ImprovementAnalyze exam performance data including pass rates, item performance, and learner outcomesIdentify trends related to exam difficulty and effectivenessUse data to refine exam quality, consistency, and alignmentProvide insights to improve overall certification credibility and effectiveness Qualifications 5 - 10+ years of experience in assessment design, certification exam development, or psychometricsStrong understanding of psychometric principles including validity, reliability, and item analysisExperience developing technical or software-related certification examsProven ability to translate complex technical content into clear, measurable assessment itemsExperience developing exam blueprints and structured item banksStrong collaboration skills when working with SMEs and product teams PreferredBackground in enterprise software, cybersecurity, or infrastructure technologiesExperience designing performance-based or hands-on assessmentsExperience with Lismus, Skytap, and Credly Familiarity with platforms such as Mindtickle, Skillable, CloudLabs, or Pearson VUE Company Description One Identity enables organizations of all sizes to better secure, manage, monitor, protect, and analyze information and infrastructure to help fuel innovation and drive their businesses forward. With team members around the globe, we intend to continue to grow revenues and add value to customers. When you join our team, you will have the opportunity to build and develop products at a scale few other...