Description

The Boeing Global Talent, Development & Employee Experience (GTD&EE) organization is seeking a highly skilled Senior Executive Assessment Scientist to join the Employee Listening, Organizational Research and Assessments team in Seattle, WA; Arlington, VA; Berkeley, MO; Chicago, IL or North Charleston, SC.

 This senior role is critical to designing, delivering, and validating executivelevel assessments for candidate selection and employee development. The role owner will be accountable for scientific integrity, psychometric validation, operational delivery, rigorous quality control, and strong program and project management for executive assessments, 360° feedback, and leadership evaluation methodologies, partnering with HR leaders and senior executives to inform talent decisions and development. 

Requirements

Position Responsibilities:

• Executive assessment strategy & governance: Define vision, strategic objectives, success metrics, and a prioritized roadmap for the executive assessment portfolio, and establish governance (steering committee, decision rights, escalation paths).
• Program leadership & delivery oversight: Set resourcing and vendor strategy (make vs. buy), allocate budget to highimpact initiatives, track ROI, provide strategic oversight of delivery (milestones, KPIs, risks, stakeholder engagement), and lead operational execution.
• Psychometrics, validation & quality assurance: Design and execute validation studies (content, construct, criterion validity, reliability, norming), develop analytic plans and run statistical tests (regression, ROC, crossvalidation, DIF/adverseimpact), provide methodological signoff, and maintain auditready documentation and QA processes. Oversee validity, fairness, scoring algorithms, and cutscore procedures for formal instruments (e.g., personality inventories, cognitive tests, simulations) and ensure interpretation guidelines are defensible and documented.
• Assessment design & vendor management: Build jobaligned assessment batteries (interviews, simulations, tests, assessment centers, 360° feedback), and select and manage vendors to ensure deliverables meet Boeing’s quality, security, and psychometric standards. Direct oversight of formal commercial assessments and simulation providers (e.g., Hogan, Raven’s/Cognitive measures, leadership simulations): licensing, administration standards, debrief protocols, vendor SLAs, and integration into assessment batteries. Ensure licensed instruments are used per publisher agreements and that vendor data handling meets Boeing DPAs and privacy requirements.
• Data, operations & test security: Oversee administration, data collection, test security, reproducible scoring, and reporting, and implement dataquality controls, versioning, and review processes to prevent errors.
• Assessor capability & calibration: Recruit, train, calibrate, coach, and evaluate assessors and debriefers, and maintain competency records and certification/CommunityofPractice programs to scale capability. Develop and enforce standardized debrief and feedback protocols for results from formal instruments and simulations.
• Stakeholder engagement & communication: Act as primary technical partner to senior HR leaders, participants, and vendors, translating technical assessment results into clear business recommendations, pragmatic coaching guidance, and executivequality deliverables.
• Compliance, privacy & ethical use: Establish policylevel controls and partner with Legal and Global Privacy to ensure legal/privacy compliance, ethical data use, and ongoing fairness monitoring.
• Continuous improvement & outcome monitoring: Monitor assessment program outcomes (performance, retention, promotion), lead periodic effectiveness reviews, and iterate assessments and processes based on evidence and documented measurement limitations.

Key Deliverables:  

• Validated executive assessment battery with documented evidence of reliability, validity, and fairness
• Project plans, timelines, risk logs, and status reports demonstrating ontime program delivery
• Standard operating procedures, assessor training materials, scoring rules, and auditready validation reports
• Executiveready reporting templates and development feedback products that meet Boeing quality standards
• Ongoing monitoring dashboard linking assessment results to organizational outcomes with dataquality controls

Basic Qualifications (Required Skills/Experience):

• Master’s Degree or PhD in Industrial/Organizational (I/O) Psychology, Psychometrics, Organizational Behavior, or closely related field
• 5+ years of progressive experience in assessment science, including executive or seniorleader assessment programs and demonstrated psychometric expertise
• 5+ years of experience designing and executing validation studies, including adverseimpact / DIF analyses
• 5+ years of experience with assessment instruments and methodologies (simulations, assessment centers, interviews, cognitive/personality measures, 360° feedback)
• Experience in at least one statistical/programming environment (e.g., R, Python, SPSS, SAS)

Preferred Qualifications (Desired Skills/Experience):  

• 10+ years of experience leading enterprise assessment programs
• Hogan certification and handson Hogan administration/debrief experience
• Strong program/project management (managing complex, crossfunctional initiatives)
• Experience selecting/integrating simulationbased executive assessments and assessment centers
• Experience running executive assessment certification programs or Communities of Practice to scale capability
• Experience conducting executive interviews and leading competency/leadership model development
• Stakeholder engagement with senior leaders and crossfunctional teams
• Experience building internal capability to reduce external consulting spend and deliver measurable ROI
• Exceptional written/verbal communication; executive summaries and technical validation reporting
• High assessment quality standards with meticulous attention to data quality, documentation, and compliance