Survey Design & Psychometric Validation
Design scientifically-valid surveys with automatic psychometric validation
by omkamalSocial Sciences & PolicyPsychology (Applied)Industrial-Organizational PsychologistSurvey/AnalyticsWhat You Can Do
Create rigorously designed surveys using evidence-based methodology and validate them with psychometric analysis. Claude analyzes your research objectives, generates targeted survey items, evaluates scale reliability and validity, and identifies potential measurement issues before data collection. You get publication-ready instruments with documented psychometric properties.
Features
Create theoretically-grounded, unbiased survey questions aligned with your constructs. Claude generates balanced items with appropriate response scales and avoids common pitfalls like leading language and double negatives.
Calculate and interpret Cronbach's alpha, test-retest reliability, and inter-rater consistency. Claude diagnoses problematic items and recommends revisions to improve internal consistency.
Analyze content validity, construct validity, and criterion validity. Claude maps items to theoretical constructs and identifies gaps or redundancies in your measurement model.
Prepare data and interpret factor structure. Claude guides you through exploratory and confirmatory factor analysis to verify that items cluster as expected.
Evaluate item difficulty, discrimination, and variance. Claude identifies problematic items (low correlations, extreme distributions, skew) and suggests improvements.
Choose appropriate rating scales (Likert, Semantic Differential, etc.) based on your construct and sample. Claude evaluates scale length, endpoint labels, and anchoring strategies.
Screen for potential measurement bias, cultural assumptions, and language barriers. Claude flags items that may disadvantage specific groups or populations.
Example Output
Input: "I'm designing a burnout scale for healthcare workers. I have three constructs: emotional exhaustion, depersonalization, and personal accomplishment."
Claude Output:
# Emotional Exhaustion Scale (5 items)
1. I feel emotionally drained by my work. [5-point Likert]
2. Working with patients all day is really a strain for me. [5-point Likert]
...
# Validity Assessment
- Content validity: All items directly address emotional depletion (strong)
- Discriminant validity concern: Item 3 overlaps with depersonalization—revise
- Recommended Cronbach's α target: 0.80+ (current: 0.76)
# Diagnostics
- Item 4 shows low corrected item-total correlation (r=0.31); consider removal
- Response distribution skewed toward agreement; check for response bias
What's Included
- Survey Template Generator: Automatically structure multi-dimensional surveys with clear section headers, consistent formatting, and professional layout instructions for distribution.
- Psychometric Analysis Checklist: Step-by-step guide to validating your survey, including reliability tests, validity checks, and item-level diagnostics with interpretation guidance.
- Response Scale Advisor: Recommendations on optimal scale types, number of response options, and endpoint anchoring based on your research design and sample characteristics.
- Bias Detection Framework: Systematic review of items for leading language, cultural assumptions, accessibility barriers, and potential measurement bias across demographics.
- Sample Size & Power Calculator: Guidance on required sample sizes for reliability estimates, factor analysis, and validity testing based on your survey complexity and statistical goals.
Who It's For
- Research Scientists & Academics
- Clinical & Organizational Psychologists
- UX Researchers & Product Teams
- HR & Learning & Development Professionals
- Public Health & Social Science Researchers
Best For
- Developing new measurement instruments from scratch
- Adapting existing scales for new populations or contexts
- Validating survey data before analysis
- Improving scale reliability and eliminating problematic items
- Documenting psychometric properties for publication
You might also like
You can design and validate selection systems that maximize predictive accuracy while minimizing legal risk. The skill applies industrial-organizational psychology principles to create structured assessments, job analyses, and validity evidence that withstand regulatory scrutiny. You'll generate documentation that demonstrates how your selection criteria connect to job performance and comply with EEOC/OFCCP standards.
by omkamal
Conduct structured Failure Mode and Effects Analysis (FMEA) with risk quantification and mitigation tracking. Generate comprehensive safety documentation including hazard analysis, root cause analysis, and compliance artifacts that meet regulatory standards (ISO 26262, FDA, IEC 61508). Transform complex safety requirements into actionable verification and validation plans with full traceability.
by omkamal
You can systematically examine aerospace incidents, cockpit procedures, and interface designs using established human factors frameworks like SHEL, Norman's action theory, and Reason's accident causation model. The skill identifies human performance bottlenecks, error traps, and design vulnerabilities—then recommends evidence-based mitigations that reduce cognitive workload, enhance situational awareness, and prevent accidents.
by omkamal
Systematically integrate psychological and psychiatric assessment results into comprehensive, legally-sound forensic competency opinions. Claude guides you through evidence-based reasoning to address the specific legal standards applicable to your jurisdiction, helping you organize clinical findings into clear, defensible conclusions about cognitive, functional, and volitional capacities relevant to the legal question at hand.
by omkamal
This skill transforms raw clinical findings and assessment data into structured, legally defensible competency evaluation reports. You provide clinical observations, test scores, and relevant history; Claude organizes them into coherent narratives with proper test cross-referencing, expert reasoning frameworks, and standards-compliant conclusions that withstand legal scrutiny.
by omkamal
Conduct systematic usability evaluations using Nielsen's 10 heuristics and other industry-standard frameworks to identify friction points and design improvements. Synthesize user research data into actionable insights, correlation patterns, and prioritized recommendations that connect quantitative findings to qualitative user behaviors. Generate detailed evaluation reports with severity ratings, evidence mapping, and implementation roadmaps for your design team.
by omkamal
This skill provides comprehensive human factors analysis of vehicle interface designs. You can assess cognitive load, identify driver distraction risks, evaluate NHTSA compliance, and uncover usability issues before design freeze. It combines HCI best practices, automotive safety standards, and workload assessment methodologies to deliver actionable feedback that keeps drivers safe.
by omkamal
This skill helps you develop comprehensive expert witness reports grounded in forensic psychology research, case law, and evidentiary standards. It guides you through crafting testimony strategies that anticipate cross-examination challenges, identify weaknesses in opposing arguments, and present psychological conclusions with maximum credibility before court. You'll produce documentation that withstands legal scrutiny and jury standards.
by omkamal