
Government Survey Methodology Assistant
Validate government survey designs with statistical rigor
What You Can Do
You can submit survey designs, sampling strategies, and analysis plans for expert methodological review. Claude evaluates your approach against statistical best practices, identifies potential biases, verifies compliance with government standards, and recommends improvements to ensure your survey produces reliable, defensible results.
Features
Reviews questionnaire structure, question wording, response options, and logical flow to identify ambiguity, bias, and respondent burden issues.
Evaluates sampling frames, stratification approaches, weighting schemes, and non-response handling to ensure representativeness and minimize sampling error.
Calculates required sample sizes for specified confidence levels and effect sizes, accounting for design effects and anticipated non-response rates.
Identifies sources of coverage bias, selection bias, measurement error, and non-response bias, then recommends specific mitigation strategies.
Verifies alignment with OMB Paperwork Reduction Act requirements, Census Bureau standards, and applicable government survey guidelines.
Develops quality assurance protocols, outlier detection procedures, and validation logic to maintain data integrity throughout collection and processing.
Evaluates statistical methods, hypothesis tests, confidence intervals, and sensitivity analyses to ensure appropriate methodology for research questions.
Example Output
Survey Design Review:
- Issue: Question 3 uses double-negative framing ("Do you NOT disagree...") → Response: Reword as positive statement
- Issue: No option for "Don't know" → Response: Add "Refused" and "Not applicable" categories
- Strength: Good skip logic reduces respondent burden by 15%
Sampling Strategy Assessment:
- Frame: USPS DSF has 98.5% coverage → Acceptable
- Stratification: Age + region appropriate for 5-state design
- Required n: 2,400 completes (accounting for 20% non-response, DEFF=1.3)
- Risk: Undersampling rural areas; recommend oversample by 30%
Compliance Summary:
- OMB Control Number: Required before implementation
- Census Bureau guidelines: Compliant on race/ethnicity categories
- Privacy considerations: Recommend secure data transmission and deletion timeline
What's Included
- Design Validation Framework: Systematic checklist covering questionnaire structure, item quality, response scales, and cognitive burden assessment.
- Sampling Strategy Templates: Reusable templates for stratified, cluster, and multi-stage designs with guidance on frame requirements and weighting.
- Statistical Analysis Guidance: Decision trees for selecting appropriate hypothesis tests, confidence interval methods, and handling missing data in government surveys.
- Compliance Checklist: OMB Paperwork Reduction Act, Census Bureau standard, and agency-specific requirements verification guide.
- Quality Assurance Protocols: Data validation logic, outlier management, consistency checking, and documentation standards for audit trails.
Who It's For
- Survey Statisticians & Methodologists
- Government Research Directors & Program Managers
- Census & Statistical Agency Officials
- Policy & Program Evaluation Analysts
- Federal & State Survey Coordinators
Best For
- Reviewing survey designs before implementation
- Validating sampling strategies for representativeness
- Planning statistical analysis and sample size calculations
- Ensuring compliance with government standards and regulations
- Identifying and mitigating sources of bias and error







