
Open Data Investigation Analyst
Uncover hidden stories in open datasets with rapid pattern analysis
What You Can Do
Analyze open datasets at scale to surface newsworthy patterns, validate data quality, and generate structured findings. You'll identify anomalies, correlations, and trends that often go unnoticed, then transform raw numbers into compelling narratives backed by rigorous analysis.
Features
Rapidly scan datasets to identify statistically significant patterns, correlations, and outliers that may signal important stories
Validate dataset integrity, flag missing values, inconsistencies, and potential data entry errors before analysis
Transform findings into structured data stories with clear headlines, supporting evidence, and implications
Process CSV, JSON, Excel, and other structured formats; handles messy real-world data cleaning automatically
Verify that claims are statistically sound, calculate confidence levels, and flag overreaching conclusions
Pinpoint unusual data points that warrant investigation or represent potential story angles
Maintain clear citations to original data sources and government agencies; verify dataset provenance
Generate structured reports with visualizable metrics, methodology notes, and data download links
Example Output
Analysis Report: Housing Affordability Crisis Accelerating
Finding: Median rent-to-income ratio exceeded 35% in 247 US counties for the first time in 5 years (HUD open dataset, 2025).
Pattern Identified: Fastest growth in tier-2 cities (Austin +18%, Raleigh +16%) previously known for affordability.
Data Quality: 3 counties excluded due to incomplete reporting; methodology note included.
Story Angle: "The Affordability Paradox: Why Tech Hubs Are Pricing Out Their Own Workers"
Second Example: Environmental Violations Spike Before Inspections
Analyzing EPA enforcement data reveals facilities report 42% MORE violations after regulatory announcements. Statistical confidence: 94%. Hypothesis: increased reporting vs. actual behavior change pending further investigation.
What's Included
- Dataset Analysis Framework: Structured workflow for ingesting, cleaning, exploring, and validating public datasets
- Data Validation Checklist: Comprehensive quality checks: missing data, duplicates, outliers, format inconsistencies, temporal gaps
- Story Structure Template: Proven narrative format for data journalism: finding → evidence → implications → next steps
- Statistical Methods Guide: Reference for appropriate tests, confidence intervals, and significance thresholds for different data types
- Findings Report Generator: Markdown-based template that auto-generates formatted reports with sources, methodology, and caveats
- Public Data Source Directory: Curated list of vetted open datasets (government, NGO, academic) organized by topic and quality
Who It's For
- Data Journalists
- Investigative Reporters
- Policy Researchers & Analysts
- NGO & Nonprofit Program Officers
- Academic Researchers
Best For
- Discovering newsworthy trends in government datasets
- Validating data integrity before publication
- Structuring raw data findings into narrative stories
- Identifying anomalies that warrant deeper investigation
- Building databases of multi-year patterns for longitudinal analysis







