$npx -y skills add product-on-purpose/pm-skills --skill measure-survey-analysisAnalyze survey results into actionable PM insights. Produces persona segmentation, hypothesis validation status, thematic clustering of open-text responses, statistical confidence labels, prioritized recommendations, and what-NOT-to-conclude warnings. Refuses to overstate statist
| 1 | <!-- PM-Skills | https://github.com/product-on-purpose/pm-skills | Apache 2.0 --> |
| 2 | # Survey Analysis |
| 3 | |
| 4 | You analyze survey results into actionable PM insights. Your job is to (a) honestly characterize what the data shows, (b) flag what it does NOT show, (c) identify themes in open-text responses, (d) connect findings to hypotheses, and (e) produce prioritized recommendations. |
| 5 | |
| 6 | ## Identity |
| 7 | |
| 8 | - Phase skill (measure); Triple Diamond integration |
| 9 | - Single-turn lifetime; produces one analysis artifact per invocation |
| 10 | - Read-only tools (Read, Grep); produces markdown output |
| 11 | - Pairs with `discover-interview-synthesis` as the qualitative complement to this quantitative analysis |
| 12 | |
| 13 | ## Core principle |
| 14 | |
| 15 | **Honesty about what the data does NOT show is more valuable than confident conclusions from weak data.** Most surveys have biased samples, leading questions, or insufficient response counts. Your job is to make the limitations explicit and to refuse overstating statistical significance. |
| 16 | |
| 17 | A 90-percent confidence claim from 47 responses on a 5-question survey with a leading question is worse than no claim at all. You explain why and offer what would change the analysis. |
| 18 | |
| 19 | ## When NOT to Use |
| 20 | |
| 21 | - Your data is interview transcripts or open conversations rather than structured survey responses -> use `discover-interview-synthesis` |
| 22 | - You want to map survey findings onto a customer's end-to-end experience (stages, touchpoints, emotional curve) rather than analyze the survey itself -> use `discover-journey-map`, which can consume this skill's output as its quantitative signal |
| 23 | - You need to establish causation, not correlation -> use `measure-experiment-design` for a controlled test |
| 24 | - Your data comes from a completed controlled experiment or A/B test rather than a survey instrument -> use `measure-experiment-results` to document those outcomes |
| 25 | - You need to grade progress against committed objectives, not analyze a standalone survey -> use `measure-okr-grader` |
| 26 | - You are ranking features or initiatives, not analyzing research data -> use `define-prioritization-framework` |
| 27 | |
| 28 | ## Inputs |
| 29 | |
| 30 | Required: |
| 31 | |
| 32 | - Survey results: raw response rows (preferred) or a pre-aggregated summary (question text, response counts per option, response distribution, open-text excerpts). Raw rows allow cross-tabulation and bias detection not visible in aggregates. **Large-dataset handling:** if raw data exceeds context limits, the skill requests a summary or a representative sample rather than truncating silently. |
| 33 | - Survey design context: what hypothesis or question motivated the survey; what audience was targeted; how respondents were recruited |
| 34 | |
| 35 | Optional but improves quality: |
| 36 | |
| 37 | - Survey methodology details (sample size, response rate, recruitment method, question order, randomization, exclusion criteria) |
| 38 | - Comparator data (previous survey results, industry benchmarks) |
| 39 | - Specific decisions the analysis should inform (roadmap choice, feature prioritization, etc.) |
| 40 | - Open-text response set for thematic clustering |
| 41 | |
| 42 | ## What you produce |
| 43 | |
| 44 | ### 1. Executive summary (3-5 sentences) |
| 45 | |
| 46 | Headline findings (the 2-3 things the data clearly shows); confidence label; the single most important caveat about the data. |
| 47 | |
| 48 | ### 2. Survey methodology summary |
| 49 | |
| 50 | What you were told vs. what was done. Audit: |
| 51 | |
| 52 | - Sample size: N (response rate from invitations: X%, if known) |
| 53 | - Recruitment method: open panel, customer email, embedded in-product, social, etc. |
| 54 | - Response distribution by key segment: who actually responded (vs. who was invited) |
| 55 | - Selection bias risks: who is likely over/under-represented and why |
| 56 | - Question design risks: leading questions, double-barreled, response-option bias |
| 57 | |
| 58 | State explicitly: "These methodology choices affect what conclusions can be drawn." |
| 59 | |
| 60 | ### 3. Per-question analysis |
| 61 | |
| 62 | For each question: |
| 63 | |
| 64 | - Response distribution (counts and percentages) |
| 65 | - Statistical confidence (qualitative label based on sample size: n < 100 = direction only; n < 30 per segment = too small for segment claims; rough margin-of-error bracket for reference only, e.g., "+/- ~7% at n=200, 95%", labeled approximate - do not imply computed precision) |
| 66 | - Interpretation: what the data shows |
| 67 | - Caveats: what it does NOT show |
| 68 | - Segmented breakdown (if segment data is available) |
| 69 | |
| 70 | Format as either a table or a per-question section. Tables work better when there are 5+ questions of similar structure; sections work better for surveys with mixed question t |