survey-design

Name: survey-design
Author: scdenney

34stars0forks

How to install survey-design?

scdenney/open-science-skills/survey-design

$npx -y skills add scdenney/open-science-skills --skill survey-design

Installs into the current project.

Summary

Design survey instruments. Use for question wording, scales, flow, pretesting, respondent burden, and social-desirability mitigation.

Files · 1

View on GitHub

SKILL.md

1	# Survey Instrument Designer
2
3	## Instructions
4
5	### 1. Question Construction
6	- Item-Specific Wording: Frame questions with item-specific response options rather than agree/disagree, true/false, or yes/no formats. Instead of "Do you agree that immigration benefits the economy?" use "How much does immigration benefit or harm the economy?" with a substantive scale. This reduces acquiescence bias and forces respondents to process the item content (Stantcheva 2023).
7	- Open-Ended vs. Closed-Ended: Use open-ended questions to discover respondent frames and vocabulary before designing closed-ended items. Deploy open-ended items in pilots to generate response categories, then convert to closed-ended for the main study. In the main survey, reserve open-ended items for exploratory or manipulation-check purposes.
8	- Behavioral vs. Attitudinal: Prefer behavioral measures (what respondents would do) over attitudinal measures (what respondents feel) when the research question concerns real-world consequences. Attitudinal items are appropriate when the construct of interest is itself an attitude, but note that attitude-behavior gaps are well documented.
9	- Avoid Double-Barreled Questions: Each item should measure exactly one construct. "Do you support increased immigration and refugee resettlement?" conflates two distinct policy domains. Split into separate items.
10	- Avoid Leading and Loaded Language: Avoid terms that signal a "correct" answer or carry strong normative connotations. Pilot-test whether question framing shifts responses -- if it does, the wording is a treatment, not a measure (Stantcheva 2023).
11	- Numeric vs. Qualitative Response Options: For cross-country or cross-group comparisons, prefer qualitative response options ("a lot," "somewhat," "not at all") over exact numeric quantities. Specific numbers carry different informational weight across contexts -- "$50,000 income" means different things in the US and South Korea (Stantcheva 2023).
12
13	### 2. Scale Design
14	- Number of Scale Points: 5- to 7-point scales are a common convention for attitudinal items, trading off discrimination against cognitive load. Fewer points can lose meaningful variance; more points may not add measurement precision. Reliability depends more on whether each point is meaningfully labeled than on the raw count; assess test-retest and internal consistency for the target construct rather than defaulting to a fixed number. For knowledge or factual questions, binary or categorical formats are often sufficient.
15	- Labeled vs. Endpoint-Only: Label all scale points when feasible. Fully labeled scales reduce respondent uncertainty about the meaning of intermediate values and improve cross-respondent comparability.
16	- Unipolar vs. Bipolar: Match scale polarity to the construct. Bipolar scales (oppose--support) suit constructs with a natural midpoint. Unipolar scales (not at all--extremely) suit constructs with a natural zero point (e.g., frequency, intensity).
17	- Feeling Thermometers: Use with caution. Feeling thermometers (0--100) introduce measurement noise because respondents interpret the scale differently. They are useful for relative comparisons across targets within respondents but unreliable for absolute-level interpretation across respondents.
18	- Index Construction: When combining multiple items into an index, assess internal consistency (Cronbach's alpha, McDonald's omega, or composite reliability) and report the method used alongside the chosen threshold and its rationale. The historical alpha > 0.70 convention is a starting point, not a standard; omega is generally preferred for multidimensional scales. For population-based survey experiments specifically, multi-item indices of the dependent variable are strongly preferred over single-item measures because heterogeneous samples inflate within-group variance (Mutz 2011). Pre-specify index construction rules in the pre-analysis plan; do not construct indices after seeing the data (see also `methods-reporting`).
19	- Balanced Scales: Include equal numbers of positively and negatively worded options or directional anchors. Unbalanced scales (three positive options, one negative) bias responses toward the overrepresented direction.
20
21	### 3. Survey Flow and Organization
22	- Ordering Effects: Question order affects responses through priming, anchoring, and context effects. Place general questions before specific ones when measuring broad attitudes; reverse this when specific experiences are the construct of interest.
23	- Warm-Up Items: Begin the survey with non-sensitive, low-stakes items to build respondent engagement before introducing experimental blocks or sensitive questions. Demographic items can serve this purpose but should not precede treatment blocks if they could pri

People who liked this also viewed

6 picks

Type

web-design-guidelinesReview UI code for Web Interface Guidelines compliance. Use when asked to "review my UI", "check accessibility", "audit design", "review UX", or "check my site against best practices".SkillsJul 2026483k29k
lark-slides飞书幻灯片：创建和编辑幻灯片。创建演示文稿、读取幻灯片内容、管理幻灯片页面（创建、删除、读取、局部替换）。当用户需要创建或编辑幻灯片、读取或修改单个页面时使用。当用户给出 doubao.com 的 /slides/ URL/token 时，也应直接使用本 skill，不要因为域名不是飞书而回退到 WebFetch；路由依据是 URL 路径模式和 token，而不是域名。不负责：云文档内容编辑（走 SkillsJul 2026332k16k
design-taste-frontendTaste-Skill - gives your AI good taste. stops the AI from generating boring, generic slop SkillsJul 2026280k66k
ui-ux-pro-maxUI/UX design intelligence for web and mobile. Searchable local database with 84 styles, 192 color palettes, 74 font pairings, 192 product types, 98 UX guidelines, 104 icon entries, 16 GSAP motion presSkillsJul 2026280k109k
caveman-helpQuick-reference card for all caveman modes, skills, and commands. One-shot display, not a persistent mode. Trigger: /caveman-help, "caveman help", "what caveman commands", "how do I use caveman".SkillsJul 2026249k92k
codebase-designShared vocabulary for designing deep modules. Use when the user wants to design or improve a module's interface, find deepening opportunities, decide where a seam goes, make code more testable or AI-nSkillsJul 2026225k182k

survey-design

34stars0forks

View on GitHub

How to install survey-design?

scdenney/open-science-skills/survey-design

$npx -y skills add scdenney/open-science-skills --skill survey-design

Installs into the current project.

Summary

Design survey instruments. Use for question wording, scales, flow, pretesting, respondent burden, and social-desirability mitigation.

Files · 1

View on GitHub

SKILL.md

1	# Survey Instrument Designer
2
3	## Instructions
4
5	### 1. Question Construction
6	- Item-Specific Wording: Frame questions with item-specific response options rather than agree/disagree, true/false, or yes/no formats. Instead of "Do you agree that immigration benefits the economy?" use "How much does immigration benefit or harm the economy?" with a substantive scale. This reduces acquiescence bias and forces respondents to process the item content (Stantcheva 2023).
7	- Open-Ended vs. Closed-Ended: Use open-ended questions to discover respondent frames and vocabulary before designing closed-ended items. Deploy open-ended items in pilots to generate response categories, then convert to closed-ended for the main study. In the main survey, reserve open-ended items for exploratory or manipulation-check purposes.
8	- Behavioral vs. Attitudinal: Prefer behavioral measures (what respondents would do) over attitudinal measures (what respondents feel) when the research question concerns real-world consequences. Attitudinal items are appropriate when the construct of interest is itself an attitude, but note that attitude-behavior gaps are well documented.
9	- Avoid Double-Barreled Questions: Each item should measure exactly one construct. "Do you support increased immigration and refugee resettlement?" conflates two distinct policy domains. Split into separate items.
10	- Avoid Leading and Loaded Language: Avoid terms that signal a "correct" answer or carry strong normative connotations. Pilot-test whether question framing shifts responses -- if it does, the wording is a treatment, not a measure (Stantcheva 2023).
11	- Numeric vs. Qualitative Response Options: For cross-country or cross-group comparisons, prefer qualitative response options ("a lot," "somewhat," "not at all") over exact numeric quantities. Specific numbers carry different informational weight across contexts -- "$50,000 income" means different things in the US and South Korea (Stantcheva 2023).
12
13	### 2. Scale Design
14	- Number of Scale Points: 5- to 7-point scales are a common convention for attitudinal items, trading off discrimination against cognitive load. Fewer points can lose meaningful variance; more points may not add measurement precision. Reliability depends more on whether each point is meaningfully labeled than on the raw count; assess test-retest and internal consistency for the target construct rather than defaulting to a fixed number. For knowledge or factual questions, binary or categorical formats are often sufficient.
15	- Labeled vs. Endpoint-Only: Label all scale points when feasible. Fully labeled scales reduce respondent uncertainty about the meaning of intermediate values and improve cross-respondent comparability.
16	- Unipolar vs. Bipolar: Match scale polarity to the construct. Bipolar scales (oppose--support) suit constructs with a natural midpoint. Unipolar scales (not at all--extremely) suit constructs with a natural zero point (e.g., frequency, intensity).
17	- Feeling Thermometers: Use with caution. Feeling thermometers (0--100) introduce measurement noise because respondents interpret the scale differently. They are useful for relative comparisons across targets within respondents but unreliable for absolute-level interpretation across respondents.
18	- Index Construction: When combining multiple items into an index, assess internal consistency (Cronbach's alpha, McDonald's omega, or composite reliability) and report the method used alongside the chosen threshold and its rationale. The historical alpha > 0.70 convention is a starting point, not a standard; omega is generally preferred for multidimensional scales. For population-based survey experiments specifically, multi-item indices of the dependent variable are strongly preferred over single-item measures because heterogeneous samples inflate within-group variance (Mutz 2011). Pre-specify index construction rules in the pre-analysis plan; do not construct indices after seeing the data (see also `methods-reporting`).
19	- Balanced Scales: Include equal numbers of positively and negatively worded options or directional anchors. Unbalanced scales (three positive options, one negative) bias responses toward the overrepresented direction.
20
21	### 3. Survey Flow and Organization
22	- Ordering Effects: Question order affects responses through priming, anchoring, and context effects. Place general questions before specific ones when measuring broad attitudes; reverse this when specific experiences are the construct of interest.
23	- Warm-Up Items: Begin the survey with non-sensitive, low-stakes items to build respondent engagement before introducing experimental blocks or sensitive questions. Demographic items can serve this purpose but should not precede treatment blocks if they could pri

People who liked this also viewed

6 picks

Type