content-experimentation-best-practices

Name: content-experimentation-best-practices
Author: sanity-io

166stars23forks

How to install content-experimentation-best-practices?

sanity-io/agent-toolkit/content-experimentation-best-practices

$npx -y skills add sanity-io/agent-toolkit --skill content-experimentation-best-practices

Installs into the current project.

Summary

Content experimentation and A/B testing guidance covering experiment design, hypotheses, metrics, sample size, statistical foundations, CMS-managed variants, and common analysis pitfalls. Use this skill when planning experiments, setting up variants, choosing success metrics, int

Files · 1

View on GitHub

SKILL.md

1	# Content Experimentation Best Practices
2
3	Principles and patterns for running effective content experiments to improve conversion rates, engagement, and user experience.
4
5	## When to Apply
6
7	Reference these guidelines when:
8	- Setting up A/B or multivariate testing infrastructure
9	- Designing experiments for content changes
10	- Analyzing and interpreting test results
11	- Building CMS integrations for experimentation
12	- Deciding what to test and how
13
14	## Core Concepts
15
16	### A/B Testing
17	Comparing two variants (A vs B) to determine which performs better.
18
19	### Multivariate Testing
20	Testing multiple variables simultaneously to find optimal combinations.
21
22	### Statistical Significance
23	The confidence level that results aren't due to random chance.
24
25	### Experimentation Culture
26	Making decisions based on data rather than opinions (HiPPO avoidance).
27
28	## References
29
30	Start with the reference that matches the current problem, such as design, statistics, CMS integration, or pitfalls. See `references/` for detailed guidance:
31	- `references/experiment-design.md` — Hypothesis framework, metrics, sample size, and what to test
32	- `references/statistical-foundations.md` — p-values, confidence intervals, power analysis, Bayesian methods
33	- `references/cms-integration.md` — CMS-managed variants, field-level variants, external platforms
34	- `references/common-pitfalls.md` — 17 common mistakes across statistics, design, execution, and interpretation

People who liked this also viewed

6 picks

Type

content-experimentation-best-practices

166stars23forks

View on GitHub

How to install content-experimentation-best-practices?

sanity-io/agent-toolkit/content-experimentation-best-practices

$npx -y skills add sanity-io/agent-toolkit --skill content-experimentation-best-practices

Installs into the current project.

Summary

Files · 1

View on GitHub

SKILL.md

1	# Content Experimentation Best Practices
2
3	Principles and patterns for running effective content experiments to improve conversion rates, engagement, and user experience.
4
5	## When to Apply
6
7	Reference these guidelines when:
8	- Setting up A/B or multivariate testing infrastructure
9	- Designing experiments for content changes
10	- Analyzing and interpreting test results
11	- Building CMS integrations for experimentation
12	- Deciding what to test and how
13
14	## Core Concepts
15
16	### A/B Testing
17	Comparing two variants (A vs B) to determine which performs better.
18
19	### Multivariate Testing
20	Testing multiple variables simultaneously to find optimal combinations.
21
22	### Statistical Significance
23	The confidence level that results aren't due to random chance.
24
25	### Experimentation Culture
26	Making decisions based on data rather than opinions (HiPPO avoidance).
27
28	## References
29
30	Start with the reference that matches the current problem, such as design, statistics, CMS integration, or pitfalls. See `references/` for detailed guidance:
31	- `references/experiment-design.md` — Hypothesis framework, metrics, sample size, and what to test
32	- `references/statistical-foundations.md` — p-values, confidence intervals, power analysis, Bayesian methods
33	- `references/cms-integration.md` — CMS-managed variants, field-level variants, external platforms
34	- `references/common-pitfalls.md` — 17 common mistakes across statistics, design, execution, and interpretation

People who liked this also viewed

6 picks

Type