music-to-video

Name: music-to-video
Author: calesthio

41kstars4.9kforks

How to install music-to-video?

calesthio/openmontage/music-to-video

$npx -y skills add calesthio/OpenMontage --skill music-to-video

Installs into the current project.

Summary

Use when the user has a music track (an audio file, or a video to pull audio from) and wants a beat-synced HyperFrames video, calm to hard-hitting. The music drives everything: one analyzer reads it once, the orchestrator lays out the frames and fills a per-frame plan, and one su

Files · 1

View on GitHub

SKILL.md

1	# music-to-video — one music-grounded, beat-synced video workflow
2
3	Use this skill to turn a music track into a beat-synced HyperFrames video. You analyze the track once, lay out the frames, fill in a per-frame plan, and build each frame as a composition. The input is a music track plus optional user images or videos — there is no narration and no website capture. Typography and templates are the floor (a complete video needs zero assets); any media the user supplies is cut in on the same beat grid.
4
5	You are the orchestrator. Work in `videos/<project>/`. Run the steps in order and pass each Gate before moving on. Two steps need the user: Step 3 (plan approval) and Step 6 (render approval). Do every step yourself except Step 4, where you dispatch one sub-agent per frame. Keep design and motion rules out of this file — they live in `references/` and the `frame-worker` sub-agent.
6
7	`SKILL_DIR` = this skill directory. `PROJECT_DIR` = `videos/<project-name>/`.
8
9	Workflow: Step 0 setup → `hyperframes.json` + `assets/bgm.mp3`; Step 1 analyze → `audiomap.json`; Step 2 skeleton → `STORYBOARD.md` (frames, groups `TBD`); Step 3 plan → complete `STORYBOARD.md` + `frame.md`; Step 4 build → `compositions/frames/NN-*.html`; Step 5 assemble → `index.html`; Step 6 render → `renders/video.mp4`.
10
11	## Two ideas that shape everything
12
13	- One analyzer, and you trust it. `analyze-beatgrid.py` is the only beat analyzer — never re-measure beats with another tool or by ear. Its energy / density / rolls / onsets / silences are always reliable. Its `bpm` and `beats_sec` are reliable only when the music is genuinely rhythmic; on calm music the grid is a metronome the tracker imposed, so pace by phrases and energy instead and never hard-cut to it. Deciding which case you're in is each frame's `pacing` (Step 2).
14	- One frame = one file; groups live inside. Step 2 cuts the track into frames, and each frame becomes one composition file `compositions/frames/NN-<frame_id>.html`, built by one frame-worker. A frame can subdivide into groups (each a template or a motion-primitives combo). Extra density goes _inside_ a group, so frame count tracks distinct treatments, not beats — a fast track does not blow up the number of sub-agents.
15
16	---
17
18	## Step 0: Setup, BGM, and inputs
19
20	Goal: Establish the music source, create the HyperFrames project, and note any user-supplied media.
21
22	The music is the spine — establish one track before anything else. This skill is tuned for fast, high-energy BGM: a strong beat grid drives the cuts (calm tracks work, but pace by phrase rather than beat). If the user gave you audio — a music file, or a video to pull the audio from — use it. If not, generate one: choose the mood from the user's description (e.g. "driving synthwave", "trap beat", "upbeat corporate") and produce a track via `/hyperframes-media` (`references/bgm.md` — HeyGen retrieval when credentialed, else local Lyria / MusicGen; ElevenLabs or another generator also works). Before generating, run `npx hyperframes auth status` and relay its output verbatim (don't paraphrase or rewrite it) — it shows whether BGM comes from HeyGen or local MusicGen and, if not signed in, how to sign in. If not signed in, STOP and wait for the user to choose — sign in, or continue offline with local MusicGen — before generating the track; don't write keys into a per-repo `.env`. (In autonomous mode, note the status and continue offline.) See `/hyperframes-media` → Preflight for the canonical guidance. Either way the track lands at `assets/bgm.mp3`. Stage any user-supplied images or videos so frames can weave them in on the beat grid; otherwise typography carries the whole video.
23
24	Initialize only if `hyperframes.json` is missing. Name `<project>` from the brief in kebab-case, such as `midnight-drive-loop` — never a timestamp. `init` checks the installed skills against the latest on GitHub and updates the global set if any are out of date.
25
26	```bash
27	npx hyperframes init "videos/<project>" --non-interactive --example=blank
28	mkdir -p "$PROJECT_DIR/assets" "$PROJECT_DIR/renders"
29	cp "<user-music>" "$PROJECT_DIR/assets/bgm.mp3" # extract from a video first if needed
30	# only if the user gave you images/videos:
31	node <SKILL_DIR>/scripts/stage-assets.mjs --from <dir> --hyperfr

People who liked this also viewed

6 picks

Type

music-to-video

41kstars4.9kforks

View on GitHub

How to install music-to-video?

calesthio/openmontage/music-to-video

$npx -y skills add calesthio/OpenMontage --skill music-to-video

Installs into the current project.

Summary

Files · 1

View on GitHub

SKILL.md

1	# music-to-video — one music-grounded, beat-synced video workflow
2
3	Use this skill to turn a music track into a beat-synced HyperFrames video. You analyze the track once, lay out the frames, fill in a per-frame plan, and build each frame as a composition. The input is a music track plus optional user images or videos — there is no narration and no website capture. Typography and templates are the floor (a complete video needs zero assets); any media the user supplies is cut in on the same beat grid.
4
5	You are the orchestrator. Work in `videos/<project>/`. Run the steps in order and pass each Gate before moving on. Two steps need the user: Step 3 (plan approval) and Step 6 (render approval). Do every step yourself except Step 4, where you dispatch one sub-agent per frame. Keep design and motion rules out of this file — they live in `references/` and the `frame-worker` sub-agent.
6
7	`SKILL_DIR` = this skill directory. `PROJECT_DIR` = `videos/<project-name>/`.
8
9	Workflow: Step 0 setup → `hyperframes.json` + `assets/bgm.mp3`; Step 1 analyze → `audiomap.json`; Step 2 skeleton → `STORYBOARD.md` (frames, groups `TBD`); Step 3 plan → complete `STORYBOARD.md` + `frame.md`; Step 4 build → `compositions/frames/NN-*.html`; Step 5 assemble → `index.html`; Step 6 render → `renders/video.mp4`.
10
11	## Two ideas that shape everything
12
13	- One analyzer, and you trust it. `analyze-beatgrid.py` is the only beat analyzer — never re-measure beats with another tool or by ear. Its energy / density / rolls / onsets / silences are always reliable. Its `bpm` and `beats_sec` are reliable only when the music is genuinely rhythmic; on calm music the grid is a metronome the tracker imposed, so pace by phrases and energy instead and never hard-cut to it. Deciding which case you're in is each frame's `pacing` (Step 2).
14	- One frame = one file; groups live inside. Step 2 cuts the track into frames, and each frame becomes one composition file `compositions/frames/NN-<frame_id>.html`, built by one frame-worker. A frame can subdivide into groups (each a template or a motion-primitives combo). Extra density goes _inside_ a group, so frame count tracks distinct treatments, not beats — a fast track does not blow up the number of sub-agents.
15
16	---
17
18	## Step 0: Setup, BGM, and inputs
19
20	Goal: Establish the music source, create the HyperFrames project, and note any user-supplied media.
21
22	The music is the spine — establish one track before anything else. This skill is tuned for fast, high-energy BGM: a strong beat grid drives the cuts (calm tracks work, but pace by phrase rather than beat). If the user gave you audio — a music file, or a video to pull the audio from — use it. If not, generate one: choose the mood from the user's description (e.g. "driving synthwave", "trap beat", "upbeat corporate") and produce a track via `/hyperframes-media` (`references/bgm.md` — HeyGen retrieval when credentialed, else local Lyria / MusicGen; ElevenLabs or another generator also works). Before generating, run `npx hyperframes auth status` and relay its output verbatim (don't paraphrase or rewrite it) — it shows whether BGM comes from HeyGen or local MusicGen and, if not signed in, how to sign in. If not signed in, STOP and wait for the user to choose — sign in, or continue offline with local MusicGen — before generating the track; don't write keys into a per-repo `.env`. (In autonomous mode, note the status and continue offline.) See `/hyperframes-media` → Preflight for the canonical guidance. Either way the track lands at `assets/bgm.mp3`. Stage any user-supplied images or videos so frames can weave them in on the beat grid; otherwise typography carries the whole video.
23
24	Initialize only if `hyperframes.json` is missing. Name `<project>` from the brief in kebab-case, such as `midnight-drive-loop` — never a timestamp. `init` checks the installed skills against the latest on GitHub and updates the global set if any are out of date.
25
26	```bash
27	npx hyperframes init "videos/<project>" --non-interactive --example=blank
28	mkdir -p "$PROJECT_DIR/assets" "$PROJECT_DIR/renders"
29	cp "<user-music>" "$PROJECT_DIR/assets/bgm.mp3" # extract from a video first if needed
30	# only if the user gave you images/videos:
31	node <SKILL_DIR>/scripts/stage-assets.mjs --from <dir> --hyperfr

People who liked this also viewed

6 picks

Type