ProductionKōda @aimikoda2026-10-230:27

Beat-synced manga-style music edit

Views
20K
Likes
421
Replies
27
Saves
416

Claude Opus turned attached footage and music into a beat-synced manga-style music edit entirely with code.

Full prompt4,500 chars

Turn the attached footage into a beat-synced, manga-style music edit and send me the finished MP4.

INPUTS (fill in or leave blank; if blank, choose sensibly and tell me what you chose)
- Source footage: [attached]
- Music: [attached track / use the source audio]
- Aspect ratio: [default 4:3 1440x1080; 9:16 1080x1920 for vertical], 24 fps
- On-screen text / credit: [optional]
- Palette: [default: paper #f8f2ea, ink #141012, main accent red #d0141e (shadow #7c0a12), highlight yellow #ffd60a (shadow #f29a00)]

GOAL
The edit should feel like a living manga page: ink lines, screentone, flat accent colours, bold graphic backgrounds, and hard cuts locked to the music. It must look designed, not like a filter over video.

1. STUDY THE MATERIAL
- Go through the footage frame by frame using contact sheets. Catalogue every usable moment: framing, pose, motion peaks, internal cuts, and strong details (eyes, hands, silhouettes, close-ups, crash zooms).
- Analyse the music: BPM, beat grid, downbeats, phrases, sections, energy curve, accents, fills, ending.

2. LOCK THE LOOK (applies to every shot)
- Mask the subject on every frame (rembg isnet-anime for anime or illustration, a human-segmentation model for live action). Check mask quality before relying on it.
- Ink lines via XDoG/DoG, with thickness scaled to the framing.
- Paper base. Mid-tones become halftone dots: fixed screen angle, area-correct radius. The deepest shadows become solid ink.
- Strict palette: paper + ink + one main accent + one highlight.
- Map the subject's most distinctive colour to the flat main accent.
- Map glowing or brightest elements to the highlight.
- Everything else stays monochrome.
- Tune tones per shot so faces read clean (mostly paper, light screentone).
- Give subject cut-outs a thin ink outline when composited over graphics.

3. DESIGN YOUR OWN SHOT VOCABULARY
Based on what this footage does well and what this music needs, define 6-10 recurring shot types. Each type pairs a kind of source framing with a graphic treatment. Draw from this palette or invent your own:
- extreme close-up of a detail with impact shake
- silhouette over a bold graphic (concentric rings, rays, burst)
- clean black-and-white manga panel with a lightened background
- subject cut-out over a graphic ground (halftone texture, printed-page texture, blobs, speed lines, flat colour)
- typographic panel (large vertical CJK or bold type, plus small secondary lines; all text original)
- impact marks (!!, stars, sparkles)
- black or flash frames
- glitch frames (channel split, slice offset, magenta/yellow)
- tinted frames (pink, red, mono)
- halftone-dissolve transitions
- punch-ins and crash zooms
Rules:
- Every type must use something the footage genuinely does well.
- Save the strongest images for the strongest musical moments.
- Briefly justify each type.

4. PLAN A FRAME-ACCURATE EDL BEFORE RENDERING
List start/end frame, shot type, source frames, framing, motion, transition and text for every shot. Rhythm rules:
- Cut 1-2 frames before the beat.
- Mix durations: 3-6 frame hits against 1-2 beat holds, with at least one breathing moment per phrase.
- Build a recognisable 8-beat (or phrase-length) pattern and repeat it, using different source footage each time.
- Let the energy follow the music:
- a calm intro (for example desaturated, with only the highlight in colour)
- dense peaks
- an outro where colour drains, glitches escalate, and the edit fades with the music
- Land gestures and motion peaks in the footage on musical accents.

5. MOTION AND FINISH
- Animate the subject on twos. Keep camera moves (zoom, drift, rotation) smooth on every frame.
- Use shake and scale bumps on hits, with subtle film grain.
- An optional small HUD element (for example a timecode box) is fine.

6. PREVIEW, FIX, RENDER, VERIFY
- Before the full render, render one frame per shot as a preview sheet. Fix composition, mask errors, text cut-offs and palette breaks.
- Render, then review the whole output on contact sheets, fix problems and re-render the affected frames.
- Encode H.264 at CRF ~20-22 with AAC 192k, synced to the music at the same length.

QUALITY BAR
- Every frame could pass as a printed panel.
- No muddy greys, no unmasked background smears, and no accidentally cropped text.
- Dot size stays consistent.
- Outside glitch frames, no more than two colours appear besides paper and ink.

DELIVER
The MP4, plus a short summary of the shot types you invented and where they land in the edit.

Source: the creator's reply under the post. Kept in its original language, unedited.

Needs your own reference assets: besides the text prompt, the creator supplied images, video, audio, documents or a codebase, which are not hosted here. The prompt alone will not reproduce the result.

Tools the creator mentioned

rembg isnet-animeXDoG/DoG

Original post: https://x.com/aimikoda/status/2113764485429125125

All works are open data at GitHub · awesome-opus-5.5-video.

Model attribution is as stated by the creator and was not independently reproduced. View counts are a snapshot from 2026-10-25. The work belongs to its creator; DM @GoSailGlobal on X for corrections or removal.

More production