A character is matted out of source footage, depth-mapped, then relit frame-by-frame with an IC-Light ControlNet driven by a hand-painted light map, with AnimateDiff-based motion modules used to stabilize the relit sequence.
Properties
family
image-to-video
modality
video -> matte + depth -> per-frame relight -> temporally-stabilized video
whyMultiModel
IC-Light is an image relighting model with no native temporal awareness; matting isolates the subject from background contamination, depth conditioning keeps the relighting geometrically consistent, and a motion module is needed to prevent frame-to-frame lighting flicker.
steps
[object Object], [object Object], [object Object] +1 more
