Resynthesize Video
Resynthesize Video - Use Frame Interpolation to synthesize replacement frames for an entire movie
- Create a set of replacement frames for use in movie restoration
- Video Blender can be used to selectively replace frames from a restoration set
- Set Input Path to a directory on this server to the PNG files to be resynthesized
- Set Output Path to a directory on this server for the resynthesized PNG files
- Output Path can be left blank to use the default folder
- The default folder is set by the
config.directories.output_resynthesissetting
- Click Resynthesize Video
-
Frame Interpolation is done using frames adjacent to each frame to interpolate replacements
- The first and last frame cannot be replaced
- When complete, the output path will contain a new set of frames
- Replacement frames can be used with Video Blender to restore a movie
- The original and restoration frames are provided
- This process could be slow, perhaps many hours long!
- Progress is shown in the console using a standard progress bar
- The browser window does NOT need to be left open
- When using a restoration frame set with Video Blender it's important to remove frame #0 from the original set of frames
- It's not possible to create a replacement for the first and last frames of the original video
- To keep the sets of PNG files synchronized while restoring a film, make sure original frame #0 is not present
- A video may have a single damaged frame between two clean ones
- Examples: a bad splice, a video glitch, a double-exposed frame due to frame rate mismatch, etc.
- AI excels at detecting motion in all parts of a scene, and will very accurately create a new clean replacement frame
- Replacement frames cannot be resynthesized without two CLEAN adjacent original frames
- Frame Restoration can be used to recover an arbitrary number of adjacent damaged frames
- Transitions between scenes will not produce usable resynthesized frames