Skip to content

Upscale Frames

Jump to bottom
Jerry Hogsett edited this page Jun 29, 2023 · 3 revisions

Screenshot 2023-03-06 163708

Upscale Frames - Use Real-ESRGAN to Enlarge and Clean Frames

Uses

  • Increase the size of video frames
  • Clean up dirty/deteriorated frames
  • Can be used to clean frames without upscaling

Important

Real-ESRGAN must be installed locally to use

  1. See the Resources tab or go to Real ESRGAN Github to access Real-ESRGAN repository
  2. Clone their repo to its own directory and follow their instructions for local setup
  3. Copy the realesrgan directory to your EMA-VFI-WebUI directory
  • The Real-ESRGAN 4x+ model (65MB) will automatically download on first use

How It Works

  1. Set Input Path to a directory on this server to the PNG files to be upscaled
    • JPG, GIF and BMP files will also be upscaled if found in the path
    • Tip: the config setting upscale_settings:file_types specifies the searched types
  2. Set Output Path to a directory on this server for the upscaled PNG files
    • If Output Path is set, upscaled files are saved as sequentially indexed PNG files with a fixed filename
    • When Output Path is left empty, upscaled files are saved to the input path using the original filename and format, and marked with the outscale amount.
  3. Set Frame Upscale Factor for the desired amount of frame enlargement
    • The factor can be set between 1.0 and 8.0 in 0.05 steps
    • Real-ESRGAN will perform upscaling when factor is > 1.0
      • Tip: It will remove dirt and noise even when not upscaling
  4. Choose whether or not to use Tiling
    • select Auto to ensure all files are processed
      • Files will be processed first for the best possible quality
      • Files that fail to process will be redone using tiling (see Yes option below)
    • Select No for the best quality.
      • Entire images will be upscaled at once
      • Files that cannot be processed due to VRAM limitations will be skipped
    • Select Yes if upscaling large images, or running into low VRAM conditions
      • Images will be upscaled in blocks then stiched together
      • Tiling Size and Padding (in pixels) are set using the config settings:
        • realesrgan_settings:tiling and realesrgan_settings:tile_pad
  5. Click Upscale Frames
  6. Real-ESRGAN is used on each frame in the input path
    • Frames are cleaned up, and enlarged if necessary
    • The new frames are copied to the output path
  7. When complete, the output path will contain a new set of frames
Clone this wiki locally