enhancr is an elegant and easy to use GUI for Video Frame Interpolation and Video Upscaling which takes advantage of artificial intelligence - built using node.js and Electron. It was created to enhance the user experience for anyone interested in enhancing video footage using artificial intelligence. The GUI was designed to provide a stunning experience powered by state-of-the-art technologies without feeling clunky and outdated like other alternatives.

It features blazing-fast TensorRT inference by NVIDIA, which can speed up AI processes significantly. Pre-packaged, without the need to install Docker or WSL (Windows Subsystem for Linux) - and NCNN inference by Tencent which is lightweight and runs on NVIDIA, AMD and even Apple Silicon - in contrast to the mammoth of an inference PyTorch is, which only runs on NVIDIA GPUs.

Features

• Encodes video on the fly and reads frames from source video, without the need of extracting frames or loading into memory
• Queue for batch processing
• Live Preview integrated in the UI, without impact on performance
• Allows chaining of interpolation, upscaling & restoration
• Offers the possibility to trim videos before processing
• Can load custom ESRGAN models in onnx & pth format and converts them automatically
• Has Scene Detection built-in, to skip interpolation on scene change frames & mitigate artifacts
• Color Themes for user customization
• Discord Rich Presence, to show all your friends progress, current speed & what you're currently enhancing
• Realtime Player (assuming you have a powerful enough GPU) with perfect support for audio, subtitles, fonts, attachments etc.
• ... and much more

Installation

Release 0.9.9 features a free version 🎉 https://dl.enhancr.app/setup/enhancr-setup-free-0.9.9.exe

To ensure that you have the most recent version of the software and all necessary dependencies, we recommend downloading the installer from Patreon. Please note that builds and an embeddable python environment for the Pro version are not provided through this repository.

Built-in engines

Interpolation

RIFE (NCNN) - megvii-research/ECCV2022-RIFE - powered by styler00dollar/VapourSynth-RIFE-NCNN-Vulkan

RIFE (TensorRT) - megvii-research/ECCV2022-RIFE - powered by AmusementClub/vs-mlrt & styler00dollar/VSGAN-tensorrt-docker

GMFSS - Union (PyTorch/TensorRT) - 98mxr/GMFSS_Union - powered by HolyWu/vs-gmfss_union

GMFSS - Fortuna (PyTorch/TensorRT) - 98mxr/GMFSS_Fortuna - powered by HolyWu/vs-gmfss_fortuna

CAIN (NCNN) - myungsub/CAIN - powered by mafiosnik/vsynth-cain-NCNN-vulkan (unreleased)

CAIN (DirectML) - myungsub/CAIN - powered by AmusementClub/vs-mlrt

CAIN (TensorRT) - myungsub/CAIN - powered by HubertSotnowski/cain-TensorRT

Upscaling

ShuffleCUGAN (NCNN) - styler00dollar/VSGAN-tensorrt-docker - powered by AmusementClub/vs-mlrt

ShuffleCUGAN (TensorRT) - styler00dollar/VSGAN-tensorrt-docker - powered by AmusementClub/vs-mlrt

RealESRGAN (NCNN) - xinntao/Real-ESRGAN - powered by AmusementClub/vs-mlrt

RealESRGAN (DirectML) - xinntao/Real-ESRGAN - powered by AmusementClub/vs-mlrt

RealESRGAN (TensorRT) - xinntao/Real-ESRGAN - powered by AmusementClub/vs-mlrt

RealCUGAN (TensorRT) - bilibili/ailab/Real-CUGAN - powered by AmusementClub/vs-mlrt

SwinIR (TensorRT) - JingyunLiang/SwinIR - powered by mafiosnik777/SwinIR-TensorRT (unreleased)

Restoration

DPIR (DirectML) - cszn/DPIR - powered by AmusementClub/vs-mlrt

DPIR (TensorRT) - cszn/DPIR - powered by AmusementClub/vs-mlrt

SCUNet (TensorRT) - cszn/SCUNet - powered by mafiosnik777/SCUNet-TensorRT (unreleased)

System Requirements

Minimum:

• Dual Core CPU with Hyperthreading enabled
• Vulkan-capable graphics processor for inference with NCNN / DirectX 12-capable graphics processor for inference with DirectML
• Windows 10

Recommended:

• Quad Core Intel Kaby Lake/AMD Ryzen or newer with Hyperthreading enabled
• 16 GB RAM
• NVIDIA 2000 Series (Ampere) for TensorRT
• Windows 11

_{Sidenote: Starting with TensorRT 8.6, support for 2nd generation Kepler and Maxwell (900 Series and below) has been dropped. You will need at least a Pascal GPU (1000 series and up) and CUDA 12.0 + driver version >= 525.xx to run inference using TensorRT.}

macOS and Linux Support

The GUI was created with cross-platform compatibility in mind and is compatible with both operating systems. Our primary focus at the moment is ensuring a stable and fully functioning solution for Windows users, but support for Linux and macOS will be made available with the 1.0 update.

Support for Apple Silicon is planned as well, ~~but I currently only have an Intel Macbook Pro available for testing~~ i'll get a Apple Silicon instance on Amazon AWS to implement this, in time for the 1.0 release.

Benchmarks

Input size: 1920x1080 @ 2x

|| RTX 2060S ¹ | RTX 3070 ²| RTX A4000 ³ | RTX 3090 Ti ⁴ | RTX 4090 ⁵ |--|--|--|--|--|--| | RIFE / rife-v4.6 (NCNN) | 53.78 fps | 64.08 fps | 80.56 fps | 86.24 fps | 136.13 fps | | RIFE / rife-v4.6 (TensorRT) | 70.34 fps | 94.63 fps | 86.47 fps | 122.68 fps | 170.91 fps | | CAIN / cvp-v6 (NCNN) | 9.42 fps | 10.56 fps | 13.42 fps | 17.36 fps | 44.87 fps | | CAIN / cvp-v6 (TensorRT) | 45.41 fps | 63.84 fps | 81.23 fps | 112.87 fps | 183.46 fps | | GMFSS / Up (PyTorch) | - | - | 4.32 fps | - | 16.35 fps | | GMFSS / Union (PyTorch) | - | - | 3.68 fps | - | 13.93 fps | | GMFSS / Union (TensorRT) | - | - | 6.79 fps | - | - | | RealESRGAN / animevideov3 (TensorRT) | 7.64 fps | 9.10 fps | 8.49 fps | 18.66 fps | 38.67 fps | | RealCUGAN (TensorRT) | - | - | 5.96 fps | - | - | | SwinIR (PyTorch) | - | - | 0.43 fps | - | - | | DPIR / Denoise (TensorRT) | 4.38 fps | 6.45 fps | 5.39 fps | 11.64 fps | 27.41 fps |

¹ _{Ryzen 5 3600X - Gainward RTX 2060 Super @ Stock}

² _{Ryzen 7 3800X - Gigabyte RTX 3070 Eagle OC @ Stock}

³ _{Ryzen 5 3600X - PNY RTX A4000 @ Stock}

⁴ _{i9 12900KF - ASUS RTX 3090 Ti Strix OC @ ~2220MHz}

⁵ _{Ryzen 9 5950X - ASUS RTX 4090 Strix OC - @ ~3100MHz with curve to achieve maximum performance}

Troubleshooting and FAQ (Frequently Asked Questions)

This section has moved to the wiki: https://github.com/mafiosnik777/enhancr/wiki

Check it out to learn more about getting the most out of enhancr or how to fix various problems.

Inferences

TensorRT is a highly optimized AI inference runtime for NVIDIA GPUs. It uses benchmarki