NokiMo
Furkan Gözükara
Furkan Gözükara

patreon


Ultimate Diffusion based SECourses Video Upscaler App Almost Ready - I need your feedback

Update 1: RIFE FPS Increase Interpolation Implemented

Ultimate Diffusion based SECourses Video Upscaler App Almost Ready - I need your feedback Ultimate Diffusion based SECourses Video Upscaler App Almost Ready - I need your feedback Ultimate Diffusion based SECourses Video Upscaler App Almost Ready - I need your feedback Ultimate Diffusion based SECourses Video Upscaler App Almost Ready - I need your feedback Ultimate Diffusion based SECourses Video Upscaler App Almost Ready - I need your feedback Ultimate Diffusion based SECourses Video Upscaler App Almost Ready - I need your feedback

Comments

i may after release

Furkan Gözükara

can you please add this to your video enhancer https://iceclear.github.io/projects/seedvr2/

Philip Heggie

Thanks a lot for comment. Yep I develop on RTX 5090 but it works on all GPUs . I have RTX 3090 ti as well to test

Furkan Gözükara

Very much looking to trying out this video upscaler on my RTX5090!

Erwin Hartsuiker

awesome so your feedback will be immensely important to me.

Furkan Gözükara

This looks promising. The cancel option you mentioned will be an important addition. I would have to get familiar with the program before making any suggestions. I do quite a bit of video editing and have work flows based on what I'm trying to achieve. I also have 6 or so paid programs I use on a regular basis. I think with AI upscaling, the most important feature for me is the ability to toggle face upscale on or off. I would normally add detail and grain well before considering AI for upscailing facial features.

Lou

thanks a lot. adding dynamic FPS reduce first feature so the time it takes to upscale can be shortened and later we can do fast RIFE FPS increase

Furkan Gözükara

his knowledge has increased and demands for his ai knowledge has increased, prices have increased, naturally sub price go up as well. still cheap and well worth it!

Ava Frigg

why are you increasing price of subscription and fastly. you are forcing person like me to leave you, who really and keenly interested in AI and your wark. I AM your subscriber from beginning of 2024

Anshul Gupta

I'm excited to try this out. Thank you for putting it together.

EnjoyerOfAll

ye those are all fake upscales. this is real diffusion based upscale. perhaps you can upscale very big rest 1 frame by 1 frame but that reduces quality I plan to add fake upscales as well like ESRGAN based which you can use to upscale further after diffusion upscale

Furkan Gözükara

can you elaborate more ? batch processing will save same file name as input. single processing saves as 0001 0002 0003 etc

Furkan Gözükara

thanks nice ideas. i plan to release hopefully soon

Furkan Gözükara

I think this is looking perfect, it would be a great first release, we can then compare its results with Topaz Starlight (this release might be even better already) and vs other tools to improve it if needed. Just to add ideas in case you think they fit (now or in the future): Check "SVFR: AI Video Upscaling: Enhancing Low-Res Footage", maybe any of the SVFR like the video impainting (to remove unwanted stuff like watermarks or other) and also has black and white video coloring. That said, there's also a 2D video to 3D converter (https://github.com/nagadomi/nunif/tree/master/iw3) in case it also fits (not sure if this is the best current 2D to 3D solution though). Thanks for the update.

Zow

Maybe lora options could be added to help keep the likeness, with it trained on whatever ai it uses.

cool1

My main concern would be to preserve likeness on a face while also fixing slight artifacts or adding detail. Sometimes it can be good at adding detail, but then lose some of the likeness. So a setting that is designed to balance those two things, with an emphasis on preserving facial likeness

J D

Looks awesome! One suggestion for the output tab- include option to input custom filenames for each file type with duplicate filename checking!

Steve

In the Topaz video AI upscaler (an older version) there's an option to upscale to 7680x4320 (and it's possible to upscale to that on my 3090). The max target width slider in the Star video upscaler screenshot shows it goes up to 4096 wide. Could it go up to 7680x4320 on normal GPUS (eg. RTX3090)? Maybe it could also allow you to change the frame rate like the topaz one could (eg. convert 24 fps to 60 fps with interpolation, convert a video to slow motion etc.). Also in the GUI it's got "max target height" then "max target width". Normally I think things ask for width first so it might be a bit easier if those two were re-ordered. From the screenshots it seems to split it by scene and has an option to describe scenes (using CogVLM2). I think it could be good and helpful if there was something like this (maybe another app) that like the "critique" option in JoyCaption beta 1 (for critiquing images as if by an art critic) if you could have an option where it critiqued a whole short film based on multiple scene descriptions and could suggest changes that could make it better (like re-ordering scenes, cutting sections out, adding things etc.).

cool1


Related Creators