VR Settings

[spoonsc2]

Hey all! I've read the forums and got an idea of some settings for VR.

What combinations have people found that work well?

[talbertj20]

I have stopped using the feature because i don't notice that it works. What settings have you found if you don't mind sharing?

[C0untFloyd]

It's working for SBS videos without much lense distortion.

[Elise96nl]

i use this for my VR videos, but you should lose the last swapped, because when there is no face, it skips that part of the video.

I uploaded a little preview, with the result with these settings. Dont forget to check the VR box.

[Elise96nl]

I started with a new VR project, but now i notice the problem aswell. The fish eye effect, makes it only really good when the face is in the center of the picture. You have to cherry pick pieces of video, and if you really want to do a whole VR video.

you can put the VR 180 video in davinci, and undo the fish eye. Then put it in roop to faceswap, en then back to davinci encode to put the fish eye effect back on. But its not perfect.

Dewarping (removing the lens distortion) before giving it to faceswap and adding it back after faceswap does help, but it's not a miracle cure. This partially addresses "reason 4" about stretched our and distorted faces. Here's what it will do: It will help faceswap recognize more faces that got too close to the edge and are stretched out. Not by a large amount though, with a moderate amount dewarping, I estimate Faceswap recognized about 10-15% more faces than it would have if I didn't dewarp it. That was a little disappointing as I was hoping it would "save" every single frame faceswap misses because of that distortion effect. The more important thing is that it really helps correct the shape of all those faces in that light green zone from my picture above, so faceswap will have a better conversion on them, and then once faceswap is done with it and you add the lens distortion back to the video, your faces are now properly distorted! So now they will be properly projected onto the inside of your headset. This also has some effect on the dark green zone in my picture above, but to a very minimal amount since they aren't that distorted to begin with. This however comes with some downsides, and it seems to be an area that I'm not properly understanding BryanLyon on. When you dewarp it before giving it faceswap, you are squishing all those pixels together on the edges of the sphere, and when you do this you lose pixel quality for those pixels affected. After faceswap is done with the file you add the distortion back to it, you are basically stretching those pixels on the edges back out, and if you ever stretched an image in MSpaint, I'm sure you'd realize how low quality that can look. Now bryanlyon has this solution for this below that if I'm honest, doesn't make any sense to me at all; But I realized something. This problem, technically isn't a problem for you. Yes the edges of my 5400x2700 video have had there quality damaged. ............But my headset can't even do 5400x2700. When I played the video with the damaged edge pixels, my headset was low enough resolution that it literally made no difference and looked 99% normal. So if you have an average VR headset like myself, and your doing a vr video that's high res, then you don't have to worry about this.

@C0untFloyd i was about to link you the VRswap github , but i found out that you already implemented this

VR Lense Distortion

Taken from https://github.com/g0kuvonlange/vrswap

https://github.com/g0kuvonlange/vrswap

[C0untFloyd]

i was about to link you the VRswap github , but i found out that you already implemented this

Not implemented but ripped the relevant parts out of that repo, yes. They aren't used (yet) though! It takes some time to tweak and fit this into my standard process and so far there were more important things to do.

Interesting discussion you quoted there. I didn't know that there's a forum about faceswapping, although it seems it has seen better times. The software is some kind of tuned DFL rip-off, isn't it?