-
-
Notifications
You must be signed in to change notification settings - Fork 29
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
static scene masking trick #52
Comments
Interesting! :-)
-- Gesendet von /e/ Mail.
Am 2. April 2021 12:24:03 MESZ schrieb Bob ***@***.***>:
…before:
![image](https://user-images.githubusercontent.com/31782485/113407724-2dfbc780-93ae-11eb-9dbf-56f61bdfc3b2.png)
after:
![image](https://user-images.githubusercontent.com/31782485/113407755-3e13a700-93ae-11eb-8b7a-65904873015b.png)
--
You are receiving this because you are subscribed to this thread.
Reply to this email directly or view it on GitHub:
#52 (comment)
|
Hi. This idea sounds nice, so if I understand correctly you're suggesting a "passthrough" mask (not sure what it would be called) that would take precedence over the depth filtering, in order to allow to let some parts of the scene visible. How would that work? Full white = always visible and full back = depth filtering (default behavior), with grey being at least semi-visible (and fully visible if depth filtering passes)? Also, if I understand correctly, this is already possible using multiples source in OBS (one RGB source with mask and one faux green screen underneath or something like that). Note that I would still implement it as it seems useful (and pretty simple to do). |
Yes exactly you understood that well as me. "passthrough" mask sounds logicaly. Yes this trick can be handled with multiple kinect source, but is not comfortable when you scale layers (must be well aligned). Thank you SirLynix |
As long as you manage to get a stable 30 FPS I'd say it's good. |
Thank you. I dont know how solve this yellow exclamation marks in Configuration viewer, but i think now its functional. (propably more people have this state). |
Hi sir linx, what you think about this https://github.com/microsoft/ailab/tree/master/VirtualStage Microsoft use this https://grail.cs.washington.edu/projects/background-matting/ for making virtual green screen postproduction software. Maybee this technoogy can be integrated to this plugin :) Their make 5 sec of blank scene screen for help AI to learn what is needed to masking. Nice idea. |
I've found https://github.com/PeterL1n/BackgroundMattingV2 which is the evolution is this. It sounds really great, however I don't think it's related to obs-kinect since it doesn't require a Kinect (maybe I'm wrong but I have the feeling it doesn't benefit from the depth sensor). I think BackgroundMatting belongs to another OBS plugin (since it doesn't require a Kinect), made by someone who knows how to use tensorflow. |
@BobTape Sorry I took so long to implement this, but here you are, now available in obs-kinect last builds. The visibility mask works like this: white means always visible, black means never visible and fully transparent means default behavior (and of course you can use any color/alpha between these). Could you test it and let me know if it works as expected? (it's the green screen "visibility mask" option) |
Hi SirLynix i try it soon as posible. Thanx a lot for this. :) |
Hi SirLynx,
i will try to make new masking layer to your great Kinect plugin.
I think in scene are a lot of static object, that we need to preserve in scene, but they are sooo shiny and depth sensor have problem with depth detection on it (for example turnables with vinyl on it).
My idea is add to plugin new static layer with optional mask (some black and white mask (maybee with grayscale for smooth))
this layer have high priority above depth sensor mask.
(in first version i planing this layer you can make from any tool like a gimp from scene screenshot).
Result: static things in scene (microphone, desk and my dj stuff will always visible), because currently is on it a lot of depth sensor noise. This dramaticaly improves faux green screen efect on static scene, when is this type of masking needed.
Thanx for reply your ideas about it. I can help you with code, (after i learn how it works, because im not typical c++ guy, i currently work most only with c# and typescript).
Bob
The text was updated successfully, but these errors were encountered: