Major Update #1: Gradio 4 Engine

[lllyasviel]

New Gradio

Gradio 4 finally landed.

The updated version is Gradio 4.39.0, the lastest version at 2024 July 26.

We finally have this:

Thanks to the very open HTML envs provided by Gradio 4, it is finally possible to control the website with nearly arbitary HTML/JS loaders. We worked with ChatGPT to created the Forge Canvas based on Gradio 4.

Keep this note:

Left Mouse Button: drag and drop image as a file, or draw on the canvas.

Right Mouse Button: drag the image.

Mouse Wheel: zoom in or out.

Note that to drag the image, you use Right Mouse Button! Not the left button!

The left mouse button drag is for dragging the image as a file to other websites or even outside browser.

Basics:

Change View Size:

Perfect Transparency Support:

Zoom-aware Brush Size:

Brush Width, Alpha, Softness:

(128 level Wacom pen pressure support)

Extreme Detail Modification:

Full Screen in One Click:

Mask Mode for Inpaint (now you never worry about brush color being invisible when it is similar to image color):

Photoshop Clipboard Format Support:

Compatibility

Since Gradio 4 is very different, some extensions may be broken.

However, in my last test, about 70% extensions still work, including adetailer, prompt expansion, tagger, etc..

So maybe the problem is not that difficult.

If broken, most extensions only need several lines of codes to fix.

[lllyasviel]

see also #854

[themaxaboy]

@lllyasviel I've read your Forge Status about Gradio 4 UIs. Currently it's Normal status. I think I found a bug about using Batch with Upload or Path not working. Tested in img2img and extra tab.

[kusobabaa29]

Thank you for updating to gradio 4, it feels really comfortable to use for img2img, inpaint, etc. You're so amazing to make all these useful tools and make it available for everyone!

[aimarxjg]

感谢敏神，哇，小铅笔图标坏了1年多了！！！！终于修好了😫

[CCpt5]

Love that you're back working on Forge lllyasviel !!

Curious if anyone else is having an issue maximizing the live preview during inference w/ a double mouse click? The image will maximize fine w/ a double click if nothing is processing, but during inference a double click on the generating images doesn't open the live preview as expected.

Figure this may be a Gradio4 thing - but I'll try a clean install to see if it persists - if so I'll make a bug report......minor thing.

[Koxae]

The ADetailer is not working

[neldot70]

Hello. This latest update is a disaster for me. WEBUI Forge doesn't work anymore.

When launching it says "Stable diffusion model failed to load" and if I try to generate an image, every model I use it returns this error:
TypeError: 'NoneType' object is not iterable

Please, anyone can help? Can I downgrade to something that works? Thanks.

[Koxae]

Remove all extensions. One of them is incompatible with the new version. I had the same problem. Half of the extensions I use are incompatible with the new version of Forge

[neldot70]

Thanks for your help, Koxae.
I have just a basic understanding of the program, but I think I just installed several Loras and Checkpoints, but not other extensions.

Where should I check and remove the extensions that you mention? Thanks in advance.

[Koxae]

Installed extensions are located at "Path to forge\webui\extensions". If this directory is empty, then the problem is somewhere else. Sorry if my advice does not help.

[ZafariJ0e]

after the latest update the loras no longer work , Does anyone have that problem?

[vhanla]

Gradio updated to 4.40.0 and index.js throws this error:
Could not get api details: Request constructor: http://127.0.0.1:7860http://127.0.0.1:7860/info is not a valid URL.
Tried with previous versions and --skip-install, and found that 4.36.1 doesn't fail on that part. I noticed the UI became too slow.
BTW: I'm using Python 3.11 on Windows 10 and 11 and disabled extensions.

[fgtm2023]

Gradio updated to 4.40.0 and index.js throws this error: Could not get api details: Request constructor: http://127.0.0.1:7860http://127.0.0.1:7860/info is not a valid URL. Tried with previous versions and --skip-install, and found that 4.36.1 doesn't fail on that part. I noticed the UI became too slow. BTW: I'm using Python 3.11 on Windows 10 and 11 and disabled extensions.

thanks a lot for pointing that gradio is the problem, i solved my problem here: #1562 by this:
1- replaced gradio==4.40.0 to gradio==4.42.0 in requirements_versions.txt
2- pip install -r requirements_versions.txt --upgrade

[vhanla]

Actually, it still shows that error on 4.42.x and newer, I have tried 4.44.0 and it seems that gradio-client-1.4.0.tgz which contains the dist js scripts, doesn't make sure to check more than 2 colons in the URL in index.js file in this part:

function resolve_root(base_url, root_path, prioritize_base) {
  if (root_path.startsWith("http://") || root_path.startsWith("https://")) {
    return prioritize_base ? base_url : root_path;
  }
  return base_url + root_path; //<---- this part is not error safe
}

I just used 7-zip to open index.js in dist directory within the archive, and edited to return only root_path instead of that concatenation.
However, it has to be done after installing gradio with pip, due caching, and uninstalling or upgrading will install gradio-client-1.4.0.tgz in site-packages/gradio/_frontend_code/client within the python's lib path.

I suppose return base_url + root_path should validate a correct URI, because http://domain:port should allow two colons maximum, but in this case, it has 4 colons, which obviously is not valid. I hope they'll fix. However, I really don't know why this fails in the first place, as it seems other users do not face this issue.

[E2GO]

@lllyasviel Nice additions for inpaint process! Appreciated! I have some suggestions for the Inpainting Process (because working a lot with inpainting and as a tablet user):

1. Add an option to enable or disable mouse scroll on the inpaint window. Reason: When the mouse cursor is over the inpaint window and you try to scroll the Forge, you might accidentally zoom in or out of the inpaint window.
2. Separate the controls for resetting the mask editing and resetting the view, or add an enable/disable option for this feature. Now - clearing mask also resets window.
3. Introduce shortcuts for resizing the brush size, such as the [ ] keys, similar to Photoshop. This would be particularly useful when using a tablet.
4. Allow erasing already painted mask by holding down the ALT key.
5. Enable the ability to continue drawing the mask even when the cursor moves outside the canvas, preventing interruptions when the mouse goes out of the image.

[hpx502766238]

#Image to Image, Resize and Fill,
#AUTOMATIC1111/stable-diffusion-webui#10504
Even with the new Forge Canvas,this problem still exist:Cannot expand the canvas in selected directions,It always expands picture from center.

[photodarren]

I have a Mac and when I right click I get a menu. I can't move my image around. And if I maximise, I can't minimise. How is that supposed to be done? Esc key doesn't work. THere's no button to click on that I can find. How do I minimise, and how do I move my image with my mouse?

[xuguozhi]

How about sd-webui-controlnet extention?