Skip to content

A demo using diffusion model and large language model for UI generation

Notifications You must be signed in to change notification settings

Jl-wei/ai-gen-ui

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

3 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

AI-Gen-UI

Getting Started

  1. Install poetry (https://python-poetry.org/docs/#installation)

  2. Install dependencies

poetry install
  1. Set the environment variable
export OPENAI_API_KEY=your_openai_api_key

Usage

UI Generation with Large Language Model

  1. Launch the LLM demo
python llm_demo.py
  1. Open http://127.0.0.1:7860 in your web browser

  2. In the textbox, enter your page description and click the "Submit" button

  3. You can also upload an HTML file and edit it by providing instructions in the textbox, such as "remove the footer of the page"

image

UI Generation with Diffusion Model

  1. Launch the DM demo
python dm_demo.py
  1. Open http://127.0.0.1:7860 in your web browser

  2. In the textbox, enter your page description and click the "Submit" button

image

Our UI-Diffuser-v2 model is available at https://huggingface.co/Jl-wei/ui-diffuser-v2

Citation

If you find our work useful, please cite our paper:

@misc{wei2024aiinspired,
      title={On AI-Inspired UI-Design}, 
      author={Jialiang Wei and Anne-Lise Courbis and Thomas Lambolais and Gérard Dray and Walid Maalej},
      year={2024},
      eprint={2406.13631},
      archivePrefix={arXiv}
}

Please note that the code and model can only be used for academic purpose.

About

A demo using diffusion model and large language model for UI generation

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages