Week 7 2021 Fall

Homework:

• Watch these short videos:
  • Introduction to Runway, part1, part2
  • Intro to ML with Runway
• Create videos/images/text using Runway models
• Or Build a sketch using Runway's model in p5.js or Processing
• Or use Photoshop or Unity Runway plugin to process images or build a game scene
• Add your blog/project link below

See demos live

Runway Network

• AttnGAN(text to image) with Runway and p5js, See instruction
• im2txt with Runway and p5js, See instruction
• ColoringBook Runway, See instruction
• deeplab Runway, Need to run deeplab at http://localhost:8000 in Runway
• GPT2 with Runway and p5js, See instruction
• CycleGAN with Runway and p5js, See instruction
• Photo Style Transfer with Runway and p5js, See instruction(Run midels at http://localhost:8000)

Runway Hosted Models

• Adain Style Transfer with Runway and p5js (host models in runway and update the model url and auth in the code)
• U2net Background remover (host models in runway and update the model url and token in the code)
• Faces to flowers mirror (host models in runway and update the model url and token in the code)
• Cartoon Mirror (host models in runway and update the model url and token in the code)

Resource:

• Get started with Runway
• Creating a custom GPT-2 Slack Bot with RunwayML’s hosted models.
• Runwayml with p5.js
• Runway with Processing
• Runway with Photoshop
• Runway with Unity
• Made with Runway

Add your name / link to your assignment below

• Your name, [Project name](Project Link), Project Description
• Sara, Trying out RunwayML, trying out a few model on RunwayML
• Mingxi, Just Something Weird
• Wendy, Runway Models
• Nart, Experiments with Text Generation in RunwayML
• Marcel, play with Deoldify model
• jenny (tried out a few models https://jennywangyw.wixsite.com/nyuitp/post/stylegan)