Azure Computer Vision in a day workshop

In this technical workshop, you will receive a thorough introduction to Azure Computer Vision and Azure Vision Studio. You will be taught how to utilize the new capabilities of Azure Computer Vision 4 to analyze images, including its multimodal features (Florence). Moreover, you will be able to investigate pre-existing solution accelerators and best practices for prototyping and deploying end-to-end use cases. Finally, the workshop will conclude with a Q&A session and a wrap-up.

Note: Some features are currently inpreview and the API may change in the future.

https://learn.microsoft.com/en-us/azure/cognitive-services/computer-vision/

1. Workshop agenda

🌅 Morning (9:00 – 12:00)

Focus: Introduction and images processing with Azure Computer Vision

📣 Azure Computer Vision presentation (30 min)
📣 Azure Azure Vision Studio (30 min)
📣 Intro Workshop (15 min)
🧑🏼‍💻 Azure Computer Vision setup (15 min)
🧑🏼‍💻 Image Analysis using Azure Computer Vision (15 min)
☕Pause (20 min)
🧑🏼‍💻 Dense captioning of images (15 min)
🧑🏼‍💻 Background removal with Azure Computer Vision (15 min)
🧑🏼‍💻 Gradio webapp example using the background removal from Azure Computer Vision (10 min)
🧑🏼‍💻 Image retrieval with Azure Computer Vision (images et text vectors embeddings) (15 min)

🌆 Afternoon (14:00 – 16:00)

Focus: Visual search usecase with Azure Computer Vision

📣 Recap (20 min)
🧑🏼‍💻 Fashion visual search - Images analysis (20 min)
🧑🏼‍💻 Fashion visual search - Images embeddings (20 min)
🧑🏼‍💻 Fashion visual search - Search using an image or a prompt - we will build a webapp as well (15 min)
🧑🏼‍💻 Fashion visual search - Images Clustering (15 min)
❓Conclusion and QnA session (30 min)

Legend: 📣 Presentation, 🧑🏼‍💻 Hands-on lab

2. Notebooks

Azure Computer Vision setup

00 Setup Azure Computer Vision

Image Analysis using Azure Computer Vision

01 Image Analysis

Dense captioning of images

02 Captioning and dense captioning

Background removal with Azure Computer Vision

03 Background removal

Gradio webapp example using the background removal from Azure Computer Vision

04 Gradio app for background removal

Image retrieval with Azure Computer Vision (images et text vectors embeddings)

05 Image retrieval

Visual Search demo based on a fashion images datasets using Azure Computer Vision

06 Fashion visual search - Images analysis

Visual Search demo (images vectors embeddings)

07 Fashion visual search - Images embeddings

Visual Search demo (Search using an image reference or a text)

08 Fashion visual search - Search using an image or a prompt

Visual Search demo (images clustering using images vectors embeddings)

09 Fashion visual search - Images Clustering

Visual Search demo (gradio webapp)

10 Fashion visual search - Gradio App

Note: You need to enter your Azure Computer vision endpoint and key in this .env file: azure.env

3. Azure Computer Vision presentation

Azure Computer Vision PowePoint presentation

4. Documentation

https://learn.microsoft.com/en-us/azure/cognitive-services/computer-vision/

5. Vision Studio

https://portal.vision.cognitive.azure.com

6. Azure Computer Vision 4 demos videos

Azure Computer Vision 4 (Florence) demos videos

Created: 19-Apr-2023
Updated: 04-May-2023

Serge Retkowsky | serge.retkowsky@microsoft.com | https://www.linkedin.com/in/serger/