Welcome to this Microsoft solutions workshop on Microsoft Fabric for the Data Professional. Microsoft Fabric is an end-to-end analytics solution with full-service capabilities including data movement, data lakes, data engineering, data integration, data science, real-time analytics, and business intelligence—all backed by a shared platform providing robust data security, governance, and compliance.
In this workshop, you'll learn what the Microsoft Fabric platform is, the various services and components it contains, how to create, use and manage a deployment, from the point of view of the data professional.
The focus of this workshop is to understand how to use Microsoft Fabric in a solution, focusing on the data aspects of the platform.
You'll start with an introduction to Microsoft Fabric, move on to understanding Workspaces, user security, and data governance. From there you'll learn about the Data Lakehouse, and then understand the developer and user experience of Microsoft Fabric. You'll end with a section on the DevOps of a Microsoft Fabric solution, with a focus on how to extrapolate what you have learned to create other solutions for your organization.
This github README.MD file explains how the workshop is laid out, what you will learn, and the technologies you will use in this solution. To download this Lab to your local computer, click the Clone or Download button you see at the top right side of this page. More about that process is here.
You can view all of the Workshops and other workshops our team has created at this link - open in a new tab to find out more.
In this workshop you'll cover these topics:
- Introduction and Overview: Introduction of the Workshop, Basic Concepts, Services, Roles, Benchmarks. Verification of pre-requisites
- Data Warehouse and Data Integration: Understanding and creating Workspaces, creating a Data Warehouse, connecting and managing, ingesting data with pipelines and data flows
- The Data Lakehouse: Creating a Lakehouse, Linking data, using Spark to create new data sets in the Lakehouse
- The Fabric Developer Experience: Using Co-Pilot, SSMS, VS Code, and development best-practices
- Real-Time Analytics with Microsoft Fabric: Working with Azure Data Explorer in Microsoft Fabric, Working with Fabric and Streaming / Event Data, and Working with Fabric and the Kusto Query Language (KQL)
- Microsoft Fabric DevOps: Design, Sizing, Monitoring and Management, Source Control, and the EXPLAIN command.
The goal of this workshop is to train the data professional to get an overview on how to determine when to implement a Microsoft Fabric solution, how to design the solution, implement it, use it, and manage, monitor and maintain it.
In each Module, you will find Sections that have topics, concepts and technologies that you will cover throughout the Workshop. You will also find various Activities where you willwork through hands-on steps to learn the material. You will also see Self-Guided Activities that you should complete after an in-person experience, or along the way if you are taking this Workshop directly from this GitHub repository.
The solution includes the following technologies - although you are not limited to these, they form the basis of the workshop. At the end of the workshop you will learn how to extrapolate these components into other solutions. You will cover these at an overview level, with references to much deeper training provided.
| Technology | Description |
|---|---|
| OneLake | Serves as the foundation storage layer for all other services, and as a Data Lake. |
| Data Factory | A fully scheduled cloud service for data pipelines. |
| Synapse | The primary Data Lake, Data Warehouse, Data Science, and Data Analytics distributed processing system for the platform. |
| Microsoft Power BI | Closest-to-user interface for data analysis. |
You'll need a local system that you are able to install software on. The workshop demonstrations use Microsoft Windows as an operating system and all examples use Windows for the workshop. Optionally, you can use a Microsoft Azure Virtual Machine (VM) to install the software on and work with the solution.
- You must have a Microsoft Azure account with the ability to create assets.
- You will need a laptop to work through the examples, access the workshop materials, and take notes.
This workshop expects that you understand data architectures, working with large data sets, data security, data analysis, and data pipelines.
If you are new to these, here are a few references you can complete prior to class:
A full pre-requisites document is located here. These instructions should be completed before the workshop starts, since you will not have time to cover these in class. Remember to turn off any Virtual Machines from the Azure Portal when not taking the class so that you do incur charges (shutting down the machine in the VM itself is not sufficient).
This is a modular workshop, and in each section, you'll learn concepts, technologies and processes to help you complete the solution.
| Module | Topics |
| 01 - Introduction and Overview | Introduction of the Workshop, Basic Concepts, Services, Roles, Benchmarks. Verification of prerequisites. |
| 02 - Desktop Tools to use with Microsoft Fabric | Understanding what desktop tools interface with Microsoft Fabric and how to use them. |
| 03 - Data Warehouse and Data Integration | Understanding and creating Workspaces, creating a Data Warehouse, connecting and managing, ingesting data with pipelines and data flows |
| 04 - The Lakehouse | Creating a Lakehouse, Linking data, using Spark to create new data sets in the Lakehouse |
| 05 - Database Mirroring | Introduction to Mirroring in Microsoft Fabric and how to utilize Mirroring as a Data Integration tool |
| 06 - Real-Time Analytics with Microsoft Fabric | Azure Data Explorer, Fabric and Streaming / Event Data, the Kusto Query Language (KQL) |
| 07 - Copilots & AI Skills | Microsoft Fabric integrates AI and LLM capabilities to assist you in creating your data workloads. Additionally you can use AI Skills to create RAG patterns off of your data to produce additional insights. |
Next Steps
Next, Continue to Pre-Requisites
This project welcomes contributions and suggestions. Most contributions require you to agree to a Contributor License Agreement (CLA) declaring that you have the right to, and actually do, grant us the rights to use your contribution. For details, visit https://cla.opensource.microsoft.com.
When you submit a pull request, a CLA bot will automatically determine whether you need to provide a CLA and decorate the PR appropriately (e.g., status check, comment). Simply follow the instructions provided by the bot. You will only need to do this once across all repos using our CLA.
This project has adopted the Microsoft Open Source Code of Conduct. For more information see the Code of Conduct FAQ or contact opencode@microsoft.com with any additional questions or comments.
Microsoft and any contributors grant you a license to the Microsoft documentation and other content in this repository under the Creative Commons Attribution 4.0 International Public License, and grant you a license to any code in the repository under the MIT License.
Microsoft, Windows, Microsoft Azure and/or other Microsoft products and services referenced in the documentation may be either trademarks or registered trademarks of Microsoft in the United States and/or other countries. The licenses for this project do not grant you rights to use any Microsoft names, logos, or trademarks. Microsoft's general trademark guidelines can be found at http://go.microsoft.com/fwlink/?LinkID=254653.
Privacy information can be found at https://privacy.microsoft.com/en-us/
Microsoft and any contributors reserve all other rights, whether under their respective copyrights, patents, or trademarks, whether by implication, estoppel or otherwise.