Data Engineering with MS Fabric

Microsoft Fabric went to general availability in November 2023. The one lake concept focuses on using delta tables to create medallion zones for your data. How do you extract, load, and transform data in Fabric?

The good news is that Fabric is just a re-organization of tools that are already familiar with.

To get data into the one lake you can use Azure Data Factory or Shortcuts. To transform data, you can use Data Flows or Spark notebooks. Finally, the SQL Analytic Endpoint or PBI semantic model can be used to present the data to the end users.

Also, I will be covering Fabric Data Warehouse for folks that like ANSI SQL and Kusto database for real time datasets.

Since this is a data engineering talk, there is no time to talk about reporting and governance. However, Power BI and Purview are available for your usage. We will be working the adventure works database, historical stock data, the pubs database and streaming vending machine datasets.

In short, this presentation is a must for data engineers that are tasked with Fabric development.