Microsoft Data Platform News 2024 - Week 21

Content

Fabric

• Bring your on-premises data to OneLake!
• Easily connect your data with the new modern get data experience for data pipeline
• Introducing Data workflows in Microsoft Fabric
• Get started with User Data Functions in Microsoft Fabric
• Native execution engine for Fabric Spark
• Announcing Public Preview of the Microsoft Fabric Workload Development Kit
• Fabric CAT Tools Version 0.4.0
• Real-Time hub: Single place for data-in-motion for the entire organization (Public Preview)
• Introducing the Fabric UX System: Our resource for extending Fabric experiences
• Snowflake and Microsoft announce expansion of their partnership
• COPY INTO: support for firewall-enabled Storage & EntraID Authentication
• Unleashing the power of data for analytics applications with the new Microsoft Fabric API for GraphQL
• Download a Microsoft Fabric Data Warehouse database project to perform CI/CD using Azure DevOps
• Loading Incremental Changes from Dynamics 365 Finance and Operations Using Microsoft Fabric and Synapse Link
• Alerting and acting on data from the Real-Time hub

Excel

• Introducing Regex Excel Functions

Fabric

Bring your on-premises data to OneLake!

We’re excited to announce the public preview availability of OneLake shortcuts to on-premises and network-restricted data sources!

https://blog.fabric.microsoft.com/en-US/blog/bring-your-on-premises-data-to-onelake/

?

Easily connect your data with the new modern get data experience for data pipeline

We are excited to share the new modern get data experience in data pipelines provides an extremely simple way to connect to your data by intuitively browsing different Fabric artifacts through the OneLake datahub and getting you closer to the data in the quickest way possible.

https://blog.fabric.microsoft.com/en-US/blog/easily-connect-your-data-with-the-new-modern-get-data-experience-in-data-pipeline/

?

Introducing Data workflows in Microsoft Fabric

Data workflows in Microsoft Fabric is powered by the Apache Airflow runtime, and provides an integrated, cloud-based platform for development, scheduling, and monitoring python-based data workflows, articulated as Directed Acyclic Graphs (DAGs).

https://blog.fabric.microsoft.com/en-US/blog/introducing-data-workflows-in-microsoft-fabric/

?

Get started with User Data Functions in Microsoft Fabric

The User data functions item in Fabric is a collection of individual functions that share the same code file and configuration settings.

https://blog.fabric.microsoft.com/en-US/blog/10474/

?

Native execution engine for Fabric Spark

This vectorized engine optimizes the performance and efficiency of your Spark queries by running them directly on your lakehouse infrastructure.

https://learn.microsoft.com/en-us/fabric/data-engineering/native-execution-engine-overview?tabs=sparksql

?

Announcing Public Preview of the Microsoft Fabric Workload Development Kit

This feature allows to extend Fabric with additional workloads and offers a robust developer toolkit for designing, developing, and interoperating with Microsoft Fabric using frontend SDKs (Software Development Kits) and backend RESTful APIs (Application Programming Interfaces).

https://blog.fabric.microsoft.com/en-US/blog/announcing-public-preview-of-the-microsoft-fabric-workload-development-kit/

?

Fabric CAT Tools Version 0.4.0

Version 0.4.0 of hashtag#fabric_cat_tools is out! Tons of updates in this version.

https://www.dhirubhai.net/posts/michaelkovalsky_github-m-kovalskyfabriccattools-supercharge-activity-7195784854381199360-_mwt?utm_source=share&utm_medium=member_android

?

Real-Time hub: Single place for data-in-motion for the entire organization (Public Preview)

A single place for your streaming data-in-motion in Microsoft Fabric: Real-Time hub (preview)! Real-Time hub enables you to easily discover, manage, and consume data-in-motion from a wide variety of streaming sources.

https://blog.fabric.microsoft.com/en-US/blog/real-time-hub-single-data-in-motion-place-for-the-entire-organization/

?

Introducing the Fabric UX System: Our resource for extending Fabric experiences

This system is a collection of design guidance, common patterns, and reusable components created to empower designers and developers to build consistent, accessible, and engaging workload experiences across Fabric surfaces.

https://blog.fabric.microsoft.com/en-US/blog/introducing-the-fabric-ux-system-our-primary-resource-for-extending-fabric-experiences/

?

Snowflake and Microsoft announce expansion of their partnership

This will enable bi-directional data access?between Snowflake and Microsoft Fabric, ensuring more?efficient and flexible data management.

https://www.microsoft.com/en-us/microsoft-fabric/blog/2024/05/22/snowflake-and-microsoft-announce-expansion-of-their-partnership/

?

COPY INTO: support for firewall-enabled Storage & EntraID Authentication

COPY INTO support for EntraID Authentication and firewall-enabled Storage!

https://blog.fabric.microsoft.com/en-US/blog/copy-into-support-for-firewall-enabled-storage-entraid-authentication/

?

Unleashing the power of data for analytics applications with the new Microsoft Fabric API for GraphQL

With Fabric API for GraphQL, data engineers and scientists can create a data API to connect to different data sources in seconds, use the APIs in their workflows, or share the API endpoints with app development teams to speed up business data analytics application development.

https://blog.fabric.microsoft.com/en-US/blog/unleashing-the-power-of-data-for-analytics-applications-with-the-new-microsoft-fabric-api-for-graphql/

?

Download a Microsoft Fabric Data Warehouse database project to perform CI/CD using Azure DevOps

In this post I want to cover how you can download a Microsoft Fabric Data Warehouse database project to perform CI/CD using Azure DevOps.

https://www.kevinrchant.com/2024/05/20/download-a-microsoft-fabric-data-warehouse-database-project-to-perform-ci-cd-using-azure-devops/

?

Loading Incremental Changes from Dynamics 365 Finance and Operations Using Microsoft Fabric and Synapse Link

In this article, I will explain how to load data from Dynamics 365 Finance and Operations and Dynamics 365 Customer Engagement into a Fabric Lakehouse.

https://www.dhirubhai.net/pulse/loading-incremental-changes-from-dynamics-365-finance-allan-rasmussen-upmdc?utm_source=share&utm_medium=member_android&utm_campaign=share_via

?

Alerting and acting on data from the Real-Time hub

Data Activator provides a no-code experience for automatically taking actions when patterns or conditions are detected in changing data and is embedded around the Real-Time hub to make creating alerts accessible at all times.

https://blog.fabric.microsoft.com/en-US/blog/alerting-and-acting-on-data-from-the-real-time-hub/

Excel

Introducing Regex Excel Functions

Microsoft Excel just got a huge upgrade with new REGEX functions!

https://www.dhirubhai.net/feed/update/urn:li:activity:7199011433030791168/

Luká? Karlovsky

FABRIC | Power BI | Power Query | SQL | Data | DWH | Excel | VBA | Instructor

LinkedIn Profile

Joyful Craftsmen

Joyful Craftsmen is a data design and data engineering team. We’ve been learning and building data solutions since 2014. We focus on our vision to do the data craft as smartly as reachable. Humanity, teamwork and joy is part of our game, regardless you are our partner or one of us. Altogether we are valued for delivering cutting edge data solutions, on time, in top quality.

https://joyfulcraftsmen.com

https://www.dhirubhai.net/company/joyful-craftsmen