Tales From the Cloud Data & Analytics Crypt #Microsoft Fabric Q&A #4: "What sets the 'Tables folder apart from the 'Files' folder? "

Tales From the Cloud Data & Analytics Crypt #Microsoft Fabric Q&A #4: "What sets the 'Tables folder apart from the 'Files' folder? "

In the cryptic depths of the Lakehouse, two folders emerge, each with its own enigma. Delve into the mysterious realm of data storage, where the veil between order and anarchy hangs by a thread.

What sets the "Tables" folder apart from the "Files" folder? Within the confinements of the Lakehouse's arcane architecture, where secrets lurk and data takes shape, a distinction unfolds.

The "Tables" folder, a realm of control and management, unveils its purpose. Here, managed tables find their sanctuary. They appear as formidable entities, meticulously organized within this sacred space. Every table, born of deliberate intent or automated creation, resides under the watchful gaze of the Lakehouse's authority.

But lo! Beyond this domain lies the treacherous "Files" folder, a dark abyss of unmanaged chaos. Here, data thrives in diverse file formats, unrestrained and untamed. Yet, the Lakehouse refuses to recognize Delta Lake format files stored in this wicked territory as tables. To summon order amidst this anarchy, one must meticulously create an external table, explicitly designating the location pointer to the unmanaged folder that harbors the elusive Delta lake files.

So, intrepid seeker of knowledge, heed this riddle: What secrets lie within the "Tables" folder that grant structure and governance, and what mysteries lurk in the "Files" folder, where unmanaged data roams free? Unveil the truth and unravel the enigma that sets these folders apart.

Micha? Pawlikowski

Data Solutions Tech Lead at Elitmind, Music Composer & Piano Player at Home ;)

1 年

As a self-proclaimed fearless seeker of knowledge, I come with a challenge that many daredevils must take up someday. How to make one simple and consistent backup of both data, structure and permissions in the lakehouse architecture taken at a given time, as it has been done so far, e.g. in SQL Server? Have a nice weekend!

回复
Pawel Potasinski

CTO at InfiniteDATA Services

1 年

"Power, unlimited power!" ;-)

要查看或添加评论,请登录

Bartlomiej Graczyk的更多文章

社区洞察

其他会员也浏览了