Other Variants: ELT, EtLT, and Reverse ETL
Credit: DALLE Image Generation from OpenAI

Other Variants: ELT, EtLT, and Reverse ETL

What is ELT, and how is it different from ETL? ETL transforms the data before loading it into the data warehouse using a separate transformation server. ELT uses the processing capabilities of the target data warehouse to transform data. Data is loaded into the data warehouse and uses the familiar SQL semantics and power of the Massively Parallel Processing (MPP) architecture to perform the transformations within the data warehouse.

What is EtLT, and how is it different from ELT? One of the critical benefits of ELT is that data can be more quickly accessed. Data doesn't need to be landed in a staging area where it can be transformed and loaded before being accessed at the data warehouse. However, because data lands in the data warehouse in a raw form, ELT alone cannot always meet data security and compliance requirements – especially those that require you to mask, remove, or encrypt PHI and PII data before moving it into a data warehouse. That's where EtLT provides the "best of both worlds." The little "t" stands for a limited data transformation in the staging area, usually to remove/mask/encrypt PHI, PII, or other sensitive data. These transformations are fast because they transform each source independently of other sources. There is no attempt to integrate data sources until after loading.

What is Reverse ETL, and Do I Need It? Reverse ETL and related tools sync processed data from your data warehouse with your operational systems, thus further unlocking the value of your data warehouse. Instead of reacting to your data as it's persisted into a BI dashboard, Reverse ETL allows you to take a proactive approach and put it in the hands of your operational teams. Hence, they can directly take action in your business applications. Whether you need Reverse ETL depends on your strategy to act upon insights from your Data Warehouse. If you need to integrate data from your data warehouse into your customer service ticketing systems or sales CRM, then you likely need a Reverse ETL tool.

#DataEngineering, #DataWarehousing,#Data, #Analytics, #BusinessIntelligence



Robert M. Dayton

MBA, Engineer | Enterprise AI | Advanced Analytics | GTM Strategy | World's First Arbor Essbase Post-Sales Consultant

1 年

Thank you for sharing Mark!

回复
Devon Arscott

move data with Fivetran

1 年

Great overview, Mark Koss. It's funny, I've been at Fivetran for 4 yrs and have never heard that term, EtLT. It seems I've just been living in a cave. It's pretty difficult for teams to decipher how tools work in this regard. At face value, many tools look the same. FWIW, Fivetran for example, we define our service as pure ELT... but we do some lite "t" hashing, blocking, normalizing, mapping etc. in order to reduce the need for heavy transformation in the warehouse before the data is actually usable. It's a good reminder to keep an open mind and be intentional about terminology.

回复
Koenraad Block

Founder @ Bridge2IT +32 471 26 11 22 | Business Analyst @ Carrefour Finance

1 年

?? Excellent breakdown of ETL vs. ELT and the evolving needs of businesses.

回复
Frank Zijlstra

Wilt u uw huis verhuren of wilt u huren? 123Wonen is de verhuurmakelaar van Nederland. Gespecialiseerd in verhuur aan expat! Het beste vastgoedbeheer!

1 年

Thank you for sharing Mark Koss - good clear article

回复

要查看或添加评论,请登录

Mark Koss的更多文章

  • Why banks need the Banking Industry Architecture Network (BIAN) model

    Why banks need the Banking Industry Architecture Network (BIAN) model

    Historically, banks who wanted to connect to a new fintech service or replace legacy systems faced several roadblocks…

  • What is a semantic layer and why do you need it

    What is a semantic layer and why do you need it

    We have all been there. Your numbers differ from another team's on a critical sales campaign or key metric, and you…

    1 条评论
  • Why Snowflake versus SQL Server?

    Why Snowflake versus SQL Server?

    As an expert in database architecture, I am often asked what the business benefits are of moving from SQL server to…

  • Cascade Bicycle Club - Why I Love Seattle

    Cascade Bicycle Club - Why I Love Seattle

    Are you new to Seattle and looking to meet great people? Do you want to experience the beauty of the Pacific Northwest…

    6 条评论
  • How to create an effective BI dashboard

    How to create an effective BI dashboard

    You have identified your dashboard's audience, clarified the questions it will answer, and identified the relivant…

    3 条评论
  • The lost art of data storytelling

    The lost art of data storytelling

    As dashboard technologies like Power BI and Tableau become more powerful and dashboard design becomes more efficient…

    2 条评论
  • What is a data vault, and when do you use it?

    What is a data vault, and when do you use it?

    Companies transform data through an ETL (Extract, Transform, and Load) into an enterprise data warehouse to analyze and…

    1 条评论
  • How does Zero ETL differ from a traditional ETL approach?

    How does Zero ETL differ from a traditional ETL approach?

    Recently, AWS released Zero ETL at Re: Invent 2022, with Microsoft, Google, and data warehouse providers Snowflake and…

    1 条评论

社区洞察

其他会员也浏览了