PART 3 – ROADMAP – NON-TECH to BIG DATA TESTING

PART 3 – ROADMAP – NON-TECH to BIG DATA TESTING

?

Before you start, I would recommend you complete the below steps.

·????????Complete part 1 & 2 videos

·????????Also read through the articles.

·????????I will put all the videos & article links in the Description box

·????????Watch all the videos

·????????Keep all the articles for reference

·????????Draw of dashboard/chart to track your performance

?

Part 1 - https://www.dhirubhai.net/pulse/road-map-from-non-tech-big-data-testing-krishna-kayaking/?trackingId=%2BfsHVpMkQo2sM8Q6PvEl%2FQ%3D%3D

Video 1 - https://www.youtube.com/watch?v=aK9jWkfS-wM

?

Part 2 - https://www.dhirubhai.net/pulse/road-map-part-2-from-non-tech-big-data-testing-krishna-kayaking/?trackingId=q2S%2Bw2SXT8ethb5kU8tgrw%3D%3D

Video 2 - https://www.youtube.com/watch?v=sw8gzSqBeqo

?

Part 3 – https://www.dhirubhai.net/feed/update/urn:li:ugcPost:6996484383201267714?updateEntityUrn=urn%3Ali%3Afs_updateV2%3A%28urn%3Ali%3AugcPost%3A6996484383201267714%2CFEED_DETAIL%2CEMPTY%2CDEFAULT%2Cfalse%29

Video 3 – https://youtu.be/7mgYcvJUkOU

=======================

THIS PART WE WILL DISCUSS THE ETL TESTING CONCEPTS

What is ETL

• Extract (DBs, Flat file, XML file, Excel file, Parquet file)
• Transform
• Load

Test strategy

1. Data Completeness
2. Data Transformation
3. Data Quality
4. Initial Load | Full load | First load
5. Incremental load | Second load | Delta load
6. Presentation layer (BI/Report)
7. Job Dependency

Learn one ETL Tool (from QA/Testing perspective)

• Informatica PC
• Talend
• SSIS
• IBM DS
• Any other ETL Tool
• Comment some of the famous ETL Tools
• Comment the one you have worked on

STM – Source Target Mapping Document

• What is STM
• Importance of STM
• I will make a separate video on

Data Transformation Test

• Data Cleansing
• Data Merging
• Data Scrubbing
• Data Aggregation

?

TRANSFORMATIONS

1. Aggregation Transformation
2. Expression Transformation
3. Filter Transformation
4. Joiner Transformation
5. Router Transformation
6. Sequence Transformation
7. Sorter Transformation
8. Lookup Transformation

?

Challenges in DWH/ETL Testing

?

File comparison testing approach

• There are multiple ways of doing this
• Comment if you want me to make a video on this
• This is a must-question in any interview
• Around 60% of the interviewers love this question

?

SCD – Slowly Changing Dimension

• Comment if you want me to make a video on this topic
• One of the most interesting topics (all interviewers like this one)

?

LOADING

• Initial load | Full load | First load Testing
• Incremental load | Second load | Delta load Testing

?

Job Dependency Testing

• Not so important
• Good to know
• Job Dependency document

Active & Passive Transformations

?

Defect Life cycle – from ETL/DWH QA Perspective

=======================================

Part 1 - https://www.dhirubhai.net/pulse/road-map-from-non-tech-big-data-testing-krishna-kayaking/?trackingId=%2BfsHVpMkQo2sM8Q6PvEl%2FQ%3D%3D

Video 1 - https://www.youtube.com/watch?v=aK9jWkfS-wM

?

Part 2 - https://www.dhirubhai.net/pulse/road-map-part-2-from-non-tech-big-data-testing-krishna-kayaking/?trackingId=q2S%2Bw2SXT8ethb5kU8tgrw%3D%3D

Video 2 - https://www.youtube.com/watch?v=sw8gzSqBeqo

?

Part 3 – https://www.dhirubhai.net/feed/update/urn:li:ugcPost:6996484383201267714?updateEntityUrn=urn%3Ali%3Afs_updateV2%3A%28urn%3Ali%3AugcPost%3A6996484383201267714%2CFEED_DETAIL%2CEMPTY%2CDEFAULT%2Cfalse%29

Video 3 – https://youtu.be/7mgYcvJUkOU

--------------------------------------------------------

?

Follow me on Social Media - Krishna Kayaking -

LinkedIn - https://www.dhirubhai.net/in/krishnakayaking

Instagram - https://www.instagram.com/krishnakayaking/

FB - https://www.facebook.com/krishnakayaking/

Twitter - https://twitter.com/krishnakayaking

?

#video #youtube #krishnakayaking #techieKrishnaKayaking #TKK #techie #techies #ITlife #informationtechnology #engineering #career #careergrowth #education #testing #BigData #ETL #DWH #linkedin #crack #interviewpreparation #interviewpreparation #interview #experience #thankyou #jobs #podcast #learning #instagram #linkedin #facebook #krishnakayaking #techieKrishnaKayaking #TKK #techie #KRGD #Krsnarupa