How do you test and validate your data load script results and outputs?

1 Debug mode

Debug mode is a built-in feature in QlikView that allows you to run your data load script step by step and inspect the data tables and fields that are created or modified. You can access debug mode from the script editor by clicking the Debug button or pressing Ctrl+Shift+D. Debug mode has several options to control the execution of the script, such as run, pause, stop, step, and break. You can also set breakpoints and watchpoints to monitor specific expressions or variables. Debug mode is useful to check the logic and syntax of your script, identify errors or warnings, and verify the data quality and structure.

2 Table viewer

Table viewer is another built-in feature in QlikView that shows you the data model that is generated by your data load script. You can access table viewer from the main menu by clicking Tools > Table Viewer or pressing Ctrl+T. Table viewer displays the data tables and fields that are loaded into the QlikView document, as well as the associations, keys, and symbols that indicate the relationships and properties of the data. You can also view the data preview, the number of rows and columns, and the memory usage of each table. Table viewer is useful to check the data model design, the data granularity and cardinality, and the data integrity and performance.

3 Data profiling

Data profiling is a process of analyzing and assessing the data quality and characteristics of your data sources and data model. You can use QlikView functions and expressions to create data profiling charts and tables that show you the distribution, frequency, range, outliers, missing values, and duplicates of your data fields. You can also use QlikView variables and parameters to control the data profiling settings and filters. Data profiling is useful to check the data accuracy and completeness, the data relevance and consistency, and the data issues and anomalies.

4 Script logging

Script logging is a feature in QlikView that enables you to generate and save log files that record the execution details and results of your data load script. You can enable script logging from the script editor by clicking Settings > Document Properties > General > Generate Logfile. Script logging creates a text file with the same name as your QlikView document in the same folder, with a .log extension. The log file contains information such as the start and end time, the script statements, the number of records, and the errors or warnings of the script execution. Script logging is useful to check the script performance and efficiency, the script progress and status, and the script errors and resolutions.

5 Data validation

Data validation is a process of comparing and verifying your data load script results and outputs with your data sources and business requirements. You can use QlikView tools and features such as list boxes, table boxes, charts, filters, bookmarks, triggers, macros, and extensions to create data validation dashboards and reports that show you the differences, discrepancies, and deviations of your data. You can also use external tools and methods such as SQL queries, Excel formulas, or manual checks to cross-validate your data. Data validation is useful to check the data alignment and agreement, the data correctness and compliance, and the data feedback and improvement.

6 Here’s what else to consider

This is a space to share examples, stories, or insights that don’t fit into any of the previous sections. What else would you like to add?