Big Data and the Reporting Funnel

I see big data as the starting point in a reporting funnel. With the tools now available in Excel to crunch tens of millions of rows of data, the task for the analyst is how to accurately capture and present this data in a clear concise manner. 

Whenever commencing this process, I generally start with the output I desire and work backwards, an inverted funnel if you will.

I find creating a sketch of your key metrics and how it might fit on a single page starts the creative juices flowing and helps to structure not only the output page but your thought process as well. Ideas tend to build, flourish and improve with time. So starting off with the end product clearly in mind helps to crystallise the data required to achieve the desired look and feel.

Once I know what I want to get out of the exercise it is a matter of working the wider end of the funnel (the big data) to ensure I have all the data points to meet my own high expectations. 

Excel's Power Pivot is invaluable when funnelling big data. I held off learning about PowerPivot for quite some time. It was only this year when CPA Australia invited me to conduct a 3-part series on the topic that I began to research this Power word and what it meant for reporting. I was delighted to discover that the back end fit together in roughly the same way as MS Access. #QuickWin. I concluded Excel PowerPivot was the big guy in the room - fat single and ready to mingle.

I am still on my journey and present part 3 of my big data national webinar series next Tuesday at the CPA offices in Brisbane. The above dashboard is the output for the webinar and it took me many days to finalise (I know, I know.... it does take some forethought). Unfortunately, I devised a rather drab title for the webinar - 'DAX Analytics and Dashboarding Results' but the Excel output file is fully weaponised and everyone leaves with a smile :)

Marcus Small is the Godfather of the Smallman.com - a website dedicated to weapons grade Excel development. Take a deep breath, the site is not for the light hearted. It is for the inner geek who has wanted to take their shirt off and scream - 'I love Excel' - Yes peeps and so do I.