Will impact measurement shrink the training industry?
Picture is AI generated

Will impact measurement shrink the training industry?

Everyone who is a professional trainer has asked themselves how much impact they really made. Although the feedback form might give an indication for the short-term, there is a chronic lack of data for impact measurement beyond the first few days.

What and who

Training impact is defined as ‘the benefits an individual and the organisation achieves from a training intervention’ and practitioners such as Kirkpatrick with the four levels of training evaluation and Will Thalheimer with his Learning Transfer Evaluation Model (LTEM) have contributed immensely to this topic.

Organisations like the Learning & Performance Institute (LPI) in the UK and Training Industry in the USA, are contributing by encouraging Learning & Development professionals to learn more about data analysis and measuring learning transfer.

The reality for Learning & Development

When interviewing L&D professionals over the last few years, the picture emerging shows a number of issues.

  • Training Needs Analysis (TNA) mostly happens as an interview. That enables a thorough approach. However, it lacks scalability
  • In the cases where an online survey is used, the examples we saw, showed that it takes a long time to create the survey because of the scheduling with subject matter experts.
  • Training Needs Analysis and post training impact measurement are not consistently planned and executed.
  • The available budget is spent on training design, creation and delivery. No money is left for impact measurement
  • L&D professionals are dependent on colleagues from other departments to calculate the ROI from their activities

Experience from Training Providers

While interviewing training providers, they mentioned that

  • The same skill issue on data analytics plays with many training companies. Most training providers are small businesses themselves and might not employ data analysts.
  • The full Training Needs Analysis is rarely available
  • The learners in the cohort often do not have the level required and that means the instructor needs to adjust elements of delivery in the course.
  • The happy sheet is the most used post-training measurement.
  • Impact measurement is sometimes offered as a service when the customer asks for it. Unfortunately, they never do…

Measuring impact tomorrow

As with most big shifts, it’s not just one event but a number of root causes coming together. The change in impact measurement has long been in the making.

  • Digital transformation,
  • Data gathering for decision making,
  • Evolving insights in what makes people learn,
  • COVID 19
  • AI tools coming onto the market, changing our way of working
  • Focus on skills-based competency models

These combined causes finally brought us closer to impact measurement.

The new business model

The most profound shift for training companies in the medium term is a changed business model. Measuring impact means that you can charge for results.

Today, a trainer might charge £500 for a training. My prediction is that it will become common to charge £300 beforehand and another £300 when impact is measured.

The threat for the training industry is that providers who fail to show enough impact will fail. On the other hand, those training companies measuring up, will have an opportunity to create more value and revenue.

I have already seen that some end customers demand this and some training providers now offering this. It will not take long for this to become mainstream.

For this business model to work, a partnership attitude is required. Training companies need to adopt new ways of working and customers need to work more closely with their training supply chain.

Training providers have a collective opportunity to add more value to their customers.

Dr. Johanna Lepp?virta

Head of Impact, PhD, Certified ROI Professional (CRP)

5 个月

I believe the answer is no. On the contrary, it might even increase the industry, if training organizations are able to show the value they create. To mention an example, Phillips and his team has been measuring impact and ROI since the 90s. The ROI Institute has developed a credible method and conducted over 9000 ROI studies over the years, majority of them around leadership programs. Showing the value is by measuring it.

Ger Driesen

Learning Innovation Leader

5 个月

Great piece JJ, looking at the comments also a great conversation starter. I'd like to add 2 things. First about TNA. In my opinion we should replace Training Needs Analysis to Needs Analysis. Training Needs Analysis wil likely lead to uhhhh...... training needs! Looking at performance problems Rummler & Brache report that when it comes to performance problems, lack of knowledge and skills is only in 15% the root cause. So 85% of the causes are related to the worksystem and context: training is not the solution to take away these causes. For training providers this means they have to be bold and courageous and after doing a good need analysis more often advise NOT to do training because it won't solve the performance issues. That is not easy and often not immedeatly appreciated by customers (I know by own experience). The other thing is about transfer: Training providers can never be responsible for real transfer on their own. Transfer has a lot to do with other aspects then learning. Aspects that are the responsibility of the customers organisation. Real transfer needs partnership. And needs business data, not learning data.

Jussi Tuominen

CEO Adloc Oy, CEO SofterHR Sarl

5 个月

Good question. I think the most expensive programs are measured more on more. However, they tend to be leadership programs that are complex to define and measure. Real productivity training, e.g. , sales or engineering procedural training is cheap and maybe not so interesting to examine. Compliance is out of scope as it is more or less keeping up the essential organisation hygiene. The big question is if courses are the best way to deliver or should it be just networking and assisted ojt.

Thijs van Zundert

Blended learning. Making business sense, ditching the nonsense.

5 个月

Short, factual, to the point, true. Nice blog Jan Jilis van Delsen !

要查看或添加评论,请登录

社区洞察

其他会员也浏览了