How Much Value Does this Really Add?

Psychometric testing with career counselling.

Apparently considered a very important part of the process by many in the field.

But - does it actually add any value to someone who is eagerly trying to determine the best professional path to support and enable his or her personal needs, goals and ambitions?

And every time I ask that question I get on someone's nerves.

It is an inevitable consequence when I ask questions about practices that have created very specific general beliefs.

So - without wasting more time, let me get into it. I'll share why I believe these tests (often done at great expense) should be treated as no more than an interesting data point. A small part of a much larger dataset to help determine whether a specific professional direction is for you - or even if a person is a great fit for your team.

(For full transparency and to be clear, I am not a trained psychologist nor am I trying to portray myself as an expert in the field of psychometric testing. But - I have come across these things quite often in my career (personal experience which I share below, and for the companies I worked with) and I have conducted my own fairly extensive analysis over the years. My view is my own - and to be fair - it is more a question than an outright statement.)

Let's Understand the Context

The theory behind these tests - as evolved over the last 100 years or so - is that psychometric testing (from a career counselling perspective) will tell you what you are good at, how clever you are, your personality type and the types of vocations that may or not may not suite you well. Amongst other things.

It is a standardized test that is interpreted by an individual trained on the theory behind it from which a profile is created - based on the responses to the questions asked in the testing process.

And usually, it is part of a broader career counselling process. But for most people going through this, it is a fundamental part of the process and the foundation from which much of the eventual advice is given.

Really, It Can Do That?

Well, this is where I'm running into some trouble.

Because a career seems to be quite an important part of most people's lives. It is something that you are apparently going to spend around 40 years of your life on, and which needs to effectively support your personal goals and ambitions.

Now - please note - I am not campaigning against these tests as part of a career evaluation process. Evidence suggests that the more reputable tests have been quite rigorously tested and validated (insofar as that is possible within the social sciences construct).

But I'd argue the value of the information gained is quite limited when considered against the context of what it is supposed to enlighten us on. Because - and this is important - a test result may be accurate.

But is it Useful?

Best summarized by this extract from an article by Harry Freedman :

Granted, it has its uses in specific situations. For example, when a company wants to check that the person they are considering for a job has the right level of skills in a certain area or has the personality to meet the demands of the job or the culture of the organization [at that point in time]. It can also be useful to give a young person a general sense of career direction, since they have little other information about their skills and career needs to go on. But some career professionals use psychometric testing as a default, basing all subsequent work on the results of the test, and I take issue with this approach.

Agreed.

Some... Concerns... if you will

I believe there are at least 4 major concerns one should carefully consider if you want to use these tests as anything more than a clearer understanding of who you purport to be at the moment of taking the test, and they are:

1. It is a snapshot in time of who you are now. And perhaps even - for some of the weaker tests - how you felt on the day of the assessment. It cannot take into account who you were, nor who you are going to become in 5 or 10 years from now. Are you not going to grow new interests, Are you not going to be exposed to new things? Or to familiar things in a manner that you may not have yet been exposed to? Are dormant capabilities and interests perhaps not going to be stimulated in the next couple of years? And perhaps more importantly - are things you may value or be good at now not going to lose its shine down the road?
2. Regardless of intent, the usability of testing simply cannot keep up with the rapid pace of workplace or professional development in our current age. To determine if testing can be used as somewhat accurate forecasting or advice mechanisms, you must administer (within controlled environments and normalized as needed) these tests to thousands of people across various demographic groupings, track these people's progress and then map it back to their test answers. It takes a couple of years to validate the results from a test - and that is the problem. I don't think anyone would argue the world in 2019 is the same as the one in 2024. Or who would take the bet that the world in 2029 will be similar to what we see today. So even if tests are properly validated over a 3 - 5 year period, the value of the results may be irrelevant by the time it can actually be used.
3. Testing in itself is inherently a fallible mechanism. Some people are great taking tests and others are simply bad at it. The stress of the situation, the importance of the outcome - all factors that can weigh heavily on someone's ability to relax and determine "which shape does not match the rest." Additionally - many tests rely on scenario or preference statements and this means there is scope for manipulation.
4. Ultimately the results are based on the interpretation of the professional (therapist, counselor, advisor) evaluating the results - even if they use a standard results matrix. They still need to derive and advise on meaning from it. And I believe it will be difficult to convince anyone that someone can really understand who you are, your deep fears and ambitions, in perhaps 2 interviews and a standard test.

So where does this leave us?

Let me share my personal experience.

You Should Not Study Business

This phrase was said to me twice. By different and unconnected professionals.

When I was 14, my parents followed some well intentioned advice to have me undergo some career testing. I did it twice within the span of 2 months. First with a local school counsellor and then with a career counselor at the University where I would eventually study Law.

Reason being - I was due to enter Standard 8 the next year (the 10th school year in South Africa, now called Grade 10). And at this point in our school career we were able to select subjects to align with our intended area of study at University.

I did not have a clear idea what I wanted to do, but I did know I wanted to go into business.

So I did the tests, chatted with the counsellors and they both, independently told me and my parents I should shy away from pursuing anything that requires numeracy skills - accounting, engineering, etc. Because - the tests indicated this capability was below average and other competencies scored much higher.

Bottom line was that my folks and I decided to refrain from pursuing a B.Com or other business degree - because "I'm not suited for it".

So I did not study accounting - which was a bit of a problem because one of the exams I had to take as part of the admission process to be admitted as a practicing attorney, was accounting. But I dug in, caught up quickly and passed the accounting exam first time with an 80% mark.

Food for Thought

I'm not suggesting these tests are a waste of money and time and have no worth whatsoever.

But I am strongly suggesting that their worth is limited to help you perhaps get a deeper understanding of who you are right now and your current skills, aptitudes and preferences.

You should use this data as PART of a broader set of criteria, not the only thing that you look at.

It can help you understand the gap you'll need to cross between what you need and what you have at the moment. It cannot tell you definitely what you should or should not pursue.

Not for Kids

I do believe though that this approach should most definitely not be used on kids whose exposure to the professional environment is limited to - and influenced by - the people they interact with and what they see on TikTok.

And additionally - may not have had access to high quality education or have not yet developed sufficient critical thinking skills to properly evaluate the advise provided by the counsellor.

A much better way, in my view, is to provide them with as much information as possible on a wide range of career opportunities, to talk them through it and share the kinds of skills and capabilities required for each.

Allow them to explore their opportunities without any bias - because quite frankly, who they are now and who they will become is not the same thing.

For kids (and I include in this group anyone up to 18 years old) the focus should be what they want to be able to do. The life they hope to live one day. Teach them from a young age that what they wish to accomplish and what they need to do to get there, is not the same thing.

You want to become a Doctor? An Engineer? A Teacher? Cool! - Why? What will that help you do and how will that help you build a live you can be proud of.

In Summary

I know - from the research I did - that many of these tests and processes have undergone substantial scrutiny. And that many of them can in fact give you a fairly accurate view of your current self and your current capabilities. It is also clear that much criticism exists - both in terms of content and application.

I also believe many of the trained specialists administering these tests as part of a broader career counselling process do so with best intent. These are the tools of their trade and they use them as they believe is best.

So if you do go down this route, then look for someone that understand these tests are merely A data point. A Snapshot in time of the person who completed the test on that day. It provides insight into who the person is now and, at best, can help define a great starting point.

Best wishes

Johan