A case study of using ChatGPT for item banking

A case study of using ChatGPT for item banking

Like so many people nowadays, I was taking ChatGPT for a test-run - I wanted to see if it could help me build an item-bank. Please note that the examples given are quite simplistic, and are just meant to showcase the capabilities of AI generated content.

Item-banking is expensive. Costs of €7,000 per item is not unheard of. An exam could cost up to €500,000 to create, and if the content is leaked, new items have to be created.

I am a firm believer of Linear On the Fly Testing (LOFT), where each candidate gets a unique set of questions based on certain pre-defined criteria.This prevents both cheating and content theft. But this requires a larger item-bank since you want to ensure the randomness of the test.

Let's see if ChatGPT can help out with that:

First I asked the AI to generate 10 questions about the American Civil War

No alt text provided for this image

Then I asked if it could give me 4 alternatives for each question

No alt text provided for this image

And to make it easier on me as an author, I asked it to give me the correct alternatives

No alt text provided for this image

OK, so it works great for multiple choice questions, but I wanted to see if it was able to give me other question types as well

No alt text provided for this image

And how I should mark these

No alt text provided for this image

The next one I didn't expect it to handle. I was utterly flabbergasted by what I got.

No alt text provided for this image

And if AI could also help me organise the content by defining the correct Bloom's taxonomy.

No alt text provided for this image

I am completely at a loss of words. So I had to ask how I could create a time machine to go back in time and invest in this company.

No alt text provided for this image
Olga Golubina, PMP?

Enterprise Portfolio Lead | Global Strategic Program Manager | Digital Transformation Leader | SAFe? Agilist

1 年

That’s indeed just amazing how great ChatGPT works. A friend of mine experimented with ChatGPT via asking it to write a novel, and you know the result was also pretty nice, not perfect but it is only a beginning. Since time traveling is not yet possible, you might want to consider the ways how you can leverage this ChatGPT in your business to bring it to the next level.

回复

要查看或添加评论,请登录

社区洞察

其他会员也浏览了