ChatGPT 4o as a grading assistant

ChatGPT 4o as a grading assistant

Vincent C Schoots Vincent C Schoots

Vincent C Schoots

Cognitive Neuroscientist | Instructor AI | Effective Altruism enthusiast

发布日期: 2024年5月16日
+ 关注

Ok so, 3 days ago I wrote a post evaluating ChatGPT 4 as a grading assistant (https://www.dhirubhai.net/posts/vincentschoots_education-ai-chatgpt-activity-7195830142634528771-MS-V?utm_source=share&utm_medium=member_desktop)

The day after, ChatGPT 4o came out. ??

So I redid it.

1) The correlation between my grade and ChatGPT's grade dropped from 0.79 to 0.48. There was even one 7 and one 8 point difference on the (French) 20-point scale. Uh-oh! ??

New result, with version 4o

2) BUT unlike with ChatGPT 4, this time training improved performance! (In the graph below, you see how the disagreement (raw residual) becomes less with time.

For fairness, I used the exact same prompts as last time.

What do you say? Is this better or worse than before? ??


要查看或添加评论，请登录

Vincent C Schoots的更多文章

  • I tried using ChatGPT as a grading assistant. Here's what I found
    2024年5月13日

    I tried using ChatGPT as a grading assistant. Here's what I found

    At #emlyon Business School, we encourage our students to use Large Language Models (#LLM) in an ethical manner. It…

    1 条评论
  • Job Opening: Instructor (m/f/x) in Finance
    2024年5月3日

    Job Opening: Instructor (m/f/x) in Finance

    If you have a finance background and you have some affinity with teaching, here is an opportunity to become my…

  • Why ethics means DevOps
    2021年11月17日

    Why ethics means DevOps

    The last decade has (finally) seen a growing awareness for fair practices and corporate responsibility. Within the…

  • International Women's Day
    2020年3月9日

    International Women's Day

    It takes strength, patience and perseverence to advance equal rights. It also takes courage to reflect on your own…

    1 条评论
  • Decoding affect from the brain
    2020年2月7日

    Decoding affect from the brain

    We have succeeded in decoding the emotional reaction to naturalistic videos by measuring the neural response with fMRI.…

  • Figure Skaters' Relationship with the Ice
    2019年12月19日

    Figure Skaters' Relationship with the Ice

    My talented sister-in-law Maja Luther has made a 10-minute mini documentary about the relationship figure skaters have…

  • Trading academia for security
    2019年12月6日

    Trading academia for security

    It is a rainy december morning. I am looking out on the wet streets from my cosy corner in the office, sipping my…

    7 条评论
  • International men's day
    2018年11月19日

    International men's day

    Today it is international men's day. The day to celebrate all those who, by nature or by choice, are male.

    3 条评论
  • Professionele trainingen
    2018年9月14日

    Professionele trainingen

    Mijn goede vriendin Wendy Bruggeman werkt als Coach en Trainer om uw medewerkers te helpen groeien en ontwikkelen. Ik…

  • Pro tip: Python Data Science Handbook
    2018年8月8日

    Pro tip: Python Data Science Handbook

    Richard Kunert, PhD gave me the following pro tip: for academics looking to apply their data science skills in…

社区洞察

其他会员也浏览了