RoundPier转发了
A lot of school district leaders have been asking what they should think about when using AI tools. Here is a list of some things to consider: Must-haves: -For under 13 (possibly 18) users- teachers and/or administrators should have transparency into how students are using the tools (i.e., have access to student conversation/transcripts and can get summaries of student AI activity) -For under 18 users - there must be clear moderation mechanisms that keep students from engaging in negative use cases (self-harm, hate, etc.).?These mechanisms must proactively notify key stakeholders (e.g., teachers and administrators) when the system detects these situations. -AI vendor must use high quality underling models that minimize errors and hallucinations?(today this is GPT-4, Gemini Pro 1.5, Anthropic Claude 3 or better). GPT3.5 is not acceptable for student/teacher use.? -AI vendor must have clear contracts with AI model creators stipulating that student data cannot be used for training of the general, public models -AI vendor must be clear that student/educator data will not be sold to third parties in ANY circumstance (even in the event of bankruptcy or an acquisition) -AI vendor must-have clean SOC-2 audits?- this ensures that student and educator data is protected/secure Nice-to-haves: -AI vendor has taken care to prevent use of AI for cheating. -AI vendor has added layers to the base model to minimize errors/hallucinations -AI vendor has evaluation/benchmarking mechanisms to measure the AI error rate -AI vendor has school/district/system level reporting so that AI use can be monitored centrally -AI vendor has professional development for teachers to understand how to deploy in the classroom -AI vendor has training for students to understand how to use the AI tools (and how to mitigate risks) -AI tool supports multiple languages -AI tool can be "one-stop" across grades and subject matter to avoid fragmentation of the experience (and the district having to manage multiple solutions).
Thank you Sal Khan for clearly outlining the list of must haves and red flags. When the market is flooded and schools have a fomo this comprehensive guidance helps.
Thank you for these guidelines. It's encouraging to see educational leaders like Khan Academy leading this discussion, as so many educators and schools are seeking direction with AI. While AI tools can be useful in education, we need clear guidelines and thorough training. It's also worth noting that these tools can alleviate teacher burnout, but they also add layers of complexity to their jobs. How will this be addressed? At EnCorps, STEM Educator Programs, we contribute to this effort by recruiting STEM professionals who are passionate about exploring education. Many of our fellows and tutors are already familiar with AI and responsible usage but also need clear guidelines for implementing these tools in the classroom.
Cfbr
Well summarized! Personally, I believe that "For under 18 users - there must be clear moderation mechanisms that keep students from engaging in negative use cases (self-harm, hate, etc.). These mechanisms must proactively notify key stakeholders (e.g., teachers and administrators) when the system detects these situations" is equally important and absent in most of the systems I have seen so far. I am also a bit skeptical of "AI vendor has taken care to prevent use of AI for cheating," as I think this is more or less an empty statement since it very much depends on the definition of "cheating" (which most likely has to be redefined anyhow).
The “must-haves list” are indeed must haves.
You might be using gpt 4 but if you have no idea what you are doing and simply asking to write an essay based on the subject line, you will still have hallucinations
Insightful! Sal Khan ??
Totally agree that there has to be oversight on the content for harmful, hate. Though wouldn't this be similar to how Google is doing it for the Google Classroom where like a "big brother" they watch every word and notify the school authorities of something bad about to happen. I am not complaining but that would be privacy invasive to begin with - also how that data will be used to further train the models?
Special Education teacher at Waukegan Public Schools - School District 60
9 个月Very informative. Thank you, Sal for all your hard work on improving and transforming the instruction and the learning experience of our children in the whole world!