Unlocking the Power of ChatGPT: Navigating the Promises and Perils for Teachers in Second Language Writing assessment
Abstract: The existing body of research within the field of English language education and Artificial Intelligence demonstrates the potential of AI to enhance students’ speaking skills, bolster reading comprehension, and boost motivation. Yet, little emphasis has been placed on the teacher’s viewpoint in the context of AI, and investigations into ChatGPT’s role as a writing assessment tool remain at an early stage of development. This study investigates the promises and perils of ChatGPT in assisting teachers with assessing student academic writing at a Japanese university.
Students were given an agree/disagree essay question based on the TOEFL Independent writing task’s principles that asks them to provide their opinion on a given topic. The teacher graded the student essays with reference to TOEFL’s Independent Writing Rubric. This was followed up with an experiment to assess how ChatGPT would evaluate the essays using the same rubric.
Although ChatGPT followed the evaluation rubric well and showed significant improvement with relevant prompts, mistakes, and occasional disparities between the human rater and ChatGPT were made. Given these disparities, it remains essential to underscore the importance of maintaining a human-centered approach in AI-enhanced formative assessment. ChatGPT can offer valuable support but should not be seen as a complete substitute for the human rater.
<Q&A 15:30-15:40>
15:45-16:05
小泉 勇人（東京工業大学）
“How do civilized human beings participate in destructive, inhumane acts?”ー 映画Experimenter(2015)で学ぶミルグラム実験 ー
英語教育で用いる映画には娯楽性が期待されることも多いが、CLILの観点からは、社会の諸問題や歴史をヴァーチャルに体験する英語教育も可能であろう。例えばヴェトナム戦争（深津、2017）、アメリカ資本主義（横山、2020）、ジェンダーロール（吉村、2022）に注目した内容言語統合型学習の研究が進められてきている中、当発表では社会心理学を主題とする映画Experimenter（2015）に注目する。かつてハンナ・アーレントがナチズムに見た「悪の凡庸さ」を心理実験で実証しようとするStanley Milgram博士の半生を描く本作であるが、本発表の狙いは、これを「ホロコースト」を考える特異な英語テキストとして位置づけることにある。Milgram博士が「第四の壁」を破る場面を取り上げ、その背後を非現実的に徘徊する巨像の表象を論じつつ、慣用句“elephant in the room”の含意を読み解きたい。
<Q&A 16:05-16:15>
16:20-17:20
Ryan Spring (Tohoku University)
Sachiko Nakamura (Tohoku University)
Workshop: How to Make Better Videos for Your Classes Part 2: Camera Proximity
Using video materials in language classes is an effective way for students to learn practical English. We can use movies, dramas, and YouTube videos, but we always need to consider limitations based on copyrights or other legal concerns. And also, it is sometimes difficult to find appropriate videos which include particular points we want to teach in class. Making our own videos can be the solution to those concerns, and many teachers have begun making original videos to contextualize words and phrases for their students. By doing so, we can prepare materials that are specifically tailored to the points our students need to learn. However, if videos are not made well enough, students will lose interest and might become bored with them. In this series, you can learn how to make quality videos using simple tools that most teachers have; a cell phone, a computer, and other simple items. In Part 2, we are going to teach you about camera distance. This will be an active workshop; you are going to shoot a video with your smartphone, learn some tips about camera distance, and re-shoot the same video using what you have learned.
