THE ANALYSIS ON DIFFERENCE BETWEEN MACHINE SCORING AND HUMAN SCORING IN WRITING ASSESSMENT
Fu Lei National University of Uzbekistan Named after Mirzo Ulugbek, Tashkent, Inner Mongolia University of Finance and Economics, Hohhot, China
Keywords:
Scoring, Difference, Analysis, AssessmentAbstract
The research chooses 20 writing samples from the automated scoring system and compares the results of machine scoring and human scoring. Based on the analysis on the differences and the reasons leading to the differences, the research concludes the results of the automated evaluation system are reliable, and human assessment should be added to high-risk tests to ensure accuracy. According to the analysis on text features, the research provides some suggestion for language teaching and learning.
References
Burstein J & Chodorow M. Automated essay scoring for nonnative English speakers [A].
Proceedings of the ACL99 Workshop on Computer-Mediated Language Assessment and Evaluation of Natural Language Processing [C]. College Park, MD. 1999. 68-75.
Deane P. On the relation between automated essay scoring and modern views of the writing construct [J]. Assessing Writing, 2013, 18(1): 7-24.
Dikli S. An overview of automated scoring of essays [ J]. Journal of Technology, Learning, and Assessment,2006, 5(1): 1-35.
Jin, T., Lu, X., Guo, K., Li, B., Liu, F., Deng, Y., Wu, J., & Chen, G. (2021). Eng-Editor: An online English text evaluation and adaptation system. Guangzhou: LanguageData (languagedata.net/tester).
Li, F. P., & Xiao, L. Y. (2020). A Study on the Teaching of Professional-Oriented English Writing in Applied-Type University Based on I Write 2.0. Creative Education, 11, 1720-1729. https://doi.org/10.4236/ce.2020.119125
白丽芳,王建.人工和机器评分差异比较及成因分析.外语测试与教学[J].外语测试与教 学,2018（3）:44-54.
何旭良. 句酷批改网英语作文评分的信度和效度研究[J]. 现代教育技术,2013,(5):64-67.
王建，张藤耀. 二语写作文本量化指标与机评分数的关系研究. 外语测试与教学[J].外 语测试与教学,2020（3）:12-20.
中华人民共和国教育部.中国英语能力等级量表[EB/OL].(2018-07-25).
http://www.moe.gov.cn/s78/A19/yxs_left/moe_810/s230/201807/t20180725_343689.html.
