Abstract: Different agreement scores are widely used in social computing studies to evaluate the reliability of crowdsourced ratings. In this research, we argue that the concept of agreement is ...
Abstract: Teachers often spend a long time assessing work and examinations for students; automatic short answer grading dramatically reduces any time spent grading. Also is can be tough for teachers ...