ePoster
Abstract Title | "To see ourselves as others see us": Comparison of peer- and tutor-assessment of discussion boards

Authors

  1. Paula J.W. Smith
  2. Emma Barron
  3. David Dewhurst
  4. Anna Paisley
  5. Peter Lamb
  6. O. James Garden

Theme

Social Networking

Category

Resources

INSTITUTION

The University of Edinburgh (Clinical Surgery and the Learning Technology Section)

Conclusion

Peer-assessment of student contributions to discussion boards improves with increasing experience. Contrary to our expectations, the introduction of peer-assessment did not increase student participation in the discussion boards.

Background

Peer-assessment has the potential to enhance learning, engaging students more actively with course content and the criteria for assessing such content, and promoting skills in critical reflection (Boud & Falchikov, 2006). Online discussion boards promote greater higher-order learning than face-to-face dialogue since students have more time to reflect upon and research their responses (Blanchette, 2001). Furthermore, discussion boards create an interactive online community which can reduce feelings of isolation associated with distance learning, and contribute to increased learning and student satisfaction (Rovai, 2002). However, it is possible for some students to adopt the role of "lurker", in that they view the discussions posted by others but do not themselves participate.

 

In this study the reliability of peer-assessment of online discussion boards, and its impact on student participation, was examined in a student cohort of junior surgical trainees.

Take-home Messages

Peer-assessment of discussion boards can be a reliable and useful exercise for ensuring students cover course material, and in developing key skills promoted in the General Medical Council guidelines on good medical practice. However, students surveyed would not support it as a replacement of expert tutor-assessment.

Summary of Work

The online MSc in Surgical Sciences programme utilises virtual case scenarios based on common surgical conditions, underpinned by basic science content. Assessment tools include asynchronous discussion boards facilitated by expert clinical tutors (consultant surgeons or senior surgical trainees).

 

Marks awarded by students and tutors were compared for contributions to boards in Year 1 and 2 modules, to test the null hypothesis that peer-assessment is comparable to that provided by experienced e-tutors. We also hypothesised that the introduction of peer-assessment would increase student participation in online discussion boards.

 

Students and tutors were provided with detailed marking criteria (range 0-3, see details) at the outset, and an online anonymous questionnaire was used to gauge students’ perceptions of peer-assessment.

Acknowledgement

The MSc in Surgical Sciences programme is run in partnership with the Royal College of Surgeons of Edinburgh.

Summary of Results

In first year boards, peer-assessment marks were consistently greater than those of tutors (P=0.02: total assessments per group = 345, by 40 students and by 32 tutors), whereas in the second year, awarded marks were similar (P=0.64: total assessments per group = 342, by 47 students and 28 tutors) (Figure 1).

 

 

Introduction of peer-assessment did not impact significantly on the frequency of student participation (Figure 2).

 

 

Survey results reveal that 46.5% of students believed peer-assessment was beneficial, but the majority favoured tutor feedback (88.4%) and tutor marks (62.8%) (n=43 respondents).

References

 MSc in Surgical Sciences

www.essq.rcsed.ac.uk

 

 

 

 Blanchette, J. (2001) Questions in the online learning environment. The Journal of Distance Education. 16 (2), 37-57.

 

Boud, D. & Falchikov, N. (2006). Aligning assessment with long-term learning. Assessment & Evaluation in Higher Education. 31 (4), 399–413.

 

 

Rovai, A.P. (2002). Development of an instrument to measure classroom community. The Internet and Higher Education. 5 (3), 197-211.

MSc M

 

Conclusion
Background
Take-home Messages

http://www.gmc-uk.org/guidance/good_medical_practice.asp

Good Medical Practice: Teaching and training, appraising and assessing

This is the Teaching and training, appraising and assessing section of Good Medical Practice.

  1. 15. Teaching, training, appraising and assessing doctors and students are important for the care of patients now and in the future. You should be willing to contribute to these activities.
  2. 16. If you are involved in teaching you must develop the skills, attitudes and practices of a competent teacher.
  3. 17. You must make sure that all staff for whom you are responsible, including locums and students, are properly supervised.
  4. 18. You must be honest and objective when appraising or assessing the performance of colleagues, including locums and students. Patients will be put at risk if you describe as competent someone who has not reached or maintained a satisfactory standard of practice.
  5. 19. You must provide only honest, justifiable and accurate comments when giving references for, or writing reports about, colleagues. When providing references you must do so promptly and include all information that is relevant to your colleague’s competence, performance or conduct.
Summary of Work

Mark Grade Description for Discussion Board Participation (Certificate and Diploma)

      FAIL

 

0                Has not participated in academic discussion

 

OR

 

Evidence of plagiarism

 

 

 

PASS

 

 

1                Has participated in discussion boards only occasionally AND/OR at a superficial level

 

2                Has made significant and original contributions to discussion boards, responding to issues raised by the e-tutor(s) and fellow students

 

3                Has made significant, original and sustained contributions to discussion boards leading debate and facilitating interaction with others, bringing original material to support arguments

Acknowledgement
Summary of Results

References
Send ePoster Link