• Currently 0.00/5
  • 1
  • 1
  • 2
  • 2
  • 3
  • 3
  • 4
  • 4
  • 5
  • 5

Rating: 0.0/5 (0 votes cast)

Logo  

Title

What are good web courses made of? Quality evaluation in the Virtual University for Occupational Health Care

Theme

eP1 ePosters 1

Authors

Lena Selanne
Marianne Rytkonen

Institutions

University of Helsinki

University of Eastern Finland

Background

The Virtual University for Occupational Health Care (VUOHC) is a collaborative effort of five medical faculties in Finland (the universities of Helsinki, Eastern Finland, Oulu, Tampere and Turku) and the Finnish Institute of Occupational Health. Universities offer training for about 800 physicians specialising in occupational health and their about 350 tutor physicians.

 

VUOHC offers about 50 courses in Moodle learning environment, varying from tutored eLearning and blended learning to self-study and case-based courses. All universities offer courses, so there are many authors with different styles. The goal of this study was to help teachers, other authors and eLearning specialists to do high-quality and coherent courses.

Summary of Work

A quantitative study was made to examine the quality of the VUOHC courses. Altogether 15 tutored and 10 self-study courses were evaluated. 35 quality criteria were defined and divided into administrative, technical and content questions (see figure below and video). The focus of the criteria was in the course design, structure and instructions.

 

The evaluation test was made as a quiz in Moodle. The criteria were formulated as questions and if the quality criterion was fulfilled the course got 1 point, if only partly 0,5 points and if not 0 points (see examples in "more detail"). Some questions had different options, but the scale was still from 0 to 1 point (see "more detail"). The quiz was build so, that after the test there was instant feedback and suggestions on how to improve the course.

Summary of Results

In the figure below are all the quality criteria questions and the mean of answers in 25 evaluated courses. The results will guide how to improve the courses (like the information about evaluation is needed more, as are responses to feedback and instructions for tutor physicians) and where things are ok (like the course summary and information about authors are extensive and there is often extra material).

 

Five of the criteria fall under 0,3 points (in red), 12 are between 0,31 and 0,70 points (in yellow) and the rest have over 0,70 points (in green). The mean of all is 0,61 points which indicate that the courses are in pretty good shape, but there are still many things to improve.

 

Conclusion

The quality criteria and test tool are still under construction. They have been tested and reworked in two workshops together with teachers and other course authors. In the workshops, participants have been given instructions and a test tool for working. After testing, feedback has been gathered and the criteria and instructions have been improved for the next workshop. There will still be three workshops before the test tool and criteria will be available to all teachers and other authors.

 

In the future, we hope this tool will be used in every course. Our next challenge is to include more substance quality in the criteria.

Take-home Messages

A quantitative analysis and an easy tool helps to enhance the quality of web courses.

Background
Summary of Work

Examples

Question: "Is it told clearly how the learning is evaluated?"
Answer: "Yes" (1 point) - There is maybe an evaluation matrix or other wise stated how to complete the course satisfactory.
"Partly" (0,5 points) - There is some information about the evaluation: e.g. how many exercises have to been done to pass the course.
"No" (0 points) - Nothing is told about how the learning is evaluated.

Question: "Are there any other formats of text files than pdf-format?"
Answer: "Yes" (0 point) - It is better to have files in pdf-format.
"Partly" (0,5 points) - Most of the files are in pdf-format (just one other).
"No" (1 point) - All the text files are in pdf-format.
 

Different options

Question: "When is the course updated last?"
Answer: "under three years" (1 point), "three years ago" (0,5 points), "over three years" (0 points)

Question: "How many sections are there (including the beginning)?"
Answer: "1-2 sections" (0), 3-8 (1 point), "9-15" (0,5 points), "over 15" (0 points)

Question: "How many blocks are there on the right side?"
Answer: "0 blocks" (1 point), "1-4" (0,75 points), "5-10" (0,5 points) "over 10" (0 points)

Question: "How many activities and resources are there at the most in one section?"
Answer: "0-6 activities and resources" (1 point), "7-15" (0,5 points), "over 15" (0 points)

Question: "How long is the longest video?"
Answer: "under 20 minutes" (1 point), "21-45 minutes" (0,5 points), "over 45 minutes" (0 points)

Summary of Results
Conclusion
Take-home Messages
References
Send ePoster Link