Abstract Title
Evaluation of an Experiential Postgraduate Certificate Programme for GP Educators

Authors

Professor Abdollah Tavabie
Dr Hilary Diack
Dr Anna Koczwara
Ms Phillipa Coan

Theme

The Teacher

INSTITUTION

Department of Postgraduate General Practice Education
Health Education Kent Surrey and Sussex
London, United Kingdom

Background

 

Postgraduate Ce rtificate in Strategic Leadership, developed by Health Education Kent, Surrey and Sussex (HEKSS) for GP Educators was piloted in 2012. It incorporated several key elements:

A Postgraduate Certificate in Strategic Leadership and Medical Education developed by Health Education Kent, Surrey and Sussex (HEKSS), piloted in 2012 incorporated several key elements:

  • A breadth of learning including the GP as  educator, clinician and team worker
  • Experiential learning strategy
  • Blended approach
    •  Action learning sets  facilitated by Academic Mentors
    • On-line educational packages
    •  Electronic portal for submission and sharing of work
  • Reflective portfolio assessment
  • Calibration of portfolio assessors

The PG Cert required GP educators meet simultaneoulsy the academic standards of the University of Kent, who accredited the course and the GMC professional standards for GP educators’ reaccreditation. 1, 2

43 out of 44 participants met both standards 

·         A breadth of learning including the GP as educator, clinician and team worker

 

·         Reflective portfolio assessment

Conclusion

The evaluation whilst largely positive is not without limitation Data was self reported and collected at a single point.

The results affirm the overall educational strategy and learning from the pilot has informed the continuing PG Cert programme. The Academic Mentors have formed a peer action learning set to share their resources and approaches. There is clearer guidance on time frames. Whilst continuing to support a personalised reflective portfolio guidance has been offered as to the overall body of work expected. Calibration of portfolio assessors has continued.

Evidence of impact on patient care is suggested but there is need for further evaluation.

 

Take-home Messages

 

To develop a PG cert programme with a high completion rate and overall satisfaction:

To develop a PG cert programme with a high completion rate and overall satisfaction:

  •  Make it relevant - high face validity
  • Focus on transferable skills readily applied to the workplace
  • Use facilitated learning sets  
  • Improve reliability of portfolio assessment through on-going calibration of assessors

·         Use facilitated peer learning sets

 

  

References

 

1. General Medical Council (2010) Generic standards for specialty including GP training http://www.gmcuk.org/Generic_standards_for_specialty_

including_GP_training_Oct_2010.pdf_ 35788108. pdf_39279982.pdf (accessed 22.7.13)

2. General Medical Council (2012) Recognising and approving trainers: the implementation plan

http://www.gmcuk.org/Approving_trainers_implementation_plan_Aug_12.pdf_

49544894.pdf (accessed 2/7/13)

3. Holgado-Tello FP Moscoso SC García IB and Chaves SS (2006) Training Satisfaction Rating Scale: Development of a Measurement Model Using Polychoric Correlations European Journal of Psychological Assessment 22: 268–279.

4. Kraiger K Ford JK and Salas E (1993) Application of cognitive, skill-based, and affective theories of learning outcomes to new methods of training evaluation. Journal of Applied Psychology 78: 311-328.

5. Birdi K (2010) The Taxonomy of Training and Development Outcomes (TOTADO): A new model of training evaluation. The B.P.S. Occupational Psychology Conference Book of Abstracts 2010, 32-36.

Summary of Work

 

An External Evaluation was comissioned  and undertaken using both a quantitative and qualitative approach

On line Questionnaire to Course Participants

Quantitative questions with 1-5 point scale based on methodologies used for:

  • Exploring objectives and content, methods and training context and usefullness3
  • Knowledge, skills and confidence attained 4  
  • Broader impacts on GP trainees’ development and the quality of the healthcare system 5  

Two qualitative questions:

  •   Overall strengths of the PG cert
  • Areas for improvement.

 S emi-structured Interviews with Course Participants, HEKSS educators, course administrators

  • 26  Interviews expanding  the questionnaire themes

 

 

 

Summary of Results

On Line Questionnaire obtained a 83% response rate

Questionnaire – key findings

  • s 67% agreed o r strongly agreed planned objectives had been met
  • 79% felt the sharing of personal experience enabled participation
  • 68% felt the PG cert was useful
  • 94% agreed or strongly agreed the course was useful in terms of their development
  • 82% had applied new knowledge in the workplace
  • 73% felt trainees would benefit as a result of their participation in the PG cert
  • 48% felt it would impact positively on healthcare

Interviews – key findings

  • Action learning sets – highly rated
  • Participants felt well supported and motivated by Academic Mentors
  • Portfolio – encouraged reflection and allowed participants to show development over time
  • Calibration of assessors was essential to the process

Examples of reported impact on knowledge, skills and confidence included:

  • Increased ability in searching for and applying evidence together with
  • Increased skills  in undertaking clinical audit
  • Increased abilities in evaluating and managing trainee performance
  • Increased understanding of colleagues' perspectives and skills in developing collaborative learning within GP practices 

Areas for Improvement;

  • Clearer guidance on expectations of participants
  • Improve consistency of experience within Action Learning Sets
  • Clearer guidance on the portfolio submission
  • Earlier access to electronic portal

 

Background
Conclusion
Take-home Messages
References
Summary of Work
Summary of Results
Send ePoster Link