Regional Quality Assurance Events

The Regional Quality Assurance (RQA) events have previously coincided with Secondary Care Appraiser Training. This year they will take place as a separate event and this will be the model going forward. 

We have two RQA events planned for later this year, one event will held in South Wales and the other in North Wales. They are likely to take place in the autumn, the dates and locations will be confirmed over the coming months. If you have any questions about RQA please contact the Quality and Revalidation team on RevalOfficer@cardiff.ac.uk 

2017 Regional Quality Assurance Event Highlights

During late 2017 the RSU provided three RQA events; St Asaph (Optic Centre) 26th October 2017, Swansea (Morriston) 10th October 2017 and Cardiff (Cardiff Football Stadium) 24th November 2017.  These ran during the morning sessions with secondary care appraiser training making up the afternoon programme hosted by the regional designated body.

Appraisers in both primary and secondary care attended the events to review the outputs of appraisal by reviewing appraisal summaries against agreed quality criteria. The number of summaries reviewed totalled 4% of both primary and secondary care appraisals from the 1st October 2016 to 30th September 2017.  In total 246 (4.3%) summaries of both primary and secondary care summaries have been scored for analysis. It was also agreed in 2017, secondary care appraisals would be doubled marked to specifically look at the consistency of marking.  Across the Health Boards 147 secondary care summaries were double marked.

Table 1: The All Wales Average Scoring for primary and secondary care summaries.  

 

Appraisal

Revalidation

Overall Average

2016-17

Previous Year’s Average 2015 -16

Primary Care

88%

83%

87%

88%

Secondary Care

57%

45%

55%

55%

Combined

68%

49%

67%

67%

In secondary care more than half of the overall summaries score above 50%. In primary care this reached 99%. The breakdown of appraisal and revalidation criteria identifies the revalidation criteria scores lower overall. Again this supports the requirement to review the criteria to ensure the criteria is asking the correct questions with regards to revalidation and that they are relevant to every appraisal.

The breakdown scores are helpful to see the overall performances within the designated bodies and can then be linked into to the Appraisal lead networks and ongoing training and development of appraisers.

Table 2. Overview of the number of appraisers’ summaries in primary care which were quality assured within their geographical team.

Primary AC Teams (Managed across localities rather than DB.)

Cardiff

Gwent

Mid Glam

North East

North West & Powys

South West

West

Combined

Number of Appraisers in AC Team

15

18

14

13

12

13

13

98

Number of Appraisers Summaries scored

8

11

12

7

6

8

6

58

Number of  total Summaries scored*

12

17

17

12

8

13

13

92

% of Appraisers’ summaries quality assured

53%

61%

86%

54%

50%

62%

46%

59%

*some appraisers have had more than one summary scored.

The national event aim is to provide a snapshot of quality across Wales. The table shows within primary care how a minimum of half of all appraisers’ are subject to one of their summaries being randomly selected as part of the event. In primary care there is an experienced team of Appraisal Co-ordinator’s (ACs), who throughout the year provide continued support and training to their appraisers. The MARS system also provides ongoing appraiser feedback directly from appraisees which is reviewed annually by the AC with the appraiser. The ACs receive individual reports from the RQA to give assurances regarding their management of their team and where to focus ongoing training on.


Previous