Written answers

Tuesday, 22 September 2020

Department of Education and Skills

State Examinations

Photo of Catherine ConnollyCatherine Connolly (Galway West, Independent)
Link to this: Individually | In context | Oireachtas source

423. To ask the Minister for Education and Skills the number of teacher predicted leaving certificate grades which were downgraded in the standardisation process by more than 10, 20, 30, 40 and 50 percentage points, respectively; if an analysis has been carried out regarding the number of students that received downgrades across several subjects; and if she will make a statement on the matter. [24841/20]

Photo of Norma FoleyNorma Foley (Kerry, Fianna Fail)
Link to this: Individually | In context | Oireachtas source

The decision to adopt a model of Calculated Grades by my Department was a direct result of COVID-19, which prevented the state from running the conventional Leaving Certificate Examinations. The purpose of this process is to allow as many students as possible to progress to employment, further education and training, or higher education in a way that is fair and equitable to all Leaving Certificate students.

Schools provided an estimated percentage mark and a rank order (the student's place in the class group) for each student’s subjects. We know from research that teachers are very good at making judgements about their students in the local context of the school.

The process of national standardisation was applied to the school information in order to ensure comparability between the standards applied by individual schools and the national standard. It is important to note that, unlike in other jurisdictions, the starting point for the standardisation process was the estimated percentage marks provided by the school.

The adjustments that occurred through standardisation resulted in the school estimates staying the same or being revised upwards or downwards. While the estimated marks have been subject to a process of adjustment to ensure fairness and comparability across schools, the national standardisation process operated on the premise that the school estimates should only be adjusted through the standardisation process where there was credible statistical evidence to justify changing them.

Following the standardisation process, the estimated percentage mark was converted to a calculated mark and subsequently, a calculated grade which was provided to students on 7September. It is only at this point that students were awarded a grade therefore, it is not accurate to state that student(s) were downgraded, or upgraded, through the standardisation process. Rather the grade that was awarded following the standardisation process is the grade for the 2020 Leaving Certificate Calculated Grades.The degree to which mark changes occurred related to the degree of over or underestimation in the school estimates for each subject and each level. This means that some students experienced mark changes from the school estimates but no changes to the grades based on the school estimates; while others will have experienced changes to the marks leading to a change in the grade that would have been awarded based on the school estimates in one or more of their subjects.

In terms of the grades awarded, 83% (almost 340,000) of all Leaving Certificate subject grades are either the same or higher than the school estimates while 17% (under 70,000) grades are lower. More detailed statistics are available on my department’s website at:

In particular the degree of mark changes between the school estimated marks and the calculated marks are documented in Section 8.2 of the Report of the National Standardisation Group, which is available on www.gov.ie/leavingcert.

It can be seen from the data that only 0.5% all Higher Level and 0.1% of Ordinary Level school estimates (fewer than 2000 results out of a total of 408,000)were reduced by more than 10 marks through the standardisation process.

The degree to which mark changes occurred related to the degree of over or underestimation in the school estimates for each subject and each level. This means that some students experienced mark changes from the school estimates but no changes to the grades based on the school estimates; while others will have experienced changes to the marks leading to a change in the grade that would have been awarded based on the school estimates in one or more of their subjects.

Of the students due to take examinations in the Leaving Certificate (including the Leaving Certificate Vocational) programme, the data requested on the number of students whose grades were different to those that would have been awarded based on the school estimates are set out in the following tables. It should be noted that some students had grades which were higher than the school estimates in some subjects and lower in others.

Number of grades which were lower than the school estimates by student

No of grades No of students Percent
0 19,596 34.0
1 18,584 32.3
2 11,663 20.2
3 5,288 9.2
4 1,885 3.3
5 488 0.8
6 83 0.1
7+ 11 0.0
Total 57598 100.0

Number of grades which were higher than the school estimates by student

No of grades No of Students Percent
0 44572 77.4
1 10842 18.8
2 1843 3.2
3 297 0.5
4 38 0.1
5 6 0.0
Total 57598 100.0

Photo of Christopher O'SullivanChristopher O'Sullivan (Cork South West, Fianna Fail)
Link to this: Individually | In context | Oireachtas source

424. To ask the Minister for Education and Skills if she will revise the avenues of appeal for the school calculated grades available to leaving certificate students; and if she will include a way to appeal the difference between the marks given by a school and the grade ultimately awarded by her Department. [24847/20]

Photo of Norma FoleyNorma Foley (Kerry, Fianna Fail)
Link to this: Individually | In context | Oireachtas source

The decision to adopt a model of Calculated Grades by my Department was a direct result of COVID-19, which prevented the state from running the conventional Leaving Certificate Examinations. The purpose of this process is to allow as many students as possible to progress to employment, further education and training, or higher education in a way that is fair and equitable to all Leaving Certificate students.

Schools provided an estimated percentage mark and a rank order for each student’s subjects. The process of national standardisation was applied to the school information in order to ensure comparability between the standards applied by individual schools and the national standard. We know from research that teachers are very good at making judgements about their students in the local context of the school. It was inherent to the system of calculated grades that school estimates would be subject to adjustment through this standardisations process. The adjustments that occurred through standardisation resulted in the school estimates staying the same or being revised upwards or downwards. The standardisation process operated on the premise that the school estimates should only be adjusted through the standardisation process where there was credible statistical evidence to justify changing them.

Following standardisation, the estimated percentage mark was converted to a calculated mark and subsequently, a calculated grade which was provided to students on 7 September. It is only at this point that students were awarded a grade.

Therefore, it is not accurate to state that student(s) were downgraded, or upgraded, through the standardisation process. Rather the grade that was awarded following the standardisation process is the grade for the 2020 Leaving Certificate (Calculated Grades).

Some students experienced mark changes from the school estimates but no changes to the grades based on the school estimates; while others will have experienced changes to the marks leading to a change in the grade that would have been awarded based on the school estimates in one or more of their subjects.

In terms of the grades awarded, 83% (almost 340,000) of all Leaving Certificate subject grades are either the same or higher than the school estimates while 17% (under 70,000) grades are lower.

Every effort has been made to make the system as fair as possible for as many students as possible. The statistical model used was blind to demographic characteristics, either at the level of the student or the school and the standardisation process has been applied uniformly across all schools. This means anyone using the certificate to make a judgement between two people who hold this certificate, either now or in the future, can place equal value on the same grade in the same subject, without regard to where they went to school.

We appreciate that some students will be disappointed at the results they have achieved. This is the case every year when the Leaving Certificate results are published.

Students, at an individual level, had access to an appeals process the closing date for which has now passed. The appeals system is, by design, restricted to looking for technical errors in the data provided on behalf of students and in the processing of that data. The nature of this appeal process has been part of the system of Calculated Grades from the outset. The appeal process will involve a technical appeal focused on looking for errors in the transmission of the data through the process. An example of this would be whether any mistake has been made in entering the information to any of the systems used in the process.

It was fundamental to the adoption of a system of Calculated Grades that the professional judgement of the school (teachers and principals) would be outside the scope of the appeals process.

The integrity, validity and reliability of the process of national standardisation was overseen by the National Standardisation Group whose role was to oversee the application of the statistical model to the school data. Any appeals process that would allow an individual student level appeal to reopen the application of the statistical process to the school sourced data would fundamentally undermine fairness and equity in the system of calculated grades.

Students dissatisfied with the outcome of the appeals process can invoke a separate process to have their appeal reviewed by independent Appeals Scrutineers. These Scrutineers are independent of the Department.

Students who consider that their appeal has not been processed correctly can make a complaint to the Ombudsman or, in the case of students under 18 years of age, the Ombudsman for Children.

Students dissatisfied with their results will have the opportunity to sit written Leaving Certificate examinations in November (subject to public health advice). Those who sit the examinations will be credited with the higher subject grade achieved between the Calculated Grade and the written exam.

Comments

No comments

Log in or join to post a public comment.