Jim O'Callaghan (Dublin Bay South, Fianna Fail)
Link to this: Individually | In context | Oireachtas source

470. To ask the Minister for Education and Skills the reason students from schools that previously excelled at the leaving certificate have had their results downgraded due to that excellence. [25255/20]

Norma Foley (Kerry, Fianna Fail)
Link to this: Individually | In context | Oireachtas source

The decision to adopt a model of Calculated Grades by my Department was a direct result of COVID-19, which prevented the state from running the conventional Leaving Certificate Examinations.

The design of the Calculated Grades model was informed by advice from a Technical Working Group comprising experts drawn from the State Examinations Commission, the Inspectorate of the Department of Education and Skills, the Educational Research Centre and international external expertise.

Schools provided an estimated percentage mark and a rank order for each student’s subjects. The process of national standardisation was applied to the school information in order to ensure comparability between the standards applied by individual schools and the national standard. We know from research that teachers are very good at making judgements about their students in the local context of the school. Schools approached this task in a very professional manner, in line with detailed guidelines about the process, but inevitably some schools were overly harsh in their estimations while others were overly generous. This is to be expected given that there is no national standard on which to base an estimated mark. But to be fair to the class of 2020, the teacher judgements made at the level of the school had to be adjusted so that a common national standard was applied.It was inherent to the system of calculated grades that school estimates would be subject to adjustment through this standardisations process.

These adjustments resulted in the school estimates staying the same or being revised upwards or downwards. The standardisation process operated on the premise that the school estimates should only be adjusted through the standardisation process where there was credible statistical evidence to justify changing them.

This standardising process happens every year and would have happened in 2020 had the Leaving Certificate examinations been run as normal.The standardisation process applied across all subject and levels. The degree to which mark changes occurred related to the degree of over or underestimation in the school estimates for each subject and each level. This means that some students experienced mark changes from the school estimates but no changes to the grades based on the school estimates; while others will have experienced marks changes from the teacher estimates leading to grade changes in one or more of their subjects.

Following standardisation, the estimated percentage mark was converted to a calculated mark and subsequently, a calculated grade which was provided to students on 7September. It is only at this point that students were awarded a grade.

Therefore, it is not accurate to state that student(s) were downgraded, or upgraded, through the standardisation process. Rather the grade that was awarded following the standardisation process is the grade for the 2020 Leaving Certificate (Calculated Grades).

The overall data on school estimated marks showed that there was a very significant rise in estimated grades against what would normally be achieved nationally. This level of grade increase based on the school estimates would have been unrealistic. For example, based on the school data there would have been 13.8% H1 grades this year when in a normal year there is 5.8%. Even with the standardisation process the rate of H1s this year is over 9%.

In terms of the grades awarded, 83% (almost 340,000) of all Leaving Certificate subject grades are either the same or higher than the school estimates while 17% (under 70,000) grades are lower.

In the absence of the Leaving Certificate examinations in 2020 every effort has been made to make the system as fair as possible for as many students a possible. The statistical model used was blind to demographic characteristics either at the level of the student or the school.The standardisation process means that the same standard has been applied uniformly across all schools. This means anyone using the certificate to make a judgement between two people who hold this certificate, either now or in the future, can place equal value on the same grade in the same subject, without regard to where they went to school, as they would in a normal year. The evidence does not suggest that any particular type of school has been disadvantaged by the standardisation process.

Individual Junior Cycle results was not used to determine any individual’s Calculated Grades. Rather, the Calculated Grades process took account of the overall Junior Cycle performance of the Leaving Certificate class of 2020 in each school and used this data to help in predicting the likely range of Leaving Certificate performance of that group. The fact that the vast majority of 2020 Leaving Certificate students would have sat the Junior Cycle examinations provides a good means of predicting the pattern of performance of these students at an aggregate level. The process was not applied at an individual student level and the absence of Junior Cycle results for an individual student l will not disadvantage that student within the statistical process.

While some students will be disappointed at the results they have achieved, this is the case every year when the Leaving Certificate results are published. It may be more difficult for students to understand when they see the estimated mark from the school.

The standardisation model has been subject to a high degree of human oversight by the National Standardisation Group with a number of safeguards built in to ensure fair results for students.

Technical details of the Calculated Grades model and standardisation process were published on the date of issue of the results and are available here: .

Jim O'Callaghan (Dublin Bay South, Fianna Fail)
Link to this: Individually | In context | Oireachtas source

471. To ask the Minister for Education and Skills the steps she plans to take to remedy the disadvantage suffered by students whose leaving certificate results were downgraded. [25256/20]

Norma Foley (Kerry, Fianna Fail)
Link to this: Individually | In context | Oireachtas source

The decision to adopt a model of Calculated Grades by my Department was a direct result of COVID-19, which prevented the state from running the conventional Leaving Certificate Examinations. The purpose of this process is to allow as many students as possible to progress to employment, further education and training, or higher education in a way that is fair and equitable to all Leaving Certificate students.

Schools provided an estimated percentage mark and a rank order for each student’s subjects. The process of national standardisation was applied to the school information in order to ensure comparability between the standards applied by individual schools and the national standard. We know from research that teachers are very good at making judgements about their students in the local context of the school. It was inherent to the system of calculated grades that school estimates would be subject to adjustment through this standardisations process. The adjustments that occurred through standardisation resulted in the school estimates staying the same or being revised upwards or downwards. The standardisation process operated on the premise that the school estimates should only be adjusted through the standardisation process where there was credible statistical evidence to justify changing them.

Following standardisation, the estimated percentage mark was converted to a calculated mark and subsequently, a calculated grade which was provided to students on 7 September. It is only at this point that students were awarded a grade.

Therefore, it is not accurate to state that student(s) were downgraded, or upgraded, through the standardisation process. Rather the grade that was awarded following the standardisation process is the grade for the 2020 Leaving Certificate (Calculated Grades).

Some students experienced mark changes from the school estimates but no changes to the grades based on the school estimates; while others will have experienced changes to the marks leading to a change in the grade that would have been awarded based on the school estimates in one or more of their subjects.

In terms of the grades awarded, 83% (almost 340,000) of all Leaving Certificate subject grades are either the same or higher than the school estimates while 17% (under 70,000) grades are lower.

Every effort has been made to make the system as fair as possible for as many students as possible. The statistical model used was blind to demographic characteristics, either at the level of the student or the school and the standardisation process has been applied uniformly across all schools. This means anyone using the certificate to make a judgement between two people who hold this certificate, either now or in the future, can place equal value on the same grade in the same subject, without regard to where they went to school.

We appreciate that some students will be disappointed at the results they have achieved. This is the case every year when the Leaving Certificate results are published.

Students, at an individual level, had access to an appeals process the closing date for which has now passed. The appeals system is, by design, restricted to looking for technical errors in the data provided on behalf of students and in the processing of that data. The nature of this appeal process has been part of the system of Calculated Grades from the outset. The appeal process will involve a technical appeal focused on looking for errors in the transmission of the data through the process. An example of this would be whether any mistake has been made in entering the information to any of the systems used in the process.

It was fundamental to the adoption of a system of Calculated Grades that the professional judgement of the school (teachers and principals) would be outside the scope of the appeals process.

The integrity, validity and reliability of the process of national standardisation was overseen by the National Standardisation Group whose role was to oversee the application of the statistical model to the school data. Any appeals process that would allow an individual student level appeal to reopen the application of the statistical process to the school sourced data would fundamentally undermine fairness and equity in the system of calculated grades which relies on the uniform application of the statistical model.

Students dissatisfied with the outcome of the appeals process can invoke a separate process to have their appeal reviewed by independent Appeals Scrutineers. These Scrutineers are independent of the Department.

Students who consider that their appeal has not been processed correctly can make a complaint to the Ombudsman or, in the case of students under 18 years of age, the Ombudsman for Children.

Students dissatisfied with their results will have the opportunity to sit written Leaving Certificate examinations in November (subject to public health advice). Those who sit the examinations will be credited with the higher subject grade achieved between the Calculated Grade and the written exam.

Donnchadh Ó Laoghaire (Cork South Central, Sinn Fein)
Link to this: Individually | In context | Oireachtas source

472. To ask the Minister for Education and Skills when the timetable for the leaving certificate re-sits in November 2020 will be released to students. [25280/20]

Norma Foley (Kerry, Fianna Fail)
Link to this: Individually | In context | Oireachtas source

The State Examinations Commission has statutory responsibility for operational matters relating to the certificate examinations.

In view of this I have forwarded your query to the State Examinations Commission for direct reply to you.

Donnchadh Ó Laoghaire (Cork South Central, Sinn Fein)
Link to this: Individually | In context | Oireachtas source

473. To ask the Minister for Education and Skills if the appeals process for calculated grades will be expedited for students that indicate that they will be sitting the November 2020 exams in order that they are not unnecessarily studying for subjects whose grades may increase on appeal; and if she will make a statement on the matter. [25283/20]

Norma Foley (Kerry, Fianna Fail)
Link to this: Individually | In context | Oireachtas source

The Calculated Grades Student Portal reopened on 14 September to allow students to view their estimated percentage mark and calculated mark to allow students to consider this data if they were considering an appeal of their Calculated Grade.

The appeals process is a process review focussed on looking for errors in the transmission and processing of student data through the process. It is not possible to appeal the information (estimated percentage mark or rank order) provided by the school. Due to the nature of the Calculated Grades system the professional judgement of the school is outside of the appeals process. It should further be noted that the design of the statistical model and the application of the national standardisation process is also outside of the scope of the appeals process.

At the time of closing the appeal application process on Wednesday 16 September, some 12,300 students had appealed almost 33,700 grades. Every effort will be made to process appeals as quickly as possible but it is not possible at this time to commit to a date for the issue of the appeal results. Students will be notified of this date as soon as possible. It is not possible to provide an expedited appeal for any student or group of students. All appeals will be processed, and results released, simultaneously to ensure fairness and equity to all.