Teaching Excellence Framework

The TEF ratings are based on statistics such as dropout rates, student satisfaction survey results and graduate employment rates. These are assessed by experts in teaching and learning who make a recommendation to a TEF panel, which includes academics and students, that will make the final award. Universities are measured across three areas: teaching quality, learning environment, and student outcomes and learning gain.{{cite web|url=http://www.hefce.ac.uk/media/HEFCE%2c2014/Content/Learning%2cand%2cteaching/TEF/TEFstudent_LeafletV2.pdf|title=Student guide to the Teaching Excellence Framework|publisher=HEFCE|date=December 2016|access-date=3 June 2017}} For 2017, all institutions meeting basic standards will be allowed to raise fees. The first ratings were to have been announced on 14 June 2017, publication having been delayed from May due to the UK general election,{{cite news|title=TEF: big upsets expected in official UK university rankings|url=https://www.theguardian.com/education/2017/may/30/tef-uk-university-rankings-teaching-execellence-framework|date=30 May 2017|author=Anna Fazackerley|work=The Guardian}} but were postponed until 22 June after the election resulted in a hung parliament.{{cite news|url=https://www.timeshighereducation.com/news/publication-teaching-excellence-framework-results-postponed|date=9 June 2017|access-date=13 June 2017|title= Publication of teaching excellence framework results postponed |work=Times Higher Education|author=Chris Havergal}} It was expected that 20–30% of the institutions would be rated gold, 50–60% silver, and 20% bronze.{{cite news|url=https://www.theguardian.com/higher-education-network/2017/jun/19/why-should-i-care-about-the-teaching-excellence-framework-explainer|title= Why should I care about the teaching excellence framework? – explainer|work=The Guardian|author=Rachel Hall|date= 19 June 2017}} The actual distribution, across all rated institutions including further education and alternative providers, was 26% gold, 50% silver, 24% bronze.{{cite news|url=https://www.timeshighereducation.com/news/tef-lse-southampton-and-liverpool-get-bronze|title= TEF: LSE, Southampton and Liverpool get bronze|date=22 June 2017|work=Times Higher Education|author=Jack Grove}}

The ratings are described by the Department for Education as:{{cite web|url=https://www.gov.uk/government/publications/teaching-excellence-framework-year-2-specification|title=Teaching Excellence Framework: year 2 specification|publisher=Department for Education|date=29 September 2016|pages=46–47}}

• Gold: "provision is consistently outstanding and of the highest quality found in the UK Higher Education sector"
• Silver: "provision is of high quality, and significantly and consistently exceeds the baseline quality threshold expected of UK Higher Education"
• Bronze: "provision is of satisfactory quality"

Institutions that do not enter the TEF or that do not meet the minimum quality threshold will not receive an award.{{cite web|url=https://www.ucas.com/ucas/undergraduate/getting-started/what-study/teaching-excellence-framework-tef|title=The Teaching Excellence Framework (TEF)|publisher=UCAS|access-date=3 June 2017|at=What if my university doesn’t have TEF?}} Institutions with insufficient data for a full assessment but which meet the quality standards can receive an unrated provisional award.{{cite web|url=http://www.hefce.ac.uk/news/newsarchive/2017/Name,114556,en.html|publisher=HEFCE|title=New assessment highlights excellence of teaching and learning across UK universities and colleges|date=21 June 2017|access-date=27 June 2017|quote=Providers that meet rigorous national quality requirements but which do not yet have sufficient data to be fully assessed may opt in for a provisional award.}}

The TEF ratings do not measure absolute performance, like traditional university league tables, but rather performance against benchmarks based on their student intake.{{Cite web |last=Bryan |date=2023-11-08 |title=TEF Results 2023: A Guide To The Teaching Excellence Framework |url=https://britannia-study.co.uk/universities/teaching-excellence-framework/ |access-date=2023-12-06 |website=Britannia UK |language=en-GB}} A university with a low absolute dropout rate of 2% and a benchmark of 2% would thus be rated worse on this measure than a university with a much higher absolute dropout rate of 8% but a benchmark of 11%. The ratings thus measure a university based on the profile of students admitted and subjects taught.{{cite web|url=http://wonkhe.com/blogs/tef-results-must-be-carefully-communicated-to-improve-students-choices/|title=TEF results must be carefully communicated to improve students’ choices|author=Sarah Stevens|date=31 May 2017|access-date=3 June 2017|publisher=WonkHE}}

The "initial hypothesis" for the ratings is based on six core metrics, for which institutions receive a double-positive flag, a positive flag, no flag, a negative flag or a double-negative flag, depending on whether they exceed or fall short of their benchmark by certain thresholds. These are:{{cite web|url=http://wonkhe.com/blogs/tef-results-the-full-core-metric-results/|title=TEF results – The full core metrics results|publisher=Wonkhe|date=22 June 2017|access-date=23 June 2017}}

• Teaching on my course (from the National Student Survey)
• Assessment and feedback (from the National Student Survey)
• Academic support (from the National Student Survey)
• Non-continuation (from the Higher Education Statistics Agency and Individualised Learner Record data)
• Employment or further study (from the Destination of Leavers from Higher Education survey)
• Highly skilled-employment or further study (from the Destination of Leavers from Higher Education survey)

Institutions received three or more positive flags and no negative flags are initially considered Gold; institutions with two or more negative flags are initially considered Bronze; all other institutions are initially considered Silver. This initial hypothesis can then be modified by the panel based on the written submissions and 'split' metrics (a breakdown of the core metrics by gender, ethnicity, age, disability, etc.). While the extent of these modifications was expected to be limited, changes were made to the initial hypothesis in 22% of cases. Among higher education institutions and alternative providers, three were downgraded, 17 were upgraded from Bronze to Silver, 15 were upgraded from Silver to Gold, and one was upgraded from Bronze to Gold.{{cite web|url=http://wonkhe.com/blogs/tef-results-who-moved-up-and-who-fell-down/|title=TEF results – Who moved up and who fell down?|publisher=Wonkhe|date=22 June 2017|access-date=23 June 2017}}

Following the publication of the 2017 "trial year" results, the TEF is to undergo a "lessons learned exercise" that will feed into the 2018 exercise as well as a full independent review on its use of statistics by 2020.{{cite web|url=http://www2.warwick.ac.uk/students/news/newsevents/tef-results-2017|title= Positive result in the Teaching Excellence Framework|access-date=22 June 2017|publisher=University of Warwick}}

After the publication of the results, the acting director of the Russell Group said that "TEF does not measure absolute quality and we have raised concerns that the current approach to flags and benchmarking could have a significant unintended impact",{{cite news|url=https://www.independent.co.uk/news/education/education-news/top-uk-university-rankings-gold-silver-bronze-oxford-cambridge-tef-teaching-excellence-framework-new-a7801681.html |archive-url=https://ghostarchive.org/archive/20220526/https://www.independent.co.uk/news/education/education-news/top-uk-university-rankings-gold-silver-bronze-oxford-cambridge-tef-teaching-excellence-framework-new-a7801681.html |archive-date=2022-05-26 |url-access=subscription |url-status=live|title= Elite UK universities found to be second-rate in new Government rankings|work=The Independent|date=22 June 2017|author=Rachael Pells }} while the vice-chancellor of the University of Southampton, which was rated bronze, said "There is no logic in our result at all", and that he had "deep concerns about its subjective assessment, its lack of transparency, and with different benchmarks for each institution removing any sense of equity and equality of assessment". He also pointed out that exceeding the benchmark by what the TEF considered a significant margin was much easier for institutions with lower benchmarks – to beat its benchmark on drop-out rate of 4.5% by the required two percentage points, Southampton would have to have achieved a drop-out rate of only 2.5% – leading him to conclude that "the benchmarking is fundamentally flawed".{{cite news|url=https://www.timeshighereducation.com/news/tef-meaningless-results-devoid-credibility-says-v-c|title=TEF: ‘meaningless’ results ‘devoid of credibility’, says v-c|work=Times Higher Education|date=22 June 2017|author=Jack Grove}}

Analysis of the results and the panel statements by higher education policy thinktank Wonkhe noted that the University of Nottingham, which had a positive flag for highly skilled employment and a negative flag for student satisfaction, was awarded gold, "the presumption that a negative flag would rule out Gold hav[ing] been overturned by the panel, perhaps because the TEF guidance also steered the panel away from over-reliance on NSS scores." Similarly, the University of Bristol overcame two negative flags – both in NSS-related categories – to be awarded silver, but the University of Liverpool, with the same number of negative flags, received bronze, "perhaps because one was not in an NSS-derived category". Wonkhe further noted that "it seems perverse that an institution – in Bristol’s case – which was ‘notably’ below benchmark should receive a higher outcome than Liverpool for which the statement is softer" and that "for institutions with a similar data pattern to Bristol’s, such as Southampton (with two negative flags in the same categories, but which wasn’t upgraded to Silver) there could be some well-deserved anger. And if you look to Durham, with its one positive flag, and no negatives, it only has a Silver result when compared to Nottingham’s Gold."{{cite web|url=http://wonkhe.com/blogs/tef-results-what-the-panel-statements-say-and-dont-say/|title=TEF results – What the panel statements say, and don’t say|publisher=Wonkhe|author=Ant Bagshaw|date=22 June 2017|access-date=24 June 2017}}{{cite news| work=The Tab|title=Durham University fires pure sass in spicy email announcing it will contest silver TEF rating|date=22 June 2017|author=Joe Banfield}}

Nick Hillman, the director of the Higher Education Policy Institute (HEPI), said after the results were released that "the fact that some of the results seem surprising suggests it is working", as it was designed to be different from other league tables. He added, however, that "in this early guise, the TEF is far from a perfect assessment of teaching and learning. While it tells us a lot of useful things, none of them accurately reflects precisely what goes on in lecture halls."{{cite web|url=http://www.hepi.ac.uk/2017/06/22/hepi-director-responds-teaching-excellence-framework-results/|title=HEPI Director responds to the Teaching Excellence Framework results|date=22 June 2017|access-date=24 June 2017| publisher=HEPI}}

In response to some of these points, Chris Husbands, the chair of the TEF panel said that the TEF was not supposed to be a "direct measure of teaching" but rather "a measure based on some of the outcomes of teaching", that different outcomes for institutions with similar metrics was to be directed as "The TEF is metric-led, not metric determined" and that the TEF was "a relative, rather than absolute measure of university and college performance". He also noted that "whilst universities have been impressive at widening participation they have been less assiduous in combatting the impact of disadvantage after students enroll", and said that the TEF was with doing as it had "raised the profile of teaching" and "focused attention on things which need to be done better".{{cite web|url=http://wonkhe.com/blogs/tef-results-the-chairs-post-match-analysis/|title=TEF results – the chair’s post-match analysis|author=Chris Husbands|date=23 June 2017|access-date=24 June 2017|publisher=Wonkhe}}

At a conference held in late June, Imperial College London's Vice Provost, Simone Buitendijk, stated that the TEF was a 'godsend' for higher education. She stated: "For people like me, a vice-provost, TEF exercises are actually a godsend because what happens is, for the first time, the president and the provost start paying close attention to the quality of teaching...It’s not a bad thing if there is very close attention being paid to teaching at research-intensive universities." University College London's President, Michael Arthur, suggested that the TEF would bring benefits to universities in the long-run.{{cite web|title=Imperial vice-provost: TEF a ‘godsend’ for university teaching|url=https://www.timeshighereducation.com/news/imperial-vice-provost-tef-godsend-university-teaching|publisher=Times Higher Education|date=1 July 2017}}

Eighteen institutions chose to appeal their 2017 ratings, including at least four from the Russell Group. Of eleven institutions that said they were appealing, three were awarded Silver and eight Bronze. Appeals must demonstrate a "significant procedural irregularity" and cannot challenge the academic judgment of the TEF panels. At least one institution, Swansea University, submitted an intent to appeal but had its case ruled inadmissible.{{cite news|url=https://www.timeshighereducation.com/news/more-uk-universities-appeal-against-tef-ratings|work=Times Higher Education|date=3 August 2017|author=Chris Havergal|title=More UK universities appeal against TEF ratings}} Only the University of East Anglia was re-graded on appeal, moving from silver to gold, and the only other change made was a revision of the statement of findings for Durham University; all other appeals were rejected. In addition, four institutions appealed their eligibility for provisional TEF awards, of which three were successful.{{cite news|url=https://www.timeshighereducation.com/news/uea-upgraded-gold-teaching-excellence-framework-appeal|title=UEA upgraded to gold in teaching excellence framework on appeal|date=15 August 2017|author=John Morgan|work=Times Higher Education}}

Prior to their publication, the TEF results were expected to be significantly different from the usual rankings of universities in the United Kingdom. The Guardian reported in May 2017 that a number of "world-renowned" universities were at risk of receiving a bronze rating; particularly London institutions, which normally have lower student satisfaction scores. The Times Higher Education also reported in early June 2017 that the members of the Russell Group (two in London) were in danger of being rated bronze, while post-1992 universities were expected to do well. However, universities also submitted additional written information to the TEF to clarify their institutional context: the head of King's College London said that he hoped this would raise the institution from a bronze to a silver rating, while SOAS noted that the financial cost of living in London meant that the student retention rate in the city was lower than the national average. The director of HEPI,

Nick Hillman, said that there might not be any gold-rated universities in London, but that for institutions such as the London School of Economics this would not have a significant impact as "[i]ts name and reputation for research excellence will trump any negative press it gets from the TEF".{{cite news|url=https://www.timeshighereducation.com/news/will-teaching-excellence-framework-shatter-old-hierarchies|title=Will teaching excellence framework shatter old hierarchies?|author=Jack Grove|date=8 June 2017|work=Times Higher Education}} Similarly, a "Mock TEF" carried out by the data analytics team at Times Higher Education in 2016 showed that while Russell Group institutions did well on absolute results, once results were adjusted for student intake only Cambridge, Durham, Birmingham, Exeter and Newcastle (in order of their ranking) were definitely rated as gold, although this did not include any adjustments that may be made for the qualitative submissions from institutions.{{cite news|url=https://www.timeshighereducation.com/features/mock-teaching-excellence-framework-tef-results-revealed-a-new-hierarchy-emerges|title=Mock TEF results revealed: a new hierarchy emerges|work=Times Higher Education|date=23 June 2016}}

The link between the TEF and tuition fees has been criticised, with the National Union of Students (NUS) voting in 2016 to boycott the National Student Survey (NSS), the results of which feed into the TEF, unless the link was broken.{{cite news|url=https://www.timeshighereducation.com/blog/destabilising-teaching-excellence-framework|title=Destabilising the teaching excellence framework|author=Rima Amin|work=Times Higher Education|date=21 April 2016}} There were suggestions that the boycott may have backfired as participation levels in the National Student Survey rose nationally with some commentators linking this to the additional publicity from the boycott.{{cite web|url=https://www.independent.co.uk/student/news/students-boycotting-nus-national-student-survey-oxford-university-warwickcambridge-tef-tuition-fees-a7598216.html |archive-url=https://ghostarchive.org/archive/20220526/https://www.independent.co.uk/student/news/students-boycotting-nus-national-student-survey-oxford-university-warwickcambridge-tef-tuition-fees-a7598216.html |archive-date=2022-05-26 |url-access=subscription |url-status=live|title=Students boycotting NUS National Student Survey boycott|date=24 February 2017|work=The Independent|author=Rachael Pells}} However 12 institutions, including Cambridge, Oxford and several other Russell Group universities, were omitted from the NSS results in 2017 due to having less than the required 50% of final year students complete the survey; which is seen as evidence that the boycott was successful in at least some of those institutions. However, with the boycott coming too late to prevent the use of the NSS in the 2017 TEF, it would be necessary to sustain it for a further two years in order to have any effect and the national NUS conference voted in 2017 not to debate a continued boycott or send it to their National Executive Committee. The boycott may also benefit universities such as Bristol for which student satisfaction has traditionally been low.{{cite web|url=http://wonkhe.com/blogs/nss-boycott-2017/|title=A bruising boycott for the Russell Group|date=9 August 2017|work=Wonkhe|author=Nona Buckley-Irvine}} Whether metrics such as student satisfaction and employability data are valid measures of teaching quality has also been questioned.{{cite news|url=https://www.theguardian.com/education/2015/nov/02/teaching-excellence-framework-university-tef-student-data-higher-education|title=The Teaching Excellence Framework: can higher education up its game?|date=2 November 2015|author=Rebecca Ratcliffe|work=The Guardian}}

Some top universities threatened to boycott the TEF, fearing that reputational damage might outweigh potential gain.{{cite web|url=https://www.theguardian.com/education/2016/nov/22/universities-nus-boycott-teaching-excellence-framework-tuition-fees|title=Universities and NUS plan boycott of flagship teaching rankings|work=The Guardian|date=22 November 2016|author=Anna Fazackerley}} However, in January 2017, just prior to the deadline for signing up, the higher education minister said that "almost all" universities would, after all, take part, and Times Higher Education was able to confirm that all but five of the English Russell Group universities had committed to participating, with the others not yet decided.{{cite news|url=https://www.timeshighereducation.com/news/tef-boycott-fears-allayed-elite-universities-opt|title=TEF boycott fears allayed as elite universities opt in|date=23 January 2017|author=John Elmes}}

{{Reflist| 30em}}

• [https://www.officeforstudents.org.uk/advice-and-guidance/teaching/about-the-tef/ About the TEF], Office for Students

Category:Education in England