Academies and Charters – where’s the evidence?Posted: November 13, 2012
Trevor Fisher writes:
1. The Obama victory has lifted the threat of the explosion of Charter Schools in the US that a Romney victory would have triggered. Ann Romney clearly stated the dogma – Charters are a magic bullet being held back by teacher unions. This is the same dogma as the Academy movement in England, as Cameron’s Tory conference speech made clear.
2. However this is only marginal relief. Obama is also committed to Charters and the political consensus on both sides the Atlantic is pro the chaos model. Labour in England created the academies and supports Academies and Free schools.
The Evidence issue
3. The key issue remains the evidence problem, the astonishing lack of evidence on either side of the Atlantic for the new model and the failure to view objectively the development of the systems. This will become even sharper with the release of new exam data in England in January, so a review of the problems is a necessary task.
4. The evidence gap is simply stated, and was stated by Ron Glatter in the Guardian (Teacher Network 29th October). As he says “there is no convincing evidence to support the government’s attempt to make virtually all schools academies or free schools”. As Glatter said in his article, “almost all the data relates to the small number of academies set up under the last government”, and it may be worth focusing on the lack of data produced by government on their new academies as an issue in its own right.
5. But the central problem lies in the main studies. These are the NAO (National Audit Office) study cited by the Public Accounts Committee (2011) and the LSE study. Curiously, the DFE in a letter to me of 12th January last in stating autonomy improves school performance cited only the Machin and Vernoit (2011) study, the LSE study. I have no idea why they did not cite the NAO study.
6. However academy supporters cannot now cite the Machin and Vernoit study. Machin wrote an article in the Guardian Education section on 10th April 2012, arguing against the government using the LSE study to support the Academisation programme . The key sentence reads: “Unfortunately, our evidence on Labour academies has frequently been marshalled in support of the new academies programme… without offering the caveat that the new academies are rather different…. We do not yet have robust, academically rigorous evidence on the coalition academies”. This statement is valid and has stopped the government using the study in support of their programme. Machin is right to argue the new academies are too different to use the LSE data in support. (Technically they are convertor as opposed to sponsor: but even where new academies have sponsors they are no longer the same – little extra finance and no new buildings)
7. While the LSE study and NAO can still be used for the old Labour academies, with the severe limitations noted below, there is, remarkably, no academic study of the coalition academies, yet we are more than two years into the programme. There never has been any evidence for academies bringing about improvement in primaries, while the idea of Pupil Referral Units being academised and run by payment by results is bizarre. That the government proceeds with no evidence on its own academies is a truly Orwellian situation. This is clearly a dogmatic programme, indifferent to the lack of evidence and without effective scrutiny.
8. Whether the Pearson study will produce evidence remains to be seen. When I contacted them in the summer they were still looking for evidence on the coalition academies. However as Glatter says, we have to rely on the old Labour academies, and the problems here are formidable. Even though the NAO and LSE study are accurate, their data uses Labour rules, which allowed vocational equivalents. Following the cogent objections of the Wolf report, the Tories abandoned these, and though they may have gone too far, gaming obviously took place, and especially in the Academy sector. Take away Vocational Equivalents something very odd occurs. The Academies become the least successful schools, suggesting that they have been gaming. Gaming is unacceptable. If Academies are gaming more than other schools, this is a major scandal.
The Impact Of Ebacc.
9. Once Gove’s chosen measure of EBacc is used, the Academy sector becomes the most unsuccessful in the secondary field. Only one media source has picked this up, namely Channel 4 news. Their “fact check” of 6th January 2012 noted that “Last summer (ie 2011 TF) analysts from the Times Educational Supplement, among others, noted that academies tended to do much worse on the EBacc…. This was not mentioned by the Department for Education when it issued its official press release about the GCSE results”. While the DfE is coy about the issue, it knows about it. The DfE evidence to the select committee on EBac in spring 2011 showed that on EBacc academies do worse.
10. It is important not to endorse EBac, it is a terrible backward looking measure. But the issue is the bizarre situation where a revolutionary government hurtles forward when on its own chosen measure, its chosen schools are the worst performers of all. And the media do not notice. Orwellian or what?
The surveys of 2012
11. The three major surveys of academy performance in 2012, point in one direction, but have failed to spark debate. The first, Henry Stewart’s for LSN, analysing the 2011 16 plus results as published in January 2012 publication, was picked up by the Observer of 25th February. This can be accessed from http:bit.ly/A49cXr.
12. However the other two were ignored by media. The House of Commons Library published an objective study on February 28th as Standard Note SNO 4719 and which can be accessed at http://www.parliament.uk/briefing-papers/SNO4719. This has not been analysed by any media that I have tracked.
13. Then on September 4th, a major study by Terry Wrigley and A Kalambouka was published by Changing Schools, which can be accessed at www.changingschools.org.uk. They concluded “Academies are not improving faster than non-academies with similar characteristics… the apparent year on year improvement of many academies also depends critically on their exploitation of alternative qualifications”. On the EBacc problem referred to above, they stated “There is a clear contradiction in government policy in that the supposed success of academies is based on qualifications that ministers distrust and are in the process of abolishing”. With vocational equivalents now “persona non grata”, how can ministers still use them to back the academy programme?
A scandal and a Wall of Silence
14. Academies not merely lack the evidence base for what their advocates call a revolution, but it has become increasingly clear as the coalition has progressed that the evidence base for the academies depends on vocational equivalents which the Tories intend to phase out. This profoundly weakens the case that academies successfully improve performance. With these qualifications stripped out academies perform worse than any other schools
15. We are thus faced with two major scandals – the first is obviously that the government intends to turn all schools into a form of schooling which is inferior to existing systems. The second is that there is no effective media scrutiny. The possibility of a cover up of major proportions is now developing, made more likely by the increasingly large sums going to academy and charter schools. On both sides of the Atlantic, a wall of silence is developing which will now overshadow the simple question, on which the evidence is now relatively well established, “How well does the new model perform?” How can the silence be broken?