TIMSS and PIRLS

The latest instalment in the international educational data soap opera has been published today. TIMSS and PIRLS between them seek to measure comparative international performance in maths and science for 10 and 14 year olds and in reading for 10 year olds. They also seek to show how performance has changed in absolute terms in different countries across time.

There is something very beguiling about this kind of report. It has a wonderful air of precision and it’s very easy to forget things like margins of error and differences between countries in how tests are managed. For example in 2007 Kazakhstan was apparently fifth in the world in maths for 10 year olds. Really?

Having said that, everyone is going to be poring over the results and trying to draw lessons from them. So what do they show?

In terms of absolute performance for England they show:

  • A big improvement in primary maths since 1995 with most of the improvement being between 1995 and 2003.
  • Overall an improvement in secondary maths since 1995 but with a slight falling back between 2007 and 2011.
  • A small decline in primary reading between 2001 and 2006 balanced by an improvement between 2006 and 2011.
  • After improvement between 1995 and 2007 in primary science, some falling back between 2007 and 2011.
  • A very modest improvement in secondary science between 1995 and 2003 but an equally modest decline since then.

In terms of relative performance, it’s much the same story. Up in some, down in others but in both cases within a narrow range. We also need to notice that participation varies – some countries didn’t take part every year and this affects league table position.

What conclusions can we draw from this? First perhaps in the immortal words of Corporal Jones “don’t panic”.  Other countries see small scale improvement and decline. For example between 2003 and 2007 secondary maths in Singapore and Hong Kong both declined. Any individual result should be approached with some caution and could easily be statistical noise.

So can we draw any useful conclusions? I would suggest that in very broad terms we can say:

  • English performance is overall pretty consistent and is amongst the best performers in the world.
  • It’s better than the great majority of European countries – even very close to the much lauded Finland in maths.
  • So this data doesn’t support the Govian nightmare of plummeting standards across the board.
  • We should see if there is other evidence to support or deny the suggestion of a decline in science performance.

One other finding worth looking at is the range of achievement in England. The gap between the highest and lowest performance in England is wider than in virtually all the countries with similar overall results. The idea that we have a tail of under-achievement is supported by this data. OECD would suggest that this has something to do with the fact that we have one of the most socially and economically segregated education systems.

The leading Asian countries remain, by this measure, the world’s highest achievers. But before we go chasing after what we think are the lessons to be learnt from them, there is a very telling section in the Guardian’s article about these results:

“The paradox is that while Truss and her boss, the education secretary, Michael Gove, seek a move towards an Asian-style system of crammed facts and rigorous exams, educators in those countries are wrestling with the paradox that their pupils too often emerge competent but narrow and uncreative in their thinking. Earlier this year Singapore’s education minister proposed a long-term move towards a less restrictive system.”

That certainly is something we should be thinking about.

Advertisements

3 Comments on “TIMSS and PIRLS”

  1. 3D Eye says:

    The Guardian article you refer to is incorrect. Singapore long ago understood that cramming and frequent high-stakes tests result in young people becoming both stressed and uncreative. It was for this reason that Singapore changed to the Finnish model, which Singapore calls “Teach Less, Learn More.” Singapore’s growing and continuing success in education is the result of this switch, which is also the case in Hong Kong and in Shanghai Province, and will soon be the case in the rest of China now that the Shanghai ‘pilot’ has proved to be successful. This article expains more fully – http://3diassociates.wordpress.com/2012/11/28/return-to-singapore/ Please take a few minutes to look at the video that’s linked to in the article.

    It’s a myth that the whole of East Asia achieves its success in education through ‘traditional’ methods. Sure, South Korea’s children achieve high scores in formal tests and they have mainly didactic teaching and an incredibly long day of schooling and extra-curricular tutoring/cramming. But even in South Korea there’s a growing awareness that their children are extremely stressed and increasingly unhappy, just as UNICEF noted was the case in Britain. Because of this the South Koreans are also taking note of the Finnish model – since they also see that children should enjoy learning, and are more likely to develop creative skills as well as social skills, communication skills and personal self-confidence in settings that encourage collaboration rather than competition, collegiality rather than individualism, and self-directed learning rather than spoon feeding.

    The power of technology in learning and a concern for the wellbeing of children and their all-round development are the engines that are driving revolutionary developments in education elsewhere in the world. We continue to ignore these things at our peril – if the wellbeing and the achievements of our children and young people are our real concern. The best British educators already understand these things and are often superb at providing stimulating and motivating learning in our classrooms, in spite of what the ‘traditionalists’ insist is best practice. The CBI has taken note of this and has called for the abolition of all 16+ exams, along with a move towards more creative teaching and learning.

    The government can say what it likes, but we must not be fooled into thinking that the East Asian countries have clung to outmoded and damaging forms of education. The leaders in education in those countries are, on the whole, far too smart for that. Teachers in Britain must not be misled into thinking that, apart from whacky little Finland, the rest of the high-achieving nations are hell bent on pursuing “an Asian-style system of crammed facts and rigorous exams”. Nothing could be further from the truth. Please feel free to re-publish our article as a corrective to misunderstandings and misinformation.
    GF

  2. Paul says:

    Absolutely right. Performance-related pay has probably never worked for anyone apart from soap powder salesmen and only in an economic boom.
    It’s useless for any type of work dependent on collaboration.
    But it’s a good way to divide and rule!