Ranting, raving and complaining Hattie and the tenor of debate within Education
I agree with the contention that Australia is within the grip
of a movement described as “the Cult of the Guru” with John Hattie as the
visible figurehead and Visible Learning as
the corporate and commercial arm.
It is worth noting that the emergence of Hattie within Australia
closely mirrors the rise of Dylan Wiliam’s in the United Kingdom and more
recently the USA. Wiliams’ Classroom Experiment
and Hattie’s Revolution School TV
programs, Wiliam’s Learning Sciences
International and Hattie’s Visible Learning
bear much in common, though their agendas differ.
So, it is clear that this is not merely an Australian trend,
but one aspect of the broader ‘Global Education Reform Movement’ (Sahlberg 2006;
2016), a trend whose examples I am sure others more qualified than I could add
to.
The critiques of Hattie’s methods are numerous and robust (Bergeron
& Rivard, 2017; Higgins & Simpson, 2011; McKnight & Morgan, 2019; Simpson,
2017; 2018; Terhart, 2011), and those that stick to strict critiques without
personal attacks or confusing the company of VL and Hattie’s academic
production have won much favour and support within the broader education space,
including some teachers and leaders. These works have generated considerable
traction within the academic spheres of education.
The work of Ollie Lovell’s Education Research Reading Room and
Cameron Malcher’s Teachers Educational Review podcasts and the incredibly
accessible and robust passion project of George Lilley’s blog: http://visablelearning.blogspot.com/
are doing exemplary work of bridging the gap between academia’s ivory, pay-wall
encircled, towers. Also, by making it clear the pitfalls and complexities within
Academia and those who would try to sell simple solutions to complex contextual
problems. But awareness and consumption of these accessible bridging works
among both teachers and leaders are low.
It is important to always emphasise the distinction between
the two realms of: the education system (the doers); and the educational
academia (the thought leaders) and to note they are largely disconnected.
Typically the education system lags roughly 10 years behind best practice
discussion within academia, something that is not true for medical research,
hence the push and temptation towards ‘Evidence-based Education’ (Bergeron
& Rivard, 2017).
Hattie may believe that the critics of his approach in Academic
journals are visible to leaders in Australian schools but by-and-large they are
not, due to a range of barriers but also simple lack of interest. This is why
Eacott’s positioning of the ‘Cult of Hattie’ rings so true to educators ‘at the
chalkface’, an effect he notes in the impressive response he has had to the 2018
article, whilst even those most accessible, such as those sampled above hold
comparatively less sway. McNight and Morgan (2019) state that Random Control
Trials (RCTs) “…serve to buttress eminence-based claims to prestige made by
gurus”, this phrasing fits neatly with Eacott’s expression of this movement and
shows the way that teachers are silenced by this cult, even though among it’s
core tenets are the empowerment and centrality of the teacher.
For his part, Simpson (2018) conflates Hattie’s work with a
much broader and more complex discussion of Evidence-based Education (McKnight &
Morgan, 2019), the “What Works” movement (Hammersley, 1997; Olson, 2004: Slavin,
2002; 2004) and his own vague and sweeping statement of the “identical,
fundamentally flawed arguments underpin much of the ‘evidence-based education’
movement.” (2018, p.2). Yet despite this oversight, his criticism of Hattie’s
method ring true and remain robust and compelling. They are however not as broadly
accessible to teachers and leaders without qualifications in education research
or knowledge of statistics.
Scott Eacott (2017) provides the most compelling account of
the conditions that allow for the “Cult of the Guru” within Australian
Educational Leadership. Not surprisingly, he focuses on the work of John
Hattie, perhaps the most current and ‘hot’ figure in this line of gurus (though
he notes others such as: Pasi Sahlberg, Michael Fullan, Andy Hargreaves and Yong
Zhou). Crucially this movement is occurring just as our focus on Finland and
Pasi Sahlberg’s representation of it and more broadly the idea of comparative
education policy development is in something of a recession, between the
release of PISA data cycles, as we currently are. His work broadens out the idea
of a mere criticism of Hattie’s work and considers the fertile ground that
allowed for this culture to emerge. Personally, I believe a direct line can be
tracked from the presentations of Sir Ken Robinson, Sal Kahn and Sugata Mitra
(among others) who laid the groundwork for a cult of edu-celebrity, whilst also
denying the system any concrete answers or approaches to the issues they identified
and espoused. As Eacott (2017) notes, it was the practicality and the Taylorist
presentation (if not necessarily content) that made these ideas, and Hattie as
the Guru, so compelling.
John Hattie’s (2017) response proves not only his
disconnection with the actual teachers that form the majority of the education
sphere, but also reveals an unwillingness to engage with the quite interesting
ideas being presented. The core disagreement stems from Hattie’s approach to make
‘bold conjectures’, citing Popper, something that seems directly in opposition
to the scientism basis of his approach to meta-meta analyses. But further his Thesis-antithesis-synthesis
conception of academia clashes directly with Eacott’s version of argument-refutation.
Personally, I lean towards the argument refutation approach as it involves
actively engaging with another person’s ideas and responding to them. This has
consistently been seen as something that Hattie avoids, instead rolling out similarly
phrased platitudes without directly addressing those arguments, or more
commonly refutations, in opposition to his work.
As with all arguments, the core thing that impacts on teachers
and school leader’s ability to actively respond to, and be critical of,
convenient and robust-sounding research is time poverty. As a teacher and budding
educational leader, I would love to agree with Hattie’s title that “Educators
are not uncritical believers of a cult figure”. Sadly, this is not true, for a
range of multiple and complex reasons including time poverty, lack of
statistical awareness and the relatively new shift towards instructional leadership
rather than transformational leadership. For those still unclear about the challenges
made to Hattie’s research and his responses to criticism I strongly recommend delving
into the reference list below.
Lastly, you, the reader, do you believe we as Educators are
uncritical believers of a cult figure?
References
Bergeron, P. J., & Rivard, L. (2017). How to Engage in
Pseudoscience with Real Data: A Criticism of John Hattie’s Arguments in Visible
Learning From the Perspective of a Statistician. McGill Journal of
Education/Revue des sciences de l'éducation de McGill, 52(1), 237-246.
Eacott, S. (2017) School leadership and the cult
of the guru: the neo-Taylorism of Hattie, School Leadership &
Management, 37:4, 413-426.
Eacott, S. (2018). Ranting, raving and complaining: reflections
on working against orthodoxy. International Journal of Leadership in
Education, 1-9.
Gilliland, A. & Stevenson, H. (2015) Teacher Unions at
the Heart of a New Democratic Professionalism. Howard Stevenson, Alison
Gilliland. From: Evers, J., & Kneyber, R. (Eds.). (2015). Flip
the system: Changing education from the ground up. Routledge.
Hammersley, M. (1997). Educational research and teaching: a
response to David Hargreaves’ TTA lecture. British Educational Research
Journal, 23(2), 141-161.
Hattie, J. (2017) Educators are not uncritical
believers of a cult figure. School Leadership & Management 37:4,
pages 427-430.
Higgins, S., & Simpson, A. (2011). Visible Learning: A
Synthesis of over 800 Meta-Analyses Relating to Achievement. By John AC Hattie:
Pp 392. London: Routledge. 2008.£ 90 (hbk),£ 27.99 (pbk),£ 35.37 (e-book).
ISBN-13 978-0415476171 (hbk), ISBN-13 978-0415476188 (pbk), ASIN: B001OLRMHS
(e-book).
McKnight, L., & Morgan, A. (2019). A broken paradigm?
What education needs to learn from evidence-based medicine. Journal of
Education Policy, 1-17.
Reid, A. (2018) Beyond Certainty: A process for thinking
about Futures in Australian Education. University of South Australia for the
Australian Secondary Principals Association.
Sahlberg, P. (2006). Education reform for raising economic
competitiveness. Journal of Educational Change, 7(4), 259-287.
Sahlberg, P. (2016). The global educational reform movement
and its impact on schooling. The handbook of global education policy,
128-144.
Simpson, A. (2017). The misdirection of public policy:
Comparing and combining standardised effect sizes. Journal of Education
Policy, 32(4), 450-466.
Simpson, A. (2018). Princesses are bigger than elephants:
Effect size as a category error in evidence‐based education. British
Educational Research Journal, 44(5), 897-913.
Slavin, R. E. (2002). Evidence-based education policies:
Transforming educational practice and research. Educational researcher, 31(7),
15-21.
Slavin, R. E. (2004). Education research can and must
address “what works” questions. Educational researcher, 33(1), 27-28.
Stevenson, H. (2018) Flip. the. system? Get.
organised! From: Rycroft-Smith, L., & Dutaut, J. L. (2018). Flip
the System UK: A teachers’ manifesto. Abingdon: Routledge.
Terhart, E. (2011). Has John Hattie really found the holy
grail of research on teaching? An extended review of Visible Learning.Journal
of curriculum studies, 43(3), 425-438.
Olson, D. R. (2004). The triumph of hope over experience in
the search for “what works”: A response to Slavin. Educational researcher, 33(1),
24-26.
Running Word Count: 9,587
How do you apply what you believe in your classroom? Was there a specific classroom experience that has sparked your criticism of Hattie's work? Do you think misunderstanding and misapplication has much to do with the genesis of the criticism?
ReplyDeleteHello Brett, interesting comment, but I believe you have either not read the above article, or misconstrued it as an opinion piece. I apply my beliefs in my classroom, as do all teachers, my classroom experience has little to do with this article, which speaks to the cult of the guru in Australian education and the way that Hattie's work has been widely criticized for the statistical inaccuracies that it rests on.
DeleteI think that misunderstanding and misapplication has much to do with the relatively poor awareness of his research, which is faulty, but few have the time to investigate this as we are a time-poor profession with world-record beating face-to-face teaching commitments when compared to other OECD nations.
It's hard to argue with statisticians who call his work 'pseudoscience', I would suggest you have a read through the articles cited in regards to these criticisms, or check out: http://visablelearning.blogspot.com/ for a more thorough overview than I can provide.
Thanks Steven for your analysis. Your insights on edu-celebrity are useful, "whilst also denying the system any concrete answers or approaches to the issues they identified and espoused."
ReplyDeleteAlso, due to my support of Simpson i was blind to "his own vague and sweeping statement" and will re-read his paper.
I agree with your summary that it is important for teachers to know that Hattie avoids directly addressing the refutations to his work.
Also, your bigger picture is quite insightful and i'd like to know more about this - "the relatively new shift towards instructional leadership rather than transformational leadership."
Hello George, Simpson's other articles are much more precise and less sweeping in their statements, but that particular piece I believe was more an attempt to break into the mainstream consciousness and as such was a bit looser with the facts, which explains his use of the very catchy analogy that he used and other elements of the paper.
DeleteI missed attending the meeting you were a part of due to being ill at the time. What was the consensus of the group and did Eacott attend?
I believe Hattie's commercial interests mean that he has taken more of a 'damage control' approach than that of a true academic, who ought to engage with criticisms on the grounds common to academic debate. This also casts a pall over his place on the AITSL board considering his association with, if not clearly established, commercial interests around HITS and so forth.
In terms of the bigger picture, that quote came from some new reading I am doing around leadership, a new area of research for me, I strongly recommend the work of Amanda Heffernan for further exploration of these ideas, as I am only new to them myself. But broadly speaking, the common view of leadership was around Taylorist ideas drawn from the factory floor, best practices, one best method and clarity of directions. Now we are moving into an age of accountability and ideas around leaders as being expected to be engaged in 'instructional leadership' for many established leaders is a pivot they simply cannot make easily. But also, as the new leaders come through, their ideas are framed around NAPLAN and what Heffernan calls the 'Accountability generation' and therefore their 'instructional leadership' is relatively narrow in response to this and likely also informed by HITS and Visible Learning also.
Also, join Twitter, almost everyone cited above is on Twitter and actively engaging in the debate being had above! It will help your ideas gain greater traction among a small subset (the super-committed) of teachers.
Hi Stephen, this is a really well researched article. I wonder whether the 'cult' status of some education celebrities is tied to how easily it is for overworked school leaders to provide whole school PD. I worked in many schools, in many places and most school leaders just want to do the best they can for students, but they don't have the time to do their own research I also wonder whether the recent obsession with 'innovation' forces school leaders to try and keep up with whatever new 'theory' is being touted.
ReplyDeleteOh absolutely! I feel it all stems from a lack of time, both among teachers and among leaders of teachers especially. Whole school PD is difficult as is keep up to date on the research literature and trends within education. Perhaps there is an avenue for the Departments to take greater control over suggesting proven and acceptable presenters for this purpose. Definitely, the push for innovation without awareness is dangerous!
Delete