Tag: research

  • Edu-research: A new approach to evidence-based practice

    Edu-research: A new approach to evidence-based practice

    This may be an unpopular opinion. Brace yourself.

    There is so much research into education that it has become, at minimum, problematic; at most, toxic. There are five C’s to explore why educational research is writing itself into irrelevance. Call it the “C’s of Evidence” if you’d like.

    Clocking-In

    Teachers are already time poor. I can’t remember the last time I got the chance to sit down and read anything work-related, more than scanning through to read the lesson outline or writing resource to implement in my class that week. Much less any educational white-paper that someone came up with with new evidence that I should now be implementing in my classroom.

    And yet that is what teacher’s are expected to do.
    Evidence-based Practice became the catchphrase of the 2020’s in education circles as teachers sought to justify themselves and their classroom decisions.
    But how many actually look at the actual evidence?
    And how much of the evidence is actually classroom tested?

    Time to read white-papers is one thing. But it’s a whole other thing to implement the findings into your own practice, and apply it across multiple curriculum areas, whilst remaining within school policy and expectation. The time that takes is greater than you might initially think, especially when considering overviews, planning, guides and resource creation. Doing this while continuing to teach a class on a daily basis can often be measured in years rather than months.

    This can be sped up of course if the research has already been synthesized for the classroom, a resource developed, and the overview written in a way that classroom teachers can pick it up and run with it. However, in many cases, what this leads to are teachers following the research second hand – trusting the resource in their implementation of the research, rather than ever reading the research and what it is based off themselves.

    Conditions

    Research is like a Science experiment. You have a series of variables that you are observing and trying to test, with constants to be able to judge the variables against, and some control conditions that allow for baseline results to be compared against. Research in education is conducted with a series of conditions, with the likes of control groups, limited sample sizes, and narrow focuses. There are many, many issues with the way in which education research is conducted. It’s not so much an issue just with education research, but any research in which humans are the test subject.

    Multi-factor Generalisations

    There are simply so many factors that can contribute to the make up of a person, what they do, why they do it, and what we can learn from that. A child who scores 12 out of 100 in Maths can have a long list of reasons that can contribute to such a score. Did they wake up on the wrong side of the bed? Are they hungry? How long is their attention span? How much learning support at home have they had in the past two years? Are they struggling with a learning disability? Have they experienced significant trauma in their lives. Is this their first, second, third, or fourth school? Does their family hold a positive view of education? Has there been health issues that impact on their attendance at school? These are all variables, for which there are zero controls. None of these remain constant, and each impacts on a person to differing degrees.

    Of course, all of these factors are impossible to take into account for the research to be conducted. You can’t possibly control all of these, and so they are largely ignored.

    Don’t work with animals or children

    Children are notoriously inconsistent. They are still learning the world around them. Whilst this makes for some naivety and therefore a degree of honesty that adults tend to be able to mask or fake, children also are much more in-tune with the imaginary and make-believe that there are serious questions over the validity of any results involving them.

    Small Samples

    Along with the myriad of variables that are trying to be accounted for, these then get multiplied by the number of students in a class that a teacher has to work with. Research is inherently dealing with smaller sizes. Rather than try and conduct in-depth research using every student in the class, they might take a sample of 5 students at random. Rather than interview every class, they might select one or two at the school. Rather than go to every school in the area, they might select one or two. The list of ways that the research is limited in order to make it manageable.

    But when was the last time a teacher had five students where factors could just be ignored? Never. Each day, there are 20-30 students to account for in the class, any number of factors impacting on them.
    So how applicable is any research conducted in the name of education?

    Contradictions

    Recently the education community has jumped on the Science of Learning bandwagon (one in which I believe the wheels are falling off quicker than they said ‘click click’ to the horse). This brought with it the Science of Reading, which looked at ways in which we actually learn to read and therefore to direct effective ways in which to teach Reading.

    Marie Clay, one of New Zealand’s most honoured education researchers, was a world power in educational research. She single-handedly lead the drive for programmes like Reading Recovery in every school to support struggling readers in the 1980’s, and was a proponent of ‘whole-language’ literacy.

    However, with the influx of the Science of Reading, as well as, researchers from various universities (particularly in the United States), her methods are now criticised as being ineffective, showing no improvement and even purported to have negative effects later on.

    Yet, while looking through a pile of seriously old education books, I stumbled upon her book in which she introduces Reading Recovery. In it, she outlines her research and what she did in order to reach her conclusions (which was that early, specific and individualised intervention supported struggling readers to get back up to speed with their peers). The depth and detail in which she goes into, the considerations made and the testing of her intervention was evident in the brief skim through I had of her initial chapters.

    What it showed me was real proof that educational research is somewhat insignificant. Because here was someone who has been lambasted and rubbished in recent years for implementing a programme in many countries all in effort to support and raise literacy levels of students who find reading difficult. She conducted her own research in order to find out what it was that made the most difference. She was meticulous and her findings were evidence-based practice.

    Now I’m not saying research can’t be disproved, and I’m not saying that additional research can’t find shortcomings, or even find better, more effective strategies. Of course they can. But at the same time, who is to say that if the likes of Marie Clay, whose research is just as legitimate, can be tossed out and the proponents vilified, then in my mind; so can absolutely any other piece of research.

    The vile statements of utter contempt recent converts of the Science of Reading have for the very mention of Clay’s name is something to behold. ‘She’s a disgrace. Caused terrible disservice to an entire generation of children.’ and other similar comments.

    So we have one piece of research saying one thing. Another piece of research saying the opposite. Undoubtedly both with a different range of variables and an indeterminably amount of factors, and neither of which had the combination of students, needs, families, experiences as those in the classroom in front of you as the teacher today.

    Shortly after, this came across my social media feed, and I simply had to screenshot it.

    This statement was made, quoting the following aritlce about research carried out by Becky Taylor in the United Kingdom.
    https://www.ucl.ac.uk/news/2026/jun/comment-should-we-stream-school-students-based-ability

    It found streaming Year 7–8 students was beneficial for higher-ability students. These students made three months’ more progress in schools that streamed students for maths that those that did not. Streaming also did not damage the results or self-belief of students from disadvantaged backgrounds.

    In fact, this study found students who were not streamed made only one month less progress overall than students who were, after two years. Students with disadvantage and students with low prior achievement made similar amounts of progress regardless of how they were grouped.

    These findings were surprising because they seem to contradict previous claims streaming can harm some students without benefiting others. This new study can and has been interpreted as showing streaming benefits some students while creating no harm to others.

    However, the findings do reinforce previous research suggesting streaming is inequitable and widens achievement gaps. The new study found high-achieving students made much more progress than low-achieving students when streaming was used.

    When presented with contradicting research, how are teachers meant to know which piece of research is correct? Which one do they listen to? The only way to really know would be for them to read both and take into consideration the sample sizes, the measures used and the methods applied for data retrieval and how the data was analysed and the evidence collated.

    And we’ve already found out that no teacher has the time to do that. By the time any teacher has been able to do that, new research would have been found and contradicted everything you’ve just read.

    When presented with contradicting research, how are teachers meant to know which piece of research is correct? Which one do they listen to?

    Count them All

    With the coining of the phrase ‘Evidence-based practice’, or ‘Evidence-based approach’, education now relies on there needing to be research in order to do anything in classrooms. It would appear to me that this is clearly a supply-and-demand issue. Teachers are wanting research conducted so that they can say they are following the evidence, and so research is conducted en mass.

    There has been a noticeable increase in educational research in the past decade.
    Is this true? Or does it just seem that way because everyone is talking about it?

    Well, I did a quick Google Search (with AI search disabled for the record!), and was thrown to this paper where researchers are now researching whether there has been an increase in research. Go figure!
    https://link.springer.com/article/10.1007/s41979-026-00184-5
    I, of course, do not have time to read it in any depth.
    Instead, I simply jumped to the results tab which shows exactly what I suspected;
    The sheer number of research papers being published has exploded since 2020.

    Graph of increase in published research

    Not only do we not have time to read all the research, there is now so much of it to read through, that it has become an impossible task for any classroom teacher to keep up with the sheer amount of it.
    To be clear, what these numbers above show;

    • In 2009 (when I began teaching) there were about 150 journals of education research being published. That’s on average one journal published every two days throughout the year. I read a grand total of 0 of these at the time.
    • A decade later, in 2019, the total number of journals published had pretty much doubled, to over one for every weekday of the year. The number of these I had read to date had also doubled. Double nothing is still nothing.
    • Come 2020, and suddenly we have 750 journals published. That’s 750 journals in a year. That’s 3 journals for every workday that year.
    • It remains around 750 published journals for the next 5 years. That’s a mere 3,750 journals published. To be clear, that’s the same number of journals that were published in the 20 years from 1997 to 2016. I did the maths.

    Put simply, researchers have written themselves into oblivion. What I mean by that is that there is simply so much research that we simply cannot keep up with it and we are simply numb to all of it now. The sheer magnitude in the number of research papers in education is creating a saturation of the market, sending them into obsolescence and irrelevance.

    Teachers are routinely told ‘The Research says this…’, ‘The Research says that…’, and the vast majority blindly follow along, accepting of whatever approach we’re being told about. This is mostly because we don’t have the time, and simply because we can’t be bothered looking up the research, analysing the methods, and processing their conclusions. Let alone searching through the 750 journals published this year, which could be disproved within the next year at the rate that we’re going. It’s easier to nod our heads and just believe what is being told to us. We rely on our own experience of our classrooms, of teaching, our own understanding of how student’s learn, and the plausibility of what is being said as being true. If it sounds reasonable, there are many who will just give it a go until we’re told otherwise.

    All this research, where findings can vary, and just about any hypothesis can be backed, is essentially rendering research as completely unimportant. Evidence-based practice isn’t a status to be touting if research can back and support anything and everything. With so much research out there, not only is it obsolete because very few have the time to read it, but with so many articles out there, evidence can probably be found for anything and everything. The saturation of the education research market is like an empty glass that is being filled, yet once the cup is full, the tap was left on and the water is now overflowing. The value of the water is depleted and we are no longer thirsty.

    “The sheer magnitude in the number of research papers in education is creating a saturation of the market, sending them into obsolescence and irrelevance.”

    Cash is King

    Why do we need all this research? One reason is the ‘evidence-based practice’ rhetoric. And because of that, in order to push through any new resource, or any new approach to teaching, providers need to have evidence for which to claim their product as being ‘evidence-based’. What this leads to of course, is every large educational conglomerate as well as governments providing funds for research to be carried out.

    Education is big money. In 2025, the total income from education was a staggering $1,106,000,000.00. Yes. You read that right. $1.1 trillion. Of course, there is expenditure to take into account, but it leaves the country with $95 billion dollars in profit.

    And that’s just New Zealand.

    – Figure.nz: https://figure.nz/chart/kIpNw1H5r3cVIesv-O0u2toDAfNpAyifH

    This then brings in a whole other reason to be skeptical of research that is conducted. Which master is the research serving? The wider educational community, or the company that is funding them to find what needs to be found in order to push their products through?

    Concluding Evidence

    One of the key statements I will hold onto was from one such researcher; Steve Graham. I was lucky enough to hear a lecture about Writing Instruction in which he outlined some of his findings from his unironically named ‘Evidence-based recommendations for teaching writing‘ paper.

    You can view it here: https://www.tandfonline.com/doi/abs/10.1080/03004279.2024.2357893

    Photo of Steve Graham
    Steve Graham

    Graham essentially said that upon reflection, any evidence, including his own, needed to be seen for what it is; evidence from a research environment.

    He said (in not so many words) that just because it happened in a research environment, regardless of sample size, “…does not mean it is going to replicate in every situation and circumstance.”
    In this one statement Graham made it clear that just because they found this in their research conditions, it does not mean it will translate into every classroom all of the time. Some classrooms may find benefit. Others may not. Some students will benefit. Some won’t.

    It is probably the single most self-reflective statement I have heard from any education researcher – a real, truthful, and down-to-earth statement about the reality every piece of research, including his own. It provided an unusual confidence in which one can stand on to challenge any research. It provided confidence to take on board research, but not make it the be-all and end-all that some try to make it.

    Moreover, I am of the opinion that each and every day, teachers around the world are conducting their own educational research. Observing, questioning, recording, planning, implementing strategies and lots of trial and error. It may not be published anywhere, and it may not carry with it the backing of a distinguished university, but that does not mean it is not important, nor less valuable. The evidence for my evidence-based practice? The 15 years I’ve spent in the classroom.

    That’s now my evidence based approach.

  • A picture is worth a thousand words

    Today an article crossed my desk which was ultimately concerning. I didn’t like it. Partly it was written because of that feeling. But moreover, it seems to add credibility to the research completed by Dr. Protheroe which seemed to suggest that pictures in books hindered the ability for students to learn to read, rather than enhanced. When this research was announced, I immediately made a post (Picture Books and Literacy Learning) to express my opinion on it. I encourage you to visit it and have a read.

    The article in question is Uncomfortable, Unthinkable Research Findings by Jessica Craig, and is written in response to an article in Education Review. Craig is one of the education consultants at Accent Learning, one of the former Ministry appointed professional development providers in the Wellington area before they cut funding.

    What is most concerning is that Accent is still widely regarded as a solid education learning provider for teachers. And yet Craig, along with others (I suspect), has failed to miss the flaw in the research carried out. Her main question seems to be “why isn’t more being made of this research!?”. Basically, why aren’t we telling new beginning teachers to take twink to the Ready to Read books in every school!?  (Once again;cause for concern – Accent Learning operates out of Victoria University’s Karori Campus; which is, surprise surprise, where they train teachers!)

    Now I’m no researcher, but I have done my time in many a math and statistics class through high school, and I know how important sample size is.

    The sample size for this research is – wait for it… 48.

    Yes. 48. Not even 50.

    To give you an idea of what 48 equates to. It is two average sized classrooms of 7-9 year olds.

    Two classrooms. Probably from one school.

    If we based every bit of research on that, we’d probably find all sorts of anomalies we’d then prioritise and force upon the entire nation! Consider the fact that these 48 students have probably had the same teachers as each other from the age of five. They probably have similar home lives, and might be completely different from a school down the road, let alone at the other end of the country. The fact is, there is not enough evidence within two classrooms of students to even remotely suggest anything; especially a claim that pictures in books hinder students reading progress.

    Further more, the research is based on only four texts. Two with pictures, two without. Probably only one fiction and one non-fiction for pictures and without pictures. Once again, hardly a comprehensive range of texts to base one’s research on. Who is to say that those texts were appropriate, relevant, needed pictures, had appropriate pictures, or that the questions were understood or allowed for child interpretation?

    In addition to this; I refer to a point I made in my previous article about this topic. I’d hesitate to say; but I’d say it’d be pretty accurate; that of the people that can read (of which you are one!), that you learned to read using books with pictures. So they can’t be that bad, as you, and generations before and after you have also learned to read using pictures. I would also suggest that those people that can’t read, that pictures in the books has little to do with the reason why they can’t read.

    Unlike Jessica Craig, I can completely understand why there has been no debate over this research. Its because the majority of us have worked out it’s a waste of time, resourcing, and energy. Quite frankly; it’s bogus. Until there is substantial evidence to the contrary, I shall remain in favour of the wonderful illustrations that grace the pages of picture books and sparks the imagination and inspiration of the younger generations as they explore the world of words and stories.

     

  • Picture Books and Literacy Learning

    I was perplexed, astonished, gobsmacked, and bewildered when I read this article this morning.

    Picture books hurt reading, says linguist Pamela Protheroe

    Read Article – Stuff.co.nz

    There are very few words I can say right now about it.
    Luckily, most of us in Education circles have gotten used to ignoring such ‘research’ and will continue to listen to trained, practising teachers who know what works, rather than these so-called ‘researchers’ who blow in and blow out of a classroom to report their findings.

    But seriously. Let’s stop for just one moment. Someone has based their research thesis on this. Countless dollars on resources, time, and all sorts to carry out this research, and for the most part, it goes against every bit of logical instincts we have.

    My first reaction was – what are the implications for schools should this research be taken on board? Book rooms around the country turned upside down, with pictures being deleted from Ready to Read books, and replaced with text-only books. Picture books being thrown onto a fire in the school courtyard outside the school library. Its just not an image you even want to imagine books and schools becoming.

    Let’s face it. We’ve all been through school where picture books were more than a staple diet. They have helped us to make sense of the world, and have scaffolded our learning of English, which is confusing at the best of times! They have provided enjoyment and fun for reading. Even today, I prefer a good picture book, and the art covered pages that bring the story to life.

    And guess what. I’m not dyslexic. In fact, many of us aren’t. And even those that I know who are dyslexic, have not only learned to adapt with this world, but have done so from a very young age; suggesting that dyslexia isn’t really something that comes to haunt us in later life like baldness or arthritis might. I’m more than sure that if this research was the least bit true, that with the copious amounts of picture books that have been read over the years, we would have countless adults complaining of suddenly developing dyslexia and getting their words and letters muddled.

    Try, just for a minute, to picture it. Where the Wild Things Are, without the beautiful scratching and muted illustrations. The Very Hungry Caterpillar without the large stenciled fruit and holes in the pages. Green Eggs and Ham without the train going through the tunnel on tracks supported by the bamboo-like truffalo trees. There is no way that these stories, without their illustrations, would remain in our minds, but more importantly, remain in our hearts.

    9985972026_54e0b07122Imagination at heart

    As for ruining imagination; I somewhat agree. I believe the imagination of young people has been harmed by the overstimulation of digital media, film, and video games. But not by picture books. Not by still images. The stationary pictures that grace a page provide just a small portion of the imagination required to gather in the entire story. There are a lot more aspects to a story than even what the picture on a page can show us. Theres movement, there’s action, there’s descriptive settings, and facial expressions. There’s reactions and emotions, all of which change and adapt with the story, something that a still image in a picture book. They rather provide a starting point and a kick start for students imaginations to build on.

    Pictures, Pictures, Pictures

    My personal favourite is a book that has no words in it whatsoever. Most likely this is because of my prejudice towards art and drawings. It’s called ‘The Arrival‘ by Shaun Tan, and it is magical. In my teaching through Daily 5, a world wide literacy programme based on in class practice, developed by teachers for teachers, one of the things that is taught is ‘three ways to read a book’. One of those is to read by using the pictures. Even I ran into problems with this when teaching older children, who are now reading chapter books which contain very few pictures!

    In Conclusion

    I guess it is quite good that this researched doesn’t have a memorable name. I can’t even remember it from the title.

    There are a few things that we need to remember. They completely dispute her findings, and lay them to rest almost instantly. Firstly, like music, pictures are a universal language for all. They tell a story on their own. They are invaluable for communicating ideas for ELL students.

    And lastly, and most importantly, I leave you with one common phrase that is used all over the world, and speaks complete truth every time it is used. And I cannot think of a more suitable time to use it than this.

    “A picture is worth a thousand words.”