Use of research-based information by school practitioners

285
Use of research-based information by school
practitioners and determinants of use:
a review of empirical research
Christian Dagenais, Larysa Lysenko, Philip C. Abrami, Robert M. Bernard,
Jean Ramde and Michel Janosz
Delivered by Ingenta to: Ãquipe RENARD
IP : 216.252.76.97 On: Fri, 11 Jan 2013 23:47:00
Copyright The Policy Press
The trend towards using research knowledge to improve policies and practices is on the
rise. However, despite considerable effort and notable progress in recent years, it seems that
school practitioners continue to make little use of research and it is not clear what conditions
would facilitate or obstruct this use.This review focuses exclusively on the available empirical1
research about (a) the use of research by school practitioners and (b) the determinants of
use, and identifies future directions for research.
research
© The Policy Press • 2012 • ISSN 1744 2648
Background
The preoccupation with making scientific knowledge public, useful and practically
beneficial is not new. As early as 1826, in London, scientists formed an association
named the Society for the Diffusion of Useful Knowledge (Smith, 1974). The
Society’s magazine, published weekly and sold for a penny, sought to educate the
general public in science, literature, history and ethics. Today, the frantic onrush of
science and technology means that practice continuously has to catch up with new
developments. The practical usability of advanced knowledge has become a crucial
issue in fields dealing with complex social issues such as health, education, social
services and justice.
However, over the past 50 years, the relationship between education and the research
knowledge it produces has been repeatedly debated, with the main critique being
the persistent failure of educational research to bring the education system up to
speed in synchrony with the demands of a rapidly changing society (consider Taylor,
1973; National Commission on Excellence in Education, 1983; Tomlinson, 1994;
Hargreaves, 1996; Davies, 1999; Carnine, 2000; Slavin, 2004; OECD, 2007). These
authors argued that educational research should be accumulating well-established
knowledge with practical relevance to provide an action base so that teachers can
improve the quality of teaching and, consequently, the quality of learning. Specifically,
there should be ongoing collaboration between education policy makers, practitioners
and researchers to shape the agenda and priorities for educational research. These
proposals formed the cornerstone of the evidence movement in education that started
gaining governments’ attention as a useful strategy promising effective change. The
necessity for education policies to be grounded in sound scientific results was explicitly
Key words
research-based information • determinants of use • school practitioners • research utilisation
Evidence & Policy • vol 8 • no 3 • 2012 • 285–309 • http://dx.doi.org/10.1332/174426412X654031
EvP_8_3_Aug_2012_text_3.2.indd 285
14/08/2012 13:23:48
Delivered by Ingenta to: Ãquipe RENARD
IP : 216.252.76.97 On: Fri, 11 Jan 2013 23:47:00
Copyright The Policy Press
286
Christian Dagenais et al
articulated in numerous documents (eg, the No Child Left Behind Act 2002 in the
United States [US] and the United Kingdom’s [UK] Tooley report to the Office of
Standards in Education: Tooley, 1998). The subsequent reforms prioritised funding
for research producing evidence-based strategies and encouraged educators at all levels
to build their practices on evidence from scientifically based research. At the same time,
teacher experience and judgement were given merit in the evidence-based education
equation. In this context, evidence-based education was defined as the synergistic
integration of the best available empirical1 evidence and professional wisdom in
making decisions about how to deliver instruction (Davies, 1999;Whitehurst, 2003).
A number of new approaches have evolved in response to this shift, including
knowledge mobilisation, research-to-action, knowledge translation, evidence-based
or evidence-informed policy and practice and knowledge-based practice (Graham
et al, 2006; McKibbon et al, 2010), to name a few. At the same time, initiatives to
promote the dissemination and use of research evidence in education have increased
in number. These include, but are not limited to, the Campbell Collaboration (C2,
www.campbellcollaboration.org), the Evidence for Policy and Practice Information
and Coordinating Centre (the EPPI-Centre, http://eppi.ioe.ac.uk), the American
Institutes for Research (AIR, www.air.org) and the What Works Clearinghouse
(WWC, www.whatworks.ed.gov). Open-access online multimedia resources of
evidence-based educational practices such as Doing What Works (http://dww.ed.gov/)
have also been created for the purpose of translating research-based findings into
practical tools for classroom instruction.
Despite considerable effort and the notable progress made in recent years, several
commentators have claimed that school practitioners continue to make little use of
educational research in their classroom practice (eg, Hannan et al, 1998; Nutley et
al, 2003a; Rohrbach et al, 2005; Dagenais et al, 2008). Numerous authors emphasise
the fact that, despite an increasing mobilisation of researchers and research-funding
agencies, the literature on research use continues to yield little evidence on the
processes involved, and even less on the effects of efforts to promote their use (Davies
et al, 2005; Estabrooks, 2007; Mitton et al, 2007; Nutley et al, 2007).
Research-based information may be produced by professional researchers, such as
research teams from universities and government departments, external evaluation
teams, and researchers within institutions, or by practitioners conducting research in
collaboration with researchers.We make a distinction between general research-based
information, which is the scientific evidence found in the literature (in scientific
publications, systematic reviews, etc) and local research-based information, which is
produced locally and intended for local use. The latter is the case, for example, of
the evaluation of a single school programme or of participatory action research. In
these types of research, the goal is to provide feedback and the utilisation of results
focuses on a particular programme. When the results of these research activities are
disseminated or used in other contexts, they then become general research-based
information.This distinction is important, because certain predictors of use identified
by the studies on the subject seem to apply only to one or the other type of research.
For example, a condition that appears to be a powerful predictor of use is direct
contact between researchers and potential users. However, although this condition
Evidence & Policy • vol 8 • no 3 • 2012 • 285–309 • http://dx.doi.org/10.1332/174426412X654031
EvP_8_3_Aug_2012_text_3.2.indd 286
14/08/2012 13:23:48
Delivered by Ingenta to: Ãquipe RENARD
IP : 216.252.76.97 On: Fri, 11 Jan 2013 23:47:00
Copyright The Policy Press
Use of research-based information by school practitioners ...
287
may be necessary in the context of participatory action research (local research), it is
unclear how it may affect the use of a meta-analysis (general research) available on
the Campbell Collaboration website, for example.
Research use has multiple dimensions: factors that mediate the process of utilisation
are plenty and may be grouped in a few ways. In this study, we grouped factors with
a focus on the user of research-based information. For this purpose, we used the key
elements of Rogers’ (1995) model of innovation diffusion, including individuals within
the system, research characteristics and communication channels. Specifically, these
influences may emerge at the practitioner’s level and pertain to perceived research
quality as well as the individual ability to use the research. At the school level, these
factors are deeply rooted in school culture and may affect practitioners’ ability to sustain
openness to learn and stimulate or subdue their initiative to use research generated
in academia or get involved in a local school-based research project. Therefore, the
factors are organised between those emerging at the individual practitioner’s level in
a school or a broader system and those enabling communication between the levels.
From the standpoint of utility or usability, research use gradually evolved into
a multifaceted, multidimensional construct comprising not only direct, but also
alternative forms of use, as well as non-use, misuse and abuse. Therefore, it cannot
be reduced to instrumental use, a direct process where research findings are being
transmitted and applied intact (Weiss, 1980). The view of conceptual use of research
emerged to underscore the enlightening function of knowledge: it is the ‘gradual
sedimentation of insights, theories, concepts and ways of looking at the world’ (Weiss,
1980: 535). Symbolic or strategic use of knowledge has been suggested to account
for the utilisation of research to confirm actual practices. According to Huberman
and Gather-Thurler (1991), such use may also turn into knowledge manipulation to
derive specific profit or to achieve power goals.
Traditionally, much of the writing about the use of research-based information in
education has been theoretical or conceptual. For instance, Sieber (1974) and then
Love (1985) characterised the existing database of research reporting some form of
outcome data on research utilisation as extremely thin. Some 30 years later, a systematic
review of literature by Hemsley-Brown and Sharp (2003) on the use of research to
improve school practices identified six peer-reviewed papers focusing on various
aspects of educators’ use of research. In their cross-sector review of the literature on
research impact, Nutley et al (2003b) located 16 empirical papers pertinent to the
education sector. In his grey2 paper reviewing education practitioners’ use of research,
posted online in 2005, Rickinson reported the increase in empirical studies. The
existing reviews target a broad category of education practitioners, including teaching
and professional staff at secondary and postsecondary educational institutions.
The aim of this study is to review the existing empirical research regarding (a) the
use of research-based information by school practitioners and (b) the determinants of
such use. For the purposes of this paper, the term ‘school practitioner’ means teaching
and administrative staff in elementary and secondary schools.
Evidence & Policy • vol 8 • no 3 • 2012 • 285–309 • http://dx.doi.org/10.1332/174426412X654031
EvP_8_3_Aug_2012_text_3.2.indd 287
14/08/2012 13:23:48
Christian Dagenais et al
288
Delivered by Ingenta to: Ãquipe RENARD
IP : 216.252.76.97 On: Fri, 11 Jan 2013 23:47:00
Copyright The Policy Press
Method
The search parameters of this review were set to focus on work published since 1990,
reflecting the suggestion by Nutley et al (2003b) that returns on searches of empirical
evidence prior to this date would be limited.The searches were confined to Englishand French-language publications.We maintained an international perspective when
searching. With regard to the literature included, the main focus was on published
journal papers, book chapters, research reports and unpublished conference papers.
We conducted searches of the major education-relevant databases, namely ERIC,
PsycINFO, Web of Science, CBCA Education and Education Full Text. The search
was limited to literature published between 1990 and 2010. Numerous combinations
were used of such terms as ‘research use’, ‘research utilization’, ‘knowledge transfer’,
‘knowledge translation’ and ‘knowledge mobilization’. Since we were interested in
factors affecting use of research-based information, truncations such as factor* or
determinant* were added to the free-text search strings. Searches were performed
using database thesauri and controlled vocabulary in the search statements. In addition,
we searched through the reference lists from the existing reviews. A summary of the
search strategy is presented in the appendix.
These combined searches produced 1,326 citations. The initial selection criteria
were (a) location within the education sector and (b) reference to research utilisation
in practice in elementary/primary, secondary/high schools. One hundred and sixtynine citations met these criteria and were chosen for further review. The second set
of criteria required that publications had to be empirical studies:
•
•
•
•
reporting data about the use of research-based information in school practice;
reporting factors affecting (either inhibiting or enabling) the use of research-based
information in school practice;
targeting one or more groups of school practitioners, including teachers and/or
head teachers and school (vice) principals;
that were not studies of special education, social work or extracurricular
programmes.
The final list of studies meeting the criteria comprised 27 papers reporting on 24
empirical studies conducted in various countries, including Australia, Canada, the
UK and the US. Table 1 summarises the study characteristics: purpose of the study,
sample size, school practitioner type, country where the study was conducted, research
design and data collection method. Half of the reports were journal publications
(n = 14), almost a quarter were reports (n = 7), and conference papers and book
chapters were one ninth each.The majority of the studies used questionnaire surveys
as instrumentation, while the remainder were case studies. Ten studies had teachers
as their target population; only three focused on school principals. The remaining
14 studies (55%) examined mixed populations of teachers and principals. Almost
two thirds (15/24) of the studies were performed in the UK and the US. Canada
and other countries, such as Australia, Israel and Sweden, were the locations of the
remaining one third (9/24).
Evidence & Policy • vol 8 • no 3 • 2012 • 285–309 • http://dx.doi.org/10.1332/174426412X654031
EvP_8_3_Aug_2012_text_3.2.indd 288
14/08/2012 13:23:49
EvP_8_3_Aug_2012_text_3.2.indd 289
551
233
Bingham et al Information
(2004)
spread from
researchers to
practitioners
and its use by
practitioners
Cousins and
Leithwood
(1993)
Use of the
sources of
information
to improve
curriculum
548
To explore
whether
educators are
informed of,
understand and
use research
findings
Bérubé
(2006)
49
To explore
the school
practitioners’
demand of
educational
research
Behrstock et
al (2009)
N
Purpose
Study
Survey
research
Survey
research
Survey
research
Design
Elementary
Survey
school principals research
(Canada)
Career and
technical
secondary
school teachers
(the US)
Teachers and
principals,
primary and
secondary
schools
(Canada)
Elementary,
middle- and
high-school
teachers (the
US)
Sample
Focus group
protocol
Instruments
Use of disseminated information
Characteristics of information: sophistication, relevance, timeliness, content,
improvement setting, information needs, user receptiveness
Seeking information from:
school district sources: other teachers, administrators, curriculum
committees etc
external sources: state department of education, academia, professional
development events etc
Frequency of accessing the following sources of info: web, written
documents, conferences and personal contacts
Information usefulness
Information sharing
Impact of the information on teaching activities
Questionnaire
Questionnaire
based on the
interviews and
case studies.
Validated via
focus group
and pilot
tested
Access to research: availability of research, activities to encourage research Questionnaire
dissemination (financial support, professional development activities)
– pilot tested
Consulting research products and participation in research
Research utilisation: (a) whether they implemented new practices in the last
3 years, (b) whether they use research and what for and (c) barriers and
facilitators of the use
Factors in the school environment (attitudes towards environment,
availability of link/diffusion agents)
Seeking academic research
Reliable sources of research
Criteria to judge research
Type of research useful for practice
Barriers to research use
Preparation to use research
Variables
Table 1: Features of empirical studies on research utilisation, attitudes towards research and conjugated factors
Delivered by Ingenta to: Ãquipe RENARD
IP : 216.252.76.97 On: Fri, 11 Jan 2013 23:47:00
Copyright The Policy Press
Use of research-based information by school practitioners ...
289
Evidence & Policy • vol 8 • no 3 • 2012 • 285–309 • http://dx.doi.org/10.1332/174426412X654031
14/08/2012 13:23:49
Forces that serve 60
to enhance or
impede schools’
propensity
to embrace
evaluative inquiry
as a support for
decision making
Cousins et al
(2006)
EvP_8_3_Aug_2012_text_3.2.indd 290
2,425
73
Dagenais et al To identify
(2008)
the predictors
of use of
research-based
information
Department Use of research
of Education, by school
Training
principals
and Youth
Affairs (2000);
Holbrook et
al (2000)
310
Educator
attitudes
towards
engagement
in systematic
inquiry
Cousins
and Walker
(2000)
N
Purpose
Study
Survey
research
Design
Survey
research
School principals Survey
(Australia)
research
Teachers, school
principals and
practitioners
(Canada)
Middle- and
Survey
secondary
research
school principals
and teachers
(Canada)
Teachers
and school
administrators
(Canada)
Sample
Sources of research that are important to principals
Research base for the innovation in their school
Impact of research on their decision making
Areas where research is needed
Collaboration between schools and academia
Frequency of use of sources of research-based information
Type of use
Opinions about research
Individual expertise
Awareness activities
Organisational factors
Elements of school evaluative inquiry
Impact of evaluative inquiry on practice
Factors affecting the reliance on evaluative inquiry at schools
Perceived utility of systemic inquiry (general research findings)
Relevance of inquiry to practice;
Personal ability to use and conduct evaluation and applied research
Need for involvement in systemic inquiry (teachers collaborate with
researchers, home research)
Need to integrate inquiry into training
Factors:
Personal: teaching efficacy, prior participation in research, prior research
coursework, experience and gender
Organisational: organisational learning capacity (collaborative work and social
processing), collegial culture, opportunity to question, etc
Variables
Delivered by Ingenta to: Ãquipe RENARD
IP : 216.252.76.97 On: Fri, 11 Jan 2013 23:47:00
Copyright The Policy Press
Structured
telephone
interview
Survey
Interview and
focus group
protocols
Questionnaire
– partially
borrowed from
Green and
Kvidahl (1990)
Instruments
290
Christian Dagenais et al
Evidence & Policy • vol 8 • no 3 • 2012 • 285–309 • http://dx.doi.org/10.1332/174426412X654031
14/08/2012 13:23:49
Contribution
441
of training to
explain teachers’
self-reported use
of research and
opinions about
research
Use of research
by teachers and
doctors
Factors
influencing
research
utilisation
Green and
Kvidahl
(1990)
Hannan et al
(1998)
EvP_8_3_Aug_2012_text_3.2.indd 291
Hultman
and Hörberg
(1998)
127
33
35
302
Teachers’ views
on research
and the value
attributed to it
Everton et al
(2000)
N
Purpose
Study
Design
Survey
research
Teachers from
primary schools
(Sweden)
Survey
research
Primary and
Survey
secondary
research
teachers
General
practitioners and
surgeons (the
UK)
Teachers (the
US)
School principals, Survey
deputy principals research
and teachers
(the UK)
Sample
Factors: time, ability, support
Obstacles to change: economy, school premises, time, pupils, teacher’s own
view, colleagues, parents
Features of research
Sources of knowledge: colleagues, own experience, professional
development activities etc
Important knowledge (areas of interest for teachers, eg, how pupils learn,
how to teach)
Satisfaction in work (eg, teaching, cooperation)
Frequency of research use
Opinions about status of research
Involvement in research
Type of use: for discussions, reviewing, trials of results, working on local
problems etc, presenting, publishing
Opinions about research
Research coursework and perceptions of training
Membership of professional organisations, subscription, conducted research
projects
Sources of research that teachers rely on and their usefulness
Topics on which research influenced their teaching (improved, confirmed or
questioned their views)
Priorities of topics to be researched
Value of research
Variables
Delivered by Ingenta to: Ãquipe RENARD
IP : 216.252.76.97 On: Fri, 11 Jan 2013 23:47:00
Copyright The Policy Press
Interviews,
questionnaire
Questionnaires
Questionnaire:
a combination
of closed and
open-ended
questions
Questionnaire:
a combination
of closed and
open-ended
questions
Instruments
Use of research-based information by school practitioners ...
291
Evidence & Policy • vol 8 • no 3 • 2012 • 285–309 • http://dx.doi.org/10.1332/174426412X654031
14/08/2012 13:23:49
Purpose
Perceptions of
participation in
the evaluation
process and use
of evaluation
results
Comparison of
research-reading
behaviours
of educators,
engineers,
lawyers and
physicians
Teachers’
attitudes
towards doing
and using
research
Teachers’
experiences
and perceptions
of educational
research
Perceptions
of school
practitioners
about ‘researchbased practice’
Study
Lafleur
(1995)
Latham
(1993)
EvP_8_3_Aug_2012_text_3.2.indd 292
McNamara
(2002)
Miretzky
(2007)
NicholsonGoodman
and Garman
(2007)
62
15
125
80
28
N
Ethnography
Survey
research
Survey
research
Survey
research
Design
Teachers and
Narrative
school principals inquiry
(the US)
Elementary
and secondary
school teachers
(the US)
Teachers (the
UK)
Educators,
engineers,
lawyers and
physicians (the
US)
School board
evaluation
committee
members
(Canada)
Sample
Practitioners’ attitudes towards:
educational research and access to it
communication of educational research
Professional development as the means to expose teachers to research
Engagement in teacher research
Leadership factor
Attitudes towards research;
Perceived benefits of research for the school
Doing and using research (experience and involvement in research)
Impact of research on teaching
Reading professional versus popular literature
Use of literature in school professional collection
Availability and nature of literature in teacher lounges
Factors affecting utilisation of participatory evaluation:
Commitment of staff and the superintendant
Quality of the evaluation
Involvement of the user
Variables
Delivered by Ingenta to: Ãquipe RENARD
IP : 216.252.76.97 On: Fri, 11 Jan 2013 23:47:00
Copyright The Policy Press
Interview
schedule
Interview
schedule
Questionnaire
Interview
protocol,
observation
Questionnaire:
a combination
of closed and
open-ended
questions.
Instruments
292
Christian Dagenais et al
Evidence & Policy • vol 8 • no 3 • 2012 • 285–309 • http://dx.doi.org/10.1332/174426412X654031
14/08/2012 13:23:49
EvP_8_3_Aug_2012_text_3.2.indd 293
Teachers’
n/a
searching
for evidence
on which
improvements in
practice could be
based
Simons et al
(2003)
Teachers
participating
in research
consortia:
schools, local
education
authorities and
universities (the
UK)
School principals Survey study
from Australia
and the US
Research
knowledge
impact on
principals’
decision making
Saha et al
(1995), Biddle
and Saha
(2002)
120
Teachers from
elementary and
high-schools
(Israeli)
Retrospective
case study
Case survey
Survey study
Shkedi (1998) To study the
47
nature of
teacher attitudes
towards research
literature
Design
Primary and
secondary
school teachers,
curriculum
policy makers,
in-service
trainers
and authors
of training
materials (the
UK)
Understanding
62
of the extent
to which
practitioners
in science
education
recognise and
make use of
research findings
Ratcliffe et al
(2005)
Sample
Purpose
Study
N
Important factors that affect use of external evidence:
Evidence should be connected to precise teaching situation
Collective interpretation and analysis is a validity filter for practitioners
Ownership of research
Research knowledge acquisition: exposure to sources, evaluation of sources,
knowledge acquired from sources
Opinions regarding knowledge and innovation
Familiarity with research knowledge: volunteered examples, recognised
examples
Use of research knowledge: volunteered topics, recognised topics, policy
decision events
Respondents’ environments: background, job history, career goals,
characteristics of schools (balance of students, interests groups) and school
system (number of students, teachers, their qualifications)
Use of research literature: professional literature they read, facilitators for
and barriers to reading professional literature
Teachers’ perceptions of research
Users’ perceptions of research: attributes of research, knowledge sources
for research
Barriers and opportunities in using research
Potential of research to affect science education
Perceived impact of research on practitioners’ own practice
Evaluating changes in practitioners’ practice
Variables
Delivered by Ingenta to: Ãquipe RENARD
IP : 216.252.76.97 On: Fri, 11 Jan 2013 23:47:00
Copyright The Policy Press
Interview
Questionnaire:
pre-tested
in both
populations;
Structured
interview
Interview
Semistructured
interview, focus
group protocol
Instruments
Use of research-based information by school practitioners ...
293
Evidence & Policy • vol 8 • no 3 • 2012 • 285–309 • http://dx.doi.org/10.1332/174426412X654031
14/08/2012 13:23:49
EvP_8_3_Aug_2012_text_3.2.indd 294
91
13
Wilson and
To identify the
Easton (2003) ways in which
local education
authorities can
facilitate the
use of research
for school
improvement
Zeuli and
Tiezzi (1993)
Teachers’ beliefs
about research
influence on
their practice
390
Impact of
information
literacy, access
and attitudes
on the use of
research
Williams and
Coles (2003,
2007)
N
Purpose
Study
Design
Teachers with
some research
experience (the
US)
Primary and
secondary
school teachers
(the UK)
Survey study
Survey study
Nursery, primary Survey study
and secondary
school teachers
(the UK)
Sample
Value of research knowledge to change practice
Educative contexts to acquire broader views of research
Research use: accessing research, engaging with findings, carrying out
research, sharing research
Benefits of research use
Attitudes toward research
Information literacy skills (confidence level)
Access to a range of sources
Individual characteristics: research experience, age, gender, position, subject
taught
Variables
Delivered by Ingenta to: Ãquipe RENARD
IP : 216.252.76.97 On: Fri, 11 Jan 2013 23:47:00
Copyright The Policy Press
Interview
Questionnaire,
focus group
protocol
Questionnaire,
interview
Instruments
294
Christian Dagenais et al
Evidence & Policy • vol 8 • no 3 • 2012 • 285–309 • http://dx.doi.org/10.1332/174426412X654031
14/08/2012 13:23:49
Use of research-based information by school practitioners ...
295
Although relying on a systematic approach to searching published research, this
study is a review of the literature that describes the existing empirical research on
research use and factors affecting use by school practitioners, and identifies future
directions of research.
Results
The results are presented in the following two subsections. The first synthesises the
available empirical evidence on the use of research-based information by school
practitioners and the second discusses evidence on determinants of use.
Delivered by Ingenta to: Ãquipe RENARD
IP : 216.252.76.97 On: Fri, 11 Jan 2013 23:47:00
Copyright The Policy Press
Use of research-based information in school practice
The empirical studies reported three main outcomes of the use of research-based
information. Specifically, these self-reported outcomes related to the level/extent to
which practitioners use research-based information, the purpose of utilisation and
practitioners’ attitudes towards educational research.
Level/extent of use was rare but was the most sought-after consideration of the use
of research-based information. School practitioners reported making little use of
research findings, no matter whether produced in academia or locally in schools (eg,
Green and Kvidahl, 1990; Lafleur, 1995; Cousins and Walker, 2000; McNamara, 2002;
Williams and Coles, 2003, 2007). Specifically, Green and Kvidahl (1990) reported
that although 441 US teachers expressed positive opinions about the usefulness of
research, on average they consulted research literature only once a year. Latham (1993)
and Shkedi (1998) showed that education practitioners rarely read research literature,
even when it was readily accessible. Bérubé (2006) found that 60% to 90% of teachers
reported research use at the low end of the range, from ‘never’ to ‘sometimes’. On
average, 297 schoolteachers in a study by Cousins and Walker (2000) described their
participation in systematic evaluative inquiry, of which reading research papers was
a part, as rare (mean score 2.2 on the scale from 1 to 5). In a study by Dagenais et al
(2008), about one third of teachers and professionals reported that, on average, they had
used local or general research-based information once or twice during the previous
year. Another third said that they had made no use of research in their practice over
the same period. Among education consultants and school administrators, non-use
was less than 20%. Williams and Coles (2003, 2007) reported that 60% to 80% of
respondents in UK schools used research related to teaching and learning infrequently
(from ‘never’ to ‘occasionally’).
Purpose of use of research-based information was rarely reported. Consequently,
not much is known about the ends to which practitioners apply research in their
teaching practice. Those who reported involvement in research used it conceptually.
This includes using research-based information to increase their teaching effectiveness
(McNamara, 2002), reflect on their practices and experiment (Bérubé, 2006), improve
their professional practice (Dagenais et al, 2008) or learn from research materials
(Saha et al, 1995; Biddle and Saha, 2002). In a study on the use of school programme
evaluations, Cousins et al (2006) reported a significant reliance by practitioners on
Evidence & Policy • vol 8 • no 3 • 2012 • 285–309 • http://dx.doi.org/10.1332/174426412X654031
EvP_8_3_Aug_2012_text_3.2.indd 295
14/08/2012 13:23:49
Delivered by Ingenta to: Ãquipe RENARD
IP : 216.252.76.97 On: Fri, 11 Jan 2013 23:47:00
Copyright The Policy Press
296
Christian Dagenais et al
quantitative indicators for decision making and programme modifications, as well
as for systematic inquiry. The studies provided little information about any aspect or
combination of aspects intended to drive educational change.
Attitude towards research-based information was the research-use measurement most
frequently mentioned. Studies on school practitioner commitment to the use of
research-based information suggested that values that practitioners attach towards
research vary. The gamut of attitudes ranged from cynicism (Nicholson-Goodman
and Garman, 2007) to scepticism (Zeuli and Tiezzi, 1993; Shkedi, 1998), to neutrality
(Dagenais et al, 2008) and positive endorsement and motivation to use research
(Green and Kvidahl, 1990; Cousins and Leithwood, 1993; Saha et al, 1995; Biddle and
Saha, 2002;Williams and Coles, 2003, 2007). Emphasising the reciprocal relationship
between use and attitudes, Cousins and Walker (2002) noted that practitioners’
involvement in systematic inquiry affected the development of favourable attitudes
towards research. Interestingly, studies also suggested that practitioners’ attitudes
towards research affected their use of research-based information.
To summarise, the available research suggests that the use of research-based
information is hardly a significant part of the school-practice scenario. If such
use occurs, it is mainly conceptual and research-based information is a source of
inspiration to accommodate or modify the practitioner’s frame of reference. Neither
the national origin of a study, nor the type of research-based information (general or
local) produced, seem to be factors in the use of research-based information in school
practice. However, the literature reports a variety of factors that may affect the process
of research use. The following subsection synthesises the available empirical data on
the determinants of the use of research-based information by school practitioners.
Determinants of the use of research-based information in education
A detailed, careful examination of existing theoretical and empirical research in the
health, social sciences and education fields reveals that a multitude of factors can
facilitate or hinder the process of research use. However, although considerable work
has been done to analyse the forces influencing the use of research-based information
in education and to compare these influences in education and in other disciplines,
not enough is known about the factors that are empirically essential for this process
to occur.
It is crucial to consider, therefore, the factors that affect practitioners’ decisions to
become involved in change processes and that help to sustain their involvement in
order to cultivate professional performance.This subsection presents five categories of
determinants of use, as identified by the empirical studies on research use in education
(see also Table 2). These determinants may be grouped by the characteristics of: (1)
research, (2) communication processes, (3) practitioners and (4) schools. As explained
earlier in this paper, further distinction can be made between (5) factors affecting the
use of general research-based information and those regarding information produced
locally.
Research characteristics identify the quality of the knowledge product, which is
determined in part by the method used to produce it and its scientific properties of
Evidence & Policy • vol 8 • no 3 • 2012 • 285–309 • http://dx.doi.org/10.1332/174426412X654031
EvP_8_3_Aug_2012_text_3.2.indd 296
14/08/2012 13:23:49
Use of research-based information by school practitioners ...
297
Table 2: Observed factors affecting use of research (general versus local)
Factor
Type of research
Empirical support
General
Williams and Coles (2003, 2007)b; Wilson
and Easton (2003)
Characteristics of research
Accessible and timely
Local
No distinctiona
Objective and true
General
Hultman and Hörberg (1998)b
Local
No distinction
Easy to understand and implement
General
Hultman and Hörberg (1998)b,
McNamara (2002)b; Williams and Coles
(2003)b; Behrstock et al (2009)
Delivered by Ingenta to: Ãquipe RENARD
IP : 216.252.76.97 On: Fri, 11 Jan 2013 23:47:00
Copyright The Policy Press
Local
Connected to school/classroom
context
No distinction
Dagenais et al (2008)c
General
Hultman and Hörberg (1998)b; Shkedi
(1998); Everton et al (2000)b; McNamara
(2002)b; Williams and Coles (2003)b;
Ratcliffe et al (2005); Miretzky (2007)
Local
No distinction
Relevant
General
McNamara (2002)b; Miretzky (2007);
Behrstock et al (2009)
Local
Lafleur (1995)c
No distinction
Dagenais et al (2008)c
General
Williams and Coles (2003, 2007)b
Characteristics of communication
Facilities
Local
No distinction
Access to research and data
General
Latham (1993); Bérubé (2006)b;
Behrstock et al (2009)
Local
No distinction
Quality
General
Behrstock et al (2009)
Local
Lafleur (1995)c
No distinction
Collegial discussions
General
Wilson and Easton (2003)
Local
Collaboration with researchers
No distinction
Dagenais et al (2008)c
General
Cousins and Walker (2000)c; Bingham
Catri et al (2004)b; Cousins et al (2006);
Miretzky, (2007); Behrstock et al (2009)
Local
No distinction
Dagenais et al (2008)c
Evidence & Policy • vol 8 • no 3 • 2012 • 285–309 • http://dx.doi.org/10.1332/174426412X654031
EvP_8_3_Aug_2012_text_3.2.indd 297
14/08/2012 13:23:49
298
Christian Dagenais et al
Sustained collaboration via networks General
and partnerships
Department of Education, Training and
Youth Affairs (2000)b; Simons et al (2003);
Ratcliffe et al (2005); Bérubé (2006)b;
Nicholson-Goodman and Garman (2007)
Local
No distinction
Media
General
Shkedi (1998); Everton et al (2000)
b; Williams and Coles (2003, 2007)
b; Bingham Catri et al (2004)b; Bérubé
(2006)b; Dagenais et al (2008)c
Local
No distinction
Characteristics of practitioners
Delivered by Ingenta to: Ãquipe RENARD
IP : 216.252.76.97 On: Fri, 11 Jan 2013 23:47:00
Copyright The Policy Press
Skills and competencies
Prior participation in research
General
Hultman and Hörberg (1998)b; Everton
et al (2000)b; Williams and Coles (2003,
2007)b; Wilson and Easton (2003)
Local
Cousins and Walker (2000)c
No distinction
Dagenais et al (2008)c
General
Green and Kvidahl(1990)c; Williams and
Coles (2003, 2007)b
Local
Cousins and Walker (2000)c
No distinction
Attitudes towards research
General
Green and Kvidahl (1990)c; NicholsonGoodman and Garman (2007);
Behrstock et al (2009)
Local
Willingness to innovate
No distinction
Dagenais et al (2008)c
General
Saha et al (1995)c ; Biddle and Saha
(2002)
Local
No distinction
Self-efficacy and commitment
General
Saha et al (1995)c; Biddle and Saha (2002)
Local
Cousins and Walker (2000)c
No distinction
Experience
Prior coursework in research
methods
General
Local
Cousins and Walker (2000)c
No distinction
Zeuli and Tiezzi (1993)
General
Green and Kvidahl (1990)c
Local
Cousins and Walker (2000)c
No distinction
Content area taught
General
Green and Kvidahl (1990)c
Local
No distinction
Training on how to make use of
research
General
Saha et al (1995)c; Biddle and Saha (2002)
c ; Bérubé (2006)c
Local
No distinction
Involvement in research
General
Local
Lafleur (1995)c; Simons et al (2003)
No distinction
Zeuli and Tiezzi (1993)
Evidence & Policy • vol 8 • no 3 • 2012 • 285–309 • http://dx.doi.org/10.1332/174426412X654031
EvP_8_3_Aug_2012_text_3.2.indd 298
14/08/2012 13:23:49
Use of research-based information by school practitioners ...
299
Characteristics of schools
Enjoys external support
General
Local
Cousins et al (2006)
No distinction
Wants evidence for decision making
General
Local
Lafleur (1995)c
No distinction
Encourages and supports initiative
Has prior experience with initiatives
General
Ratcliffe et al (2005); Bérubé (2006)b
Local
Cousins et al (2006) No distinction
Dagenais et al (2008)c
General
Local
Cousins and Walker (2000)c; Cousins et
al (2006)
No distinction
Staff capacity and support to use
research
General
Local
Cousins et al (2006)
Delivered by Ingenta to: Ãquipe RENARD
IP : 216.252.76.97 On: Fri, 11 Jan 2013 23:47:00
Copyright The Policy Press
No distinction
Encourages internal collaboration
General
Simons et al, (2003)
Local
Cousins and Walker (2000)c
No distinction
Prioritises appropriate professional
development activities
Needs innovation
General
Latham (1993); Shkedi (1998); Wilson
and Easton (2003)
Local
Hannan et al (2000)b
No distinction
Dagenais et al (2008)c
General
Saha et al (1995)c; Biddle and Saha (2002)
c
Local
No distinction
Is committed to organisational
learning
General
Ratcliffe et al (2005)
Local
Lafleur (1995)c; Cousins and Walker
(2000)c; Cousins et al (2006)
No distinction
Allocates time and resources,
including available technology
General
Hultman and Hörberg (1998)b; Williams
and Coles (2003, 2007)b
Local
No distinction
Dagenais et al (2008)c
Notes:
a Some studies referred to both types of research without distinguishing the factors influencing
each of them separately.
b
Only descriptive data are presented.
c Weight
of determinants of use has been calculated.
The study presents qualitative data only.
Evidence & Policy • vol 8 • no 3 • 2012 • 285–309 • http://dx.doi.org/10.1332/174426412X654031
EvP_8_3_Aug_2012_text_3.2.indd 299
14/08/2012 13:23:49
Delivered by Ingenta to: Ãquipe RENARD
IP : 216.252.76.97 On: Fri, 11 Jan 2013 23:47:00
Copyright The Policy Press
300
Christian Dagenais et al
validity and reliability. Most importantly, however, research characteristics represent
practitioners’ perceptions of its relevance to their practice and drive practitioners’
decisions to use research. The extent to which perceptions affect action can be
considerable. For example, Dagenais et al (2008) found that, among various factors,
practitioners’ opinions about research emerged as the strongest predictor of their use
of research-based information. Other empirical research (Lafleur, 1995; Hultman and
Hörberg, 1998; Shkedi, 1998; McNamara, 2002; Simons et al, 2003; Ratcliffe et al,
2005; Behrstock et al, 2009) has reported that the features appreciated by education
practitioners include clarity, timeliness, relevance, usability, amenability of research to
action/transfer, applicability and sophistication in terms of how well the research-based
information aligns with classroom needs and local contexts. Specifically, research is
valued more when it matches professional experience (Everton et al, 2000) and can
be translated into tangible and useful outcomes (Ratcliffe et al, 2005). In addition,
to be of value in classroom practice, research-based information should be linked to
practice and yield direct teaching applications (Hultman and Hörberg, 1998; Shkedi,
1998; McNamara, 2002) or enhance teacher–pupil interaction and improve methods
of classroom instruction (Everton et al, 2000). Despite the rates of information
digitisation and computerisation, research accessibility remains an issue: teachers
prefer information that is readily accessible (Williams and Coles, 2003, 2007;Wilson
and Easton, 2003), makes minimal demands on time, and does not require special
knowledge or search skills.
Characteristics of communication processes reveal the nature of relationships between
researchers and potential users, as well as their roles in research production. On the
one hand, on the premise that research is external and should be delivered to the
user, the knowledge dissemination model encourages researchers’ initiatives to interest
practitioners in research outcomes. Tailoring research products to meet educators’
needs, expertise and contexts may secure the practical application of these products.
In this way, contacts between researchers and practitioners have been reported as
ensuring more personalised and contextualised research results that increase both the
relevance of the research to the practitioners and, consequently, the likelihood that
they will use it (Bingham Catri et al, 2004; Miretzky, 2007; Behrstock et al, 2009).
On the other hand, sustained interactivity between researchers and practitioners
guarantees the use of the results produced by such common effort. Thus, networks
and partnerships may enhance situated transfer processes (Simons et al, 2003; Ratcliffe
et al, 2005; Bérubé, 2006; Nicholson-Goodman and Garman, 2007). Participation
in such alliances allows practitioners to develop a sense of ownership and a positive
attitude with regard to the research products. Because teachers value their own
research (Wilson and Easton, 2003), their direct involvement in the research process
increases its utility and utilisation. Cousins and Walker (2000) and, later, Cousins et al
(2006) reported that the participation of teachers in programme evaluation initiatives
increased their appreciation of both the evaluation results and the related school
improvement processes.
The choice of media used to communicate research-based information to potential
users also emerges as an important determinant of use (Shkedi, 1998; Williams and
Coles, 2003, 2007; Bingham Catri et al, 2004; Bérubé, 2006). Everton et al (2000)
Evidence & Policy • vol 8 • no 3 • 2012 • 285–309 • http://dx.doi.org/10.1332/174426412X654031
EvP_8_3_Aug_2012_text_3.2.indd 300
14/08/2012 13:23:50
Delivered by Ingenta to: Ãquipe RENARD
IP : 216.252.76.97 On: Fri, 11 Jan 2013 23:47:00
Copyright The Policy Press
Use of research-based information by school practitioners ...
301
reported that teachers still preferred traditional print media such as official publications
and books. A few years later, Williams and Coles (2003, 2007) found that teachers
valued the speed and general accessibility of the Internet. Along the same lines,
Dagenais et al (2008) reported that the Internet was the most frequently consulted
source for research-based information.
Practitioners’ characteristics provide the third category of factors that appear to
determine user-related research-use variables. Williams and Coles (2003, 2007)
reported that the overall beneficial impact of research on practice would improve
if teachers knew more about how to use the products of research. An individual’s
capacity to use research findings to inform everyday practice and the skills needed
to do so thus become important prerequisites for practitioner engagement with
educational research.This skill set includes, but is not limited to, the ability to formulate
questions about problems encountered in practice and the ability to find solutions
by locating research, appraising it critically, inferring from data, applying findings
to practice and conducting one’s own research projects (Hultman and Hőrberg,
1998; Williams and Coles, 2003, 2007; Wilson and Easton, 2003; Dagenais et al,
2008). Simons et al (2003) emphasised the importance of the practitioner’s ability
to perform contextual interpretation of educational research. Empirical research has
also shown that practitioners’ inclination to use research and their engagement with
it can be influenced by a number of personal variables, including self-efficacy and
commitment (Saha et al, 1995; Cousins and Walker, 2000; Biddle and Saha, 2002),
prior involvement in research (Green and Kvidahl, 1990; Cousins and Walker, 2000;
Williams and Coles, 2003, 2007), previous research training (Saha et al, 1995; Biddle
and Saha, 2002; Bérubé, 2006), the number of years of experience (Zeuli and Tiezzi,
1993; Cousins and Walker, 2000) and individual willingness to innovate (Saha et al,
1995; Biddle and Saha, 2002).
A few of the studies reviewed suggested that functions performed by practitioners in
the school hierarchy may affect use of research-based information by various groups of
school practitioners. In Everton et al’s (2000) study, school principals, deputy principals
and teachers reported that their engagement in research use caused them to question
their current opinions and led to improvements in their practice. Deputy principals
were most likely to benefit from extended professional development opportunities
to pursue their career advancement. Not surprisingly, they also scored highest on the
scale of interest in research, whereas teachers scored lowest. However, teachers valued
the opportunity for personal involvement in research much more than did the other
practitioners. Dagenais et al (2008) identified a divide between school principals
on the one hand, and teachers and professionals on the other. Although overall use
of research-based information was low, school administrators showed a significant
lead in the use of major sources of research-based information, including scholarly
documents, professional publications, school evaluations, pre-service and in-service
training, conferences and experts.
School characteristics refer to the educational organisation, with its structure, culture,
physical and human capital, procedures and incentive systems all playing an important
role and contributing to a school’s capacity to learn. In the context of this review,
school learning capacity can be understood as a school’s willingness and readiness to
Evidence & Policy • vol 8 • no 3 • 2012 • 285–309 • http://dx.doi.org/10.1332/174426412X654031
EvP_8_3_Aug_2012_text_3.2.indd 301
14/08/2012 13:23:50
Christian Dagenais et al
Delivered by Ingenta to: Ãquipe RENARD
IP : 216.252.76.97 On: Fri, 11 Jan 2013 23:47:00
Copyright The Policy Press
302
encourage and support its practitioners in their use of research-based information
to improve practice. Factors promoting school learning refer first and foremost to
leadership and administrative styles that are geared to enhance the school’s capacity to
learn. Specifically, this includes openness to change initiatives (Lafleur, 1995; Cousins
and Walker, 2000; Ratcliffe et al, 2005; Cousins et al, 2006), support for collaboration
and collegiality (Cousins and Walker, 2000; Simons et al, 2003), providing time and
appropriate resources including technology (Hultman and Hörberg, 1998; William
and Coles, 2003, 2007; Dagenais et al, 2008) and prioritising professional development
of the teaching staff (Latham, 1993; Shkedi, 1998; Hannan et al, 2000; Wilson and
Easton, 2003; Dagenais et al, 2008). The school’s need for innovation (Saha et al,
1995; Biddle and Saha, 2002) and evidence for decision making (Lafleur, 1995) are
the critical prerequisites for the move. For a school to succeed, another two elements
are important: prior experience with initiatives (Cousins and Walker, 2000; Cousins
et al, 2006) and staff capacity and support in using research (Cousins et al, 2006).
Because educational institutions are embedded in a larger system, a school’s
commitment to the use of research-based information may in turn be affected by
a number of system-related factors, including political concerns, public opinion,
available resources and funding, and the influence of lobbyists and support groups
(Nicholson-Goodman and Garman, 2007).
Determinants of use relating to local versus general research-based information
In this subsection, we explore potential differences in the determinants influencing the
use of general versus local research-based information. Because the studies we reviewed
presented no empirical comparison of the uses of these two types of information, we
analysed the factors observed in each study to determine whether any were specific
to either type of research-based information (local or general). Thus, for instance,
perceived quality of research and communication strategies might be more relevant
for users of general research, since this research is traditionally external to everyday
educational practices. On the other hand, contact between producers and users might
be an important determinant for the use of research studies produced locally for local
users, but probably not for systematic reviews.
Our comparative analysis shows that for the most part, the factors affecting the
use of general research-based information are similar to those affecting the use of
locally produced research (see Table 2). However, certain differences exist. Studies
have revealed five determinants specific of local research use:
•
•
Local research project must be relevant to the teachers’ classroom needs (Lafleur,
1995); for instance, practitioners are more likely to use local research-based
information if in the first place the school wants evidence of efficient decision
making (Lafleur, 1995).
High-quality communication must occur between researchers and practitioners
(Lafleur, 1995).
Evidence & Policy • vol 8 • no 3 • 2012 • 285–309 • http://dx.doi.org/10.1332/174426412X654031
EvP_8_3_Aug_2012_text_3.2.indd 302
14/08/2012 13:23:50
Use of research-based information by school practitioners ...
•
•
•
303
Direct involvement in research by practitioners is even more desirable as a
predictor of use (Lafleur, 1995; Simons et al, 2003). The process of preparing
and conducting research also increases the likelihood that local research will be
successful and thus used.
Practitioners with extensive teaching experience are more likely to use school
research data (Zeuli and Tiezzi, 1993; Cousins and Walker, 2000).
Organisational support for the local endeavour is crucial for research to be
conducted and used. School commitment to learning and the school’s capacity to
conduct local inquiries on a systematic basis (Cousins and Walker, 2000; Cousins
et al, 2006) also encourage the use of locally produced research-based information.
Delivered by Ingenta to: Ãquipe RENARD
IP : 216.252.76.97 On: Fri, 11 Jan 2013 23:47:00
Copyright The Policy Press
Conclusion
Under pressure from an emerging learning society in which knowledge is becoming
the force that drives economies, education faces the challenge of having to adapt in
order to be more effective. Education needs to go through processes of enhanced
individual and organisational learning and change. To ensure that this learning is
continuous, it is important to build close links between research, policy and practice,
through which relevant research can be made available at appropriate times for
acquisition and use by practitioners and school organisations that have the potential
to produce and share contextual knowledge.
This review of the empirical literature pertaining to the use of research-based
information (local and general) by school practitioners may suffer limitations that
affect its results and conclusions. First, little focus was placed on some resources
available in the open Web and dissertation research having neither publication nor
peer-reviewed status was left out of the review. Second, the limited number of primary
studies focusing on the use of research-based information generated in situ and the
complete absence of studies comparing the use of general and local research-based
information did not allow for a full comparison of factors affecting use by education
practitioners. At the same time, the comparison of the available determinants of local
and general research use revealed only some significant differences in their main
features. However, the distinctions between the two did become apparent. Third,
it was difficult to evaluate the relative influence of factors on use, since only four
of the 24 empirical studies tested variables for causality and reported the unique
contribution of each factor; other studies were either descriptive or exploratory.
None of the four studies tested factors for their interaction or combined contribution
in producing an effect on research use. The operationalisation of what constitutes
research use, psychometric inconsistencies such as lack of reliability coefficients, and
small unrepresentative or misrepresentative samples are among the main limitations
of the scales developed to measure use.
There are a few points to be made in these conclusions. As empirical evidence
shows, it is necessary to clarify what constitutes research-evidence use in education.
Despite the accumulated empirical evidence, the extent of use and the dimension
of use, or a combination thereof, sufficient for educational change to occur are still
unknown. Specifically, for instance, we do not know whether reading research once
Evidence & Policy • vol 8 • no 3 • 2012 • 285–309 • http://dx.doi.org/10.1332/174426412X654031
EvP_8_3_Aug_2012_text_3.2.indd 303
14/08/2012 13:23:50
Delivered by Ingenta to: Ãquipe RENARD
IP : 216.252.76.97 On: Fri, 11 Jan 2013 23:47:00
Copyright The Policy Press
304
Christian Dagenais et al
a year is a sufficient incentive to improve classroom instruction. Neither do we know
whether conceptual use of research that modifies opinions and understandings is a
good-enough indicator of change of practice.
Further, to help promote research use in education, the five categories of
determinants that we used to group the numerous factors presented in the selected
studies need to be further assessed for the extent of their influence as well as for
their reciprocal associations and individual share in the joint effect they produce on
educational practice. Finally, much more research is needed to test the many existing
theoretical models of knowledge-transfer processes to guide the transfer process in
education.
Most of these models originate in research-and-technology-guided domains where
ends and means are relatively plain and straightforward and where constant advances
make knowledge obsolete within a few years. Despite contextual differences, transfer
and use patterns developed for other sectors can be worth empirical exploration in
education. From this perspective, evidence-based practice seems to be a promising
framework. If the required research is inadequate or unavailable, practitioners or
organisations with sufficient capability could undertake research on their own or in
partnership with researchers to produce the information required to make decisions
about what will work in their practice (Davies, 1999; Hargreaves, 2000). In this
regard, the Organisation for Economic Co-operation and Development emphasises
the importance of training, support and access to expertise (Cook and Gorard, 2007;
OECD, 2007).
It should be noted that strategies and structures used to support the process of
research-based information use by practitioners as a catalyst for educational change
are contextually embedded and thus exposed to the myriad influences emerging
from their contexts. A multi-framework analysis of likely determinants of use
combines features of research-based information, communication, users and schools.
These determining factors, arising from empirical attempts to understand research
use, need to be examined for both their direct and their mediated influence on the
research-use process. It would also be interesting to analyse the variables studied in
the empirical research for their fit with the critical elements and features of models
that conceptualise the knowledge transfer process.
Notes
1 Empirical: capable of being verified or disproved by observation or experiment.
2
Grey literature refers to written material that is difficult to find through conventional
channels, for example in published journals and monographs, because it is not published
commercially or is generally inaccessible.
Evidence & Policy • vol 8 • no 3 • 2012 • 285–309 • http://dx.doi.org/10.1332/174426412X654031
EvP_8_3_Aug_2012_text_3.2.indd 304
14/08/2012 13:23:50
Delivered by Ingenta to: Ãquipe RENARD
IP : 216.252.76.97 On: Fri, 11 Jan 2013 23:47:00
Copyright The Policy Press
Use of research-based information by school practitioners ...
305
References
Behrstock, E., Drill, K. and Miller, S. (2009) ‘Is the supply in demand? Exploring how,
when and why teachers use research. Learning Point Associates’, Paper presented
at the Annual Meeting of the American Education Research Association, Denver,
Colorado.
Bérubé, B. (2006) L’accès à la recherche en enseignement et son utilisation dans la pratique:
Résultats d’une enquête auprès des enseignants et des enseignantes du préscolaire, du primaire
et du secondaire (Enquête réalisée dans le cadre du rapport annuel 2004–2005 : Le
dialogue entre la recherche et la pratique en éducation: Une clé pour la réussite),
Québec: Conseil supérieur de l’éducation, Direction des études et de la recherche.
Biddle, B.J. and Saha, L.J. (2002) The untested accusation: Principals, research knowledge,
and policy making in schools, Westport, CT and Lanham, MD: Ablex Publishing and
Scarecrow Education.
Bingham Catri, D., Austin, J.T., Moore, M.H., Jones, L.M. and Werner, L. (2004)
Dissemination-utilization patterns of career and technical educators: Survey results,
Columbus, OH: Center on Education and Training for Employment, College of
Education, Ohio State University,
Carnine, D. (2000) ‘Why education experts resist effective practices (and what it would
take to make education more like medicine)’, Thomas B. Fordham Foundation,
www.edexcellence.net/
Cook, T.D. and Gorard, S. (2007) ‘What counts and should count as evidence?’, in
Organisation for Economic Co-operation and Development (OECD) Evidence in
education: Linking research and policy, Paris: OECD.
Cousins, J.B. and Leithwood, K.A. (1993) ‘Enhancing knowledge utilization as a
strategy for school improvement’, Science Communication, 14 (3): 305–33.
Cousins, J.B., Goh, S. and Clark, S. (2006) ‘Data use leads to data valuing: evaluative
inquiry for school decision making’, Leadership and Policy in Schools, 4: 155–76.
Cousins, J.B. and Walker, C. (2000) ‘Predictors of educators’ valuing of systematic
inquiry in schools’, Canadian Journal of Program Evaluation, Special Issue, 25–52.
Dagenais, C., Abrami, P., Bernard, R., Janosz, M. and Lysenko, L. (2008) Integrating
research-based information into the professional practices by teachers and school administrators:
Towards a knowledge transfer model adapted to the educational environment, Ottawa:
Canadian Council on Learning.
Davies, H.T.O., Nutley, S.M. and Walter, I. (2005) Approaches to assessing research
impact: Report of the ESRC symposium on assessing the non-academic impact of research,
St Andrews: Research Unit for Research Utilisation, School of Management,
University of St Andrews.
Davies, P. (1999) ‘What is evidence-based education?’, British Journal of Educational
Studies, 47 (2): 108–21.
Department of Education,Training and Youth Affairs (2000) The impact of educational
research, London: Research Evaluation Programme.
Estabrooks, C.A. (2007) ‘Prologue: a program of research in knowledge translation’,
Nursing Research, 56 (4 suppl 1): S4–S6.
Everton, T., Galton, M. and Pell, T. (2000) ‘Teachers’ perspectives on educational
research: knowledge and context’, Journal of Education for Teaching, 26 (2): 167–82.
Evidence & Policy • vol 8 • no 3 • 2012 • 285–309 • http://dx.doi.org/10.1332/174426412X654031
EvP_8_3_Aug_2012_text_3.2.indd 305
14/08/2012 13:23:50
Delivered by Ingenta to: Ãquipe RENARD
IP : 216.252.76.97 On: Fri, 11 Jan 2013 23:47:00
Copyright The Policy Press
306
Christian Dagenais et al
Graham, I.D., Logan, J., Harrison, M.B., Straus, S.E., Tetroe, J.M., Caswell, W. and
Robinson, N. (2006) ‘Lost in knowledge translation: time for a map?’, Journal of
Continuing Education in the Health Professions, 26 (1): 13–24.
Green, K. and Kvidahl, R. (1990) ‘Research methods courses and post-Bachelor’s
education: effects on teachers’ research use and opinions, paper presented at the
annual meeting of the American Educational Research Association, Boston, MA.
Hannan, A., Enright, H. and Ballard, P. (1998) Using research: The results of a pilot
study comparing teachers, general practitioners and surgeons, www.leeds.ac.uk/educol/
documents/000000851
Hannan, A., Enright, H. and Ballard, P. (2000) ‘Using research: the results of a pilot
study comparing teachers, general practitioners and surgeons’, www.leeds.ac.uk/
educol/documents/000000851.htm
Hargreaves, D. (1996) Teaching as a research-based profession: Possibilities and prospects,
London: Teacher Training Agency.
Hargreaves, D. (2000) ‘The production, mediation and use of professional knowledge
among teachers and doctors: a comparative analysis’, in Organisation for Economic
Co-operation and Development (OECD) (ed) Knowledge management in the learning
society: Education and skills, Paris: OECD, 219–38.
Hemsley-Brown, J. and Sharp, C. (2003) ‘The use of research to improve professional
practice: a systematic review of the literature’, Oxford Review of Education, 29 (4):
449–71.
Huberman, M. and Gather-Thurler, M. (1991) De la recherche à la pratique, Berne/
Paris: P. Lang.
Hultman, G. and Hörberg, C.R. (1998) ‘Knowledge competition and personal
ambition: a theoretical framework for knowledge utilization and action in context’,
Science Communication, 19 (4): 328–48.
Lafleur, C. (1995) ‘A participatory approach to district level program evaluation: the
dynamics of internal evaluations’, in J.B. Cousins and L.M. Earl (eds) Participatory
evaluation in education: Studies in evaluation use and organizational learning, London
and Washington, DC: Falmer Press, 33–54.
Latham, G. (1993) ‘Do educators use the literature of the profession?’, National
Association of Secondary School Principals Bulletin, 77 (550): 63–7.
Louis, K.S. (1996) ‘Reconnecting knowledge utilisation and school improvement:
two steps forward, one step back’, in A. Hargreaves, M. Fullan and D. Hopkins (eds)
International handbook on school improvement, London: Cassell.
Love, J.M. (1985) ‘Knowledge transfer and utilization in education’, Review of Research
in Education, 12: 337–86.
McKibbon, K.A., Lokker, C., Wilczynski, N.L., Ciliska, D., Dobbins, M., Davis,
D.A., Haynes, R.B. and Straus, S.E. (2010) ‘A cross-sectional study of the number
and frequency of terms used to refer to knowledge translation in a body of
health literature in 2006: a Tower of Babel?’, Implementation Science, 5 (1): 16, doi:
10.1186/1748-5908-5-16.
McNamara, O. (ed) (2002) Becoming an evidence-based practitioner:A framework for teacherresearchers, London and New York, NY: Routledge/Falmer.
Evidence & Policy • vol 8 • no 3 • 2012 • 285–309 • http://dx.doi.org/10.1332/174426412X654031
EvP_8_3_Aug_2012_text_3.2.indd 306
14/08/2012 13:23:50
Delivered by Ingenta to: Ãquipe RENARD
IP : 216.252.76.97 On: Fri, 11 Jan 2013 23:47:00
Copyright The Policy Press
Use of research-based information by school practitioners ...
307
Miretzky, D. (2007) ‘A view of research from practice: teachers talk about research’,
Theory into Practice, 46 (4): 272–80.
Mitton, C., Adair, C.E., McKenzie, E., Patten, S.B., and Waye Perry, B. (2007)
‘Knowledge transfer and exchange: review and synthesis of the literature’, Milbank
Quarterly, 85 (4): 729–68.
National Commission on Excellence in Education (1983) A nation at risk:The imperative
for educational reform, Washington, DC: US Government Printing Office.
Nicholson-Goodman, J. and Garman, N.B. (2007) ‘Mapping practitioner perceptions
of “it’s research based”: scientific discourse, speech acts and the use and abuse of
research’, International Journal of Leadership in Education, 10 (3): 283–99.
Nutley, S.M., Percy-Smith, J. and Solesbury, W. (2003b) Models of research impact: A
cross-sector review of literature and practice building effective research, London: Learning
and Skills Research Center.
Nutley, S.M., Walter, I. and Davies, H.T.O. (2003a) ‘From knowing to doing: a
framework for understanding the evidence-into-practice agenda’, Evaluation: The
International Journal of Theory, Research and Practice, 9 (2): 125–48.
Nutley, S.M., Walter, I. and Davies, H.T.O. (2007) Using evidence: How research can
inform public services, The Bristol: Policy Press.
OECD (Organisation for Economic Co-operation and Development) (2007) Evidence
in education: Linking research and policy, Paris: OECD Publications Service.
Ratcliffe, M., Bartholomew, H., Hames,V., Hind,A., Leach, J., Millar, R. and Osbourne,
J. (2005) ‘Evidence-based practice in science education: the researcher–user
interface’, Research Papers in Education, 20 (2): 169–86.
Rickinson, M. (2005) Practitioners’ use of research:A research review for the National Evidence
for Education Portal (NEEP) Development Group, Working Paper, London: National
Educational Research Forum, www.eep.ac.uk/nerf/word/WP7.5-PracuseofRe42d.
doc?version=1
Rogers, E.M. (1995) Diffusion of innovations (4th edition), New York, NY: Free Press.
Rohrbach, L.A., Ringwalt, C.L., Ennett, S.T. andVincus,A.A. (2005) ‘Factors associated
with adoption of evidence-based substance use prevention curricula in US school
districts’, Health Education Research, 20 (5): 514–26.
Saha, L.J., Biddle, B.J. and Anderson, D.S. (1995) ‘Attitudes towards education research
knowledge and policymaking among American and Australian school principals’,
International Journal of Educational Research, 23 (2): 113–26.
Shkedi, A. (1998) ‘Teachers’ attitudes towards research: a challenge for qualitative
researchers’, International Journal of Qualitative Studies in Education, 11 (4): 559–77.
Sieber, S.D. (1974) ‘Trends in diffusion research: knowledge utilization’,Viewpoints,
50(3), 61-81.
Simons, H., Kushner, S., Jones, K. and James, D. (2003) ‘From evidence-based practice
to practice-based evidence: the idea of situated generalization’, Research Papers in
Education, 18 (4): 347–64.
Slavin, R.E. (2004) ‘Education research can and must address “what works” questions’,
Educational Researcher, 33 (1): 27–8.
Smith, H. (1974) The Society for the Diffusion of Useful Knowledge 1826–1846: A social
and bibliographical evaluation, London:Vine Press.
Evidence & Policy • vol 8 • no 3 • 2012 • 285–309 • http://dx.doi.org/10.1332/174426412X654031
EvP_8_3_Aug_2012_text_3.2.indd 307
14/08/2012 13:23:50
Delivered by Ingenta to: Ãquipe RENARD
IP : 216.252.76.97 On: Fri, 11 Jan 2013 23:47:00
Copyright The Policy Press
308
Christian Dagenais et al
Taylor, W. (1973) ‘Knowledge and research’, in W. Taylor (ed) Research perspectives in
education, NY: Routledge & Kegan Paul Ltd.
Tomlinson, S. (1994) ‘What is really going on in school?’, Parliamentary Brief on
Education, Decemberpp. 103 - 110.
Tooley, J. with Darby, D. (1998) Educational research: A critique, London: Office for
Standards in Education.
Weiss, C.H. (1980) ‘Knowledge creep and decision accretion’, Knowledge: Creation,
Diffusion, Utilization, 1, 381-404.
Whitehurst, G.J. (2003) The Institute of Education Sciences: New wine, new bottles, www.
ed.gov/rschstat/research/pubs/ies.html
Williams, D. and Coles, L. (2003) The use of research by teachers: Information literacy,
access and attitudes, Research Report No 14, Aberdeen: Department of Information
Management, Aberdeen Business School, Robert Gordon University,
Williams, D. and Coles, L. (2007) ‘Teachers’ approaches to finding and using research
evidence: an information literacy perspective’, Educational Research, 49: 185–206,
doi: 10.1080/00131880701369719.
Wilson, R. and Easton, C. (2003) ‘Using research for school improvement: the LEA’s
role’, paper presented at the British Educational Research Association Annual
Conference, Heriot-Watt University, Edinburgh, 11–13 September.
Zeuli, J.S. and Tiezzi, L.J. (1993) Creating contexts to change teachers’ beliefs about the
influence of research, Report No 1, East Lansing, MI: National Center for Research
on Teacher Learning.
Appendix: Search strategy summary
The following is a brief description (with an example) of each database used in the
search to identify relevant studies. The overall search strategy utilised terms to capture
the outcome, setting and participants.
The basic search string (free-text) was as follows: (“research use” OR “research utilization”
OR “evidence-based” OR “knowledge transfer” or “knowledge mobilization”) AND
(determinant* OR factor * OR predictor*). A similar basic search string was used for
the French language search.
Year of publication: 1990 was used as a delimiter.
When available, the database thesaurus was consulted for the specific terminology used
by the database to adjust the search statement.
ERIC (Education Resources Information Centre) Thesaurus: research utilization,
evaluation utilization, use studies, elementary secondary education.
PsycInfo and Academic Search Complete Thesaurus: evidence based practice, best practice,
knowledge transfer.Alternative free-text search element: NOT (health OR medicine OR
nursing OR clinical OR “social work”).
Evidence & Policy • vol 8 • no 3 • 2012 • 285–309 • http://dx.doi.org/10.1332/174426412X654031
EvP_8_3_Aug_2012_text_3.2.indd 308
14/08/2012 13:23:50
Use of research-based information by school practitioners ...
309
CBCA Education Thesaurus: none.
Web of Science Thesaurus: none. Alternative free-text search element: NOT (health OR
medicine OR nursing OR clinical OR “social work”).
Delivered by Ingenta to: Ãquipe RENARD
IP : 216.252.76.97 On: Fri, 11 Jan 2013 23:47:00
Copyright The Policy Press
Education Full Text Thesaurus: evidence-based education.
Christian Dagenais (christian.dagenais@umontreal.ca)
Department of Psychology, Université de Montréal, and
Centre for Liaison on Intervention and Prevention in the Psychosocial Area (CLIPP),
Montréal, Canada
Larysa Lysenko, Philip C. Abrami and Robert M. Bernard
all at Department of Education, and Centre for the Study of Learning and Performance,
Concordia University, Montréal, Canada
Jean Ramde Department of Psychology and
Michel Janosz School of Psychoeducation,
both at Université de Montréal, Canada
Evidence & Policy • vol 8 • no 3 • 2012 • 285–309 • http://dx.doi.org/10.1332/174426412X654031
EvP_8_3_Aug_2012_text_3.2.indd 309
14/08/2012 13:23:50