Critical Analysis of Empirical Research
Critical Analysis of Empirical Research
Critical Analysis of Empirical Research
ABSTRACT KEYWORDS
Undertaking empirical research in law can be a daunting task, one Legal research; empirical
for which current undergraduate and postgraduate legal research; legal education
education does not provide a great deal of preparation. Yet the
ability to undertake such research is valuable and, some suggest,
in demand. Many areas of law, its operation and effects, can be
usefully informed by empirical research. This article suggests that
the benefits of empiricism are both pragmatic or policy-driven,
and theoretical.
1. Introduction
Increasingly, higher degree research (HDR) students are encouraged to undertake empiri-
cal research in pursuit of a doctorate or research master’s degree in law. However, they
may frequently have little or no training or experience in undertaking social research,
and generally, there is a lack of education and training in empirical research methods
for undergraduate and postgraduate students in law. This leads to a corresponding dearth
of academics qualified to undertake or supervise such projects. Yet empirical method-
ologies also hold many attractions for legal scholars and for the practice of law – whether
in relation to understanding evidence, basing policy decisions on sound research, or hav-
ing a deep and critical understanding of law’s impact on the world. With the current trend
toward interdisciplinarity, it is more important than ever that undergraduate and particu-
larly HDR students be provided with opportunities to train in, and undertake, empirical
legal research.
Empirical research in law has a long history. The Legal Realists were thinking about
law’s social implications in the early 1900s. 1 Today, it is possible to find a multitude of
examples of empirical methods in law. While criminal law and family law are perhaps
the most abundant sources,2 in Australia empirical legal research has been conducted
in areas as diverse as bankruptcy, 3 consumer law,4 and law and popular culture. 5 While
it may not always be explicitly labelled or taught, Mohr and Manderson observed in
GRIFFITH LAW REVIEW 263
2002 that more critical, interdisciplinary and empirical research was taking place in Aus-
tralian universities than perhaps was commonly realised. 6 They noted that ‘research
understood as a genuine and far reaching inquiry into the nature and experience of law is
taking place in our universities, and it is increasing’.7 Bradney made a similar point in the
late 1990s when he suggested that the ‘doctrinal project’ was in its ‘death throes’.8 Still,
even in the face of the ‘extraordinarily confined approach’9 of doctrinal method, there
seems a general reluctance on the part of legal academics to engage with diverse
methodologies. Empirical research is ‘largely absent from law school curricula’.10 Thus,
students’ and even early career academics’ encounters with various methodologies are
likely to be ad hoc, unstructured or involve learning on the job. Even with access to train-
ing and supervisors experienced in conducting empirical research, embarking on such a
project can be a daunting task as empirical legal research throws up various unique
hurdles.11
This article considers why it is that use of empirical method remains relatively absent
from law schools. It goes on to suggest that empiricism in law holds out many possibilities,
both practically and policy-oriented, and theoretical, for legal academics and HDR stu-
dents in law.
and Duncan report that a small study of law theses in the period 2004–09 found that just
over half were ‘unlikely to require ethics clearance’,19 suggesting that the remaining 44 per
cent had some empirical aspect.
On a broad approach, case studies, case analysis and arguments for law reform are all
empirical methods, as they refer to ‘the real world’.20 These methods may, however, be
limited in terms of the empirical insights they can provide into the law’s operations. More-
over, Bradney notes that ‘most definitions of empirical legal research are much more
restricted’.21
The starting point for a discussion of legal empiricism is often the United States’ Legal
Realism of the early part of the twentieth century.22 Dow has described this movement as a
challenge to the dominance of ‘legal science’ and reliance on the case study method in the
late nineteenth century.23 Perhaps the most obvious goal of empirical research in law is to
contrast the ‘law in books’ with the ‘law in action’24 in the legal realist tradition. 25 Kruse
has explained the necessity for this type of project as follows:
Missing from the law in books are the myriad ways the meaning of law shifts as it filters down
from appellate opinions to lower court cases; as it spreads from lower court cases to local
practices; as local practices influence the information and advice about the law transmitted
by lawyers, court clerks, social workers, probation officers, friends, neighbors, employers,
and others; and as it ultimately shapes the lives of people who receive information or advice
from these multiple sources of legal authority.26
This variance between legal doctrine and its enactment in everyday life led to early empiri-
cal studies such as Moore and Callahan’s 1940s examination of parking fines27 and Kalven
and Zeisel’s study of jury decision-making in the 1960s.28 Hutchinson explains that
‘[s]ocial science research is looking at the context in which the law operates with an
aim to providing reasonably reliable data regarding human behaviour’.29 ‘Testing’ the
effect of law in an empirical fashion allows its impact to be measured against its purpose,
thus, studies may be motivated by the desire to understand how the law actually func-
tions.30 Kalven and Zeisel’s study involved sending questionnaires to judges, asking
them to describe ‘how the jury decided the case, and how they would have decided it
… without a jury’.31 From these data, the authors were able to examine how frequently
disagreements occurred, and the basis of these disagreements.32 They described their
GRIFFITH LAW REVIEW 265
Collier has observed that the term is ‘notoriously ill-defined and contested’.42 Citing Fee-
ley, Economides refers to three branches of socio-legal studies, ‘policy science … social
science, and a distinctive socio-legal voice … ’.43 Hunter describes a continuum of
approaches,44 contrasting empiricism in pursuit of the ‘neo-liberal project of efficiency’
with more critical and theoretical socio-legal perspectives.45 The former refers to the
idea that empiricism in law can be too ‘instrumental’ or focused on a cost–benefit analysis
– putting social science to work for ‘narrow utilitarian’ ends.46
266 F. BELL
3. Methods
The actual methods chosen may include quantitative or qualitative analysis of interview
material, observation or survey responses. Eisenberg, like Heise, has suggested that
Empirical Legal Studies projects ‘usually’ involve statistical analysis.47 In legal research,
methods might include what Harrington and Merry refer to as ‘archival’48 such as analysis
of court files or court records,49 as well as surveys,50 interviews51 and observation, includ-
ing of lawyers interacting with their clients;52 a typical day in a lawyer’s practice53 or court-
room proceedings.54 A great deal of legal practice involves performativity: though court
work may be only a small part of a lawyer’s practice, its symbolic impact is tremendous.
Often, research will use a combination of methods in a mixed- or multi-method approach:
this can, as Harrington and Merry note, ‘enrich the insights’ of a project.55 There are many
mixed method studies involving the law. 56 Feeley’s study, for example, involved obser-
vation of the courtroom, combined with quantitative analysis of court cases; McCann’s
study of labour activism utilised ethnographic observation, interviews, quantitative analy-
sis of media reporting, as well as more traditional analysis of case law. Eekelaar, Maclean
and Beinart observed and interviewed family lawyers, as well as analysing Law Society and
Legal Aid statistics in order to draw their sample.57
At the other end of the scale, methods in which the researcher is more implicated in
interactions with participants, 58 such as ‘naturalistic observation’59 in the tradition of eth-
nography, have also been used in legal projects. Ethnography may refer both to ‘fieldwork
and to writing, to a practice and a genre’:60 Darian-Smith describes it as ‘an in-depth study
of one culture involving ‘firsthand, detailed, description of a living culture based on per-
sonal observation’.61 Legal or criminological ethnographies may involve a detailed study of
law on the ground, in its everyday or commonplace iterations. Valverde’s Everyday Law on
the Street is an example of this – a study of the everyday enactment of planning law in
Toronto.62 Such experiences may take place over lengthy periods: Bourgois’ study of
the crack cocaine market, for example, was based on years of observation and interviews
with his neighbours in East Harlem.63
Learning about empirical research involves understanding what methodologies exist –
the idea of choosing a method implies an understanding of other potential methods, their
strengths and drawbacks. It is necessary to think carefully about whether the research
GRIFFITH LAW REVIEW 267
questions posed are answerable by the method chosen. Kritzer has noted that ‘[i]t is very
easy to ask questions or collect some data, but frequently we fail to explicitly ask ourselves
what we might find in the responses or in the data that will help us answer our own ques-
tion’.64 Perhaps even more importantly, it is necessary to consider the limits and assump-
tions implied by the very questions framed. Trubek and Esser argued, in advocating a
‘critical’ approach:
[I]n the context of this epistemology, ‘empiricism’ does not mean the accurate description of
the external world through careful observation. Rather, it means the imperative to construct
new perspectives through (a) the study (if not observation and description) of meaningful
activity in (b) locales that are defined as unorthodox and trivial from the point of view of
the dominant perspective.65
In other words, there must be awareness of the partiality and subjectivity of ‘scientific’
methods, even if the goal of empiricism remains rigor and ‘reality’.
Whatever the proposed method, undertaking an empirical legal research project (par-
ticularly as part of a higher research degree) is not a choice made lightly. Empirical
research can be expensive, frustrating, time-consuming and demanding. Whitehouse
and Bright identify four key challenges for the empirical legal researcher: lack of training,
funding constraints, accessing data and respondents, and ethics. 66 Atop of these practical
constraints come more pervasive and unavoidable theoretical challenges – related to
interpretation, generalisation, subjectivity and situatedness. Differing conceptions of
what is meant by empiricism and ‘validity’ of results, and a multitude of disciplinary
and analytical frameworks, contribute to the arduousness of any project. Moore and
Maher, discussing ethnography in drug research, have suggested that it is not possible
to cleanly separate a method from a theoretical origin:
[F]or the nature of one’s relationship to research subjects, one’s intersubjective engagement,
fundamentally determines what is possible analytically, through the production of certain
kinds of data.67
Thus, the disciplinary context or origins of the method chosen remain important.
Research without such a context lays itself open to the criticism described above, the
assumption that it is possible for a ‘pure’ form of data to be collected. This is essentially
the criticism that Hunter (2014) makes of Darbyshire’s study of judges, when suggesting
the raw data had been only partially ‘digested’:68
Often, what is presented is only semi-digested: strings of quotations, minimally edited obser-
vation notes and collections of anecdotes grouped under broad headings. [Darbyshire]
explains at the outset that ‘I have not used any theoretical model’, but one rather wishes
she had.69
Rather than the absence of a theoretical model permitting greater objectivity and distance,
it in fact dampens the rigor of the work, due to the researcher’s inability to identify and
reflect upon her own position and influence in the research process. Without the
268 F. BELL
researcher’s own analysis, the imposition of a critical position, the work seems no more
than journalistic: the consumer is left to draw his or her own conclusions. Janet Chan
has discussed the tension, particularly in criminological research, between rejecting an
overly ‘scientistic’ approach to evaluating or quantifying ‘rigor’ in qualitative research,
and acknowledging the need for validity. 70 This need is heightened when a study has
clear policy ends. Lempert has cautioned against ‘overselling’ the findings of research
studies in a policy arena.71
The complexity of research design and implementation perhaps go toward explaining
why, despite a long history and many current examples of empiricism in law, empirical
legal research seems to still be seen as uncommon in Australia. The following section
turns to consider one possible reason for this: the absence of training in empiricism or
empirical methods at law schools.
In other words, if undergraduate students are not exposed to empirical research in law, this
has a flow on effect to HDR students, and ultimately legal academics. Vick commented in
2004 that ‘most present-day legal academics received their undergraduate education in law
departments concerned primarily with training their students to be solicitors, barristers,
advocates, and judges, not academic lawyers’.79
GRIFFITH LAW REVIEW 269
Hillyard suggested that undergraduate law students emerge with a corresponding ten-
dency toward ‘theoretical and textual analysis’,80 or what Burns and Hutchinson describe
as the ‘established traditional territory’ of doctrinal research.81 Loughnan and Shackel
made a similar point about Australian law HDR students, who may not even consider
empirical methods:
[F]or some law students, methodology may appear to be uncontroversial or even non-nego-
tiable, as a student may automatically turn to case law, legislation, legal codes, treaties and
government materials such as parliamentary papers, and then subsequently to secondary
sources such as academic commentary. 82
The lack of opportunity for undergraduate students to engage in empirical legal research
is, Hillyard suggests, also an effect of the neo-liberal university and the job market to which
law students are often seeking entry. 83 That is, the sights of many undergraduate students
are firmly focused on attaining gainful employment as legal practitioners. 84 In Australia,
the curriculum’s consequent focus on technical legal skills and doctrine, at the expense of
critical, interdisciplinary and socio-legal analyses has previously been noted.85 Burns and
Hutchinson noted that few undergraduate law courses included any training in empirical
methods.86 Yet, given the large number of law graduates who will not actually enter legal
practice, and may well end up in fields where training in empirical methods is valued, such
a focus may be misplaced. 87 Of course, students may already have a background in
research methods gained from earlier degrees or work. The increasing availability of post-
graduate law degrees – predominantly the Juris Doctor – in Australia,88 may also herald a
positive change, as greater numbers of law students have other degrees and training to
draw upon. Nevertheless, despite having already completed another degree, not all stu-
dents would have extensive experience in empirical methods or conducting a research
project.
While a lack of exposure to empirical methods in the undergraduate curriculum may be
explicable, the absence of training for higher degree research students is perhaps more sur-
prising. It has been suggested that this lack of training is the primary barrier to HDR stu-
dents embarking on an empirical research project: 89 this has been observed, for example,
of the USA90 and New Zealand,91 as well as Australia.92 Noting the prevalence of double
degrees (combined law and other disciplines), Economides argued that with a relatively
270 F. BELL
The University of Sydney Law School currently offers a program of compulsory research
seminars for its HDR students, though only one session covers methodologies. 97 It seems
that few other Australian law schools offer an equivalent, 98 though Griffith Law School
would appear to be a notable exception, offering various courses. Generic methods courses
may be offered centrally, outside of faculties or schools, but of course by their nature these
are not specific to law. The discipline of criminology is more likely to offer such courses to
undergraduates and coursework masters students: for example, the University of Sydney
course includes a subject titled Crime Research and Policy, in which students design a
hypothetical empirical research project. Within the discipline of law, HDR students
may thus have to pursue their own training and education via conferences, workshops
and formal training sessions, which may be external to the faculty. Funding such training
can be costly, particularly courses in using computer software or advanced statistics. This
may come on top of costs incurred in actually conducting research, such as travel and
accommodation, transcription or data entry. University ethics committees have obli-
gations to consider the safety of researchers as well as research subjects, but precautions
GRIFFITH LAW REVIEW 271
may impose an additional financial burden. 99 Even where available, Zeiler has sounded
a note of caution about short training courses, suggesting these ‘are problematic in that
they attempt to teach material generally covered over at least three semesterlong
courses’ in unrealistically short timeframes.100
More recently, however, Heise has identified that ‘an ever-increasing number of [US] law
professors possess either formal training in an array of social science fields (including, but
not limited to, economics) or a substantial appreciation for social scientific method-
ologies’.103 He connects this to the continuing growth of empirical legal scholarship. 104
Hersch and Viscusi reported that a significant proportion (one-fifth) of academics at
the 26 highest ranked law schools had a doctorate in a social science field. 105 LoPucki
found that ‘62% of PhD holders on top-twenty-six law school faculties have their PhDs
in fields where Statistics is likely required’,106 with a greater proportion of PhDs in econ-
omics and political science, than history or philosophy. Law professors with PhDs in law
comprised only 3 per cent.107 LoPucki has argued that though American law schools
employ faculty members with PhDs in order to promote empirical research, it is not an
effective means of doing so. 108 It is not clear that the hiring practices of Australian law
schools are following a similar trend, though there seems to be greater emphasis placed
on attaining a PhD than previously.
Despite the apparently greater emphasis being given to interdisciplinarity, a more pessi-
mistic view identifies ‘significant impediments’ to collaboration, including lack of under-
standing of other disciplines, poor collaborative skills and the individualistic and
competitive atmosphere of law schools. 109 There may also be structural and institutional
272 F. BELL
barriers: Baron suggested that law faculties traditionally encouraged ‘lone wolf research-
ers’.110 Burns and Hutchinson quote Adler who, describing the UK, commented on ‘the
weak position of socio-legal researchers’ and lack of incentives to ‘encourage law schools
to take postgraduate training in socio-legal studies seriously’.111 They suggest that the Aus-
tralian topography is much the same. 112 Nevertheless, it is claimed that there is a ‘shift’
away from the doctrinal, toward the use of empirically based methodologies 113 with the
importance of interdisciplinary collaboration emphasised particularly through the allo-
cation of funding.114
Such collaboration still takes time and energy, as relationships must be developed and
negotiated. Moreover, postgraduate students and even early career researchers may not
have sufficient academic connections or experience to readily find advice and guidance
from others. Thus, when it comes to rigorous training in empirical methodologies,
there likely remains a dependence on supervisors, as Carney and later Burns and Hutch-
inson identified,115 or fortuitous encounters with more senior scholars.116
The importance of supervision is further emphasised by a school of thought suggesting
that empirical research, particularly the use of qualitative techniques such as interviewing
and ethnographic methods, can only be learned by doing. 117 The experience of undertak-
ing an empirical project has been called a ‘rite of passage’ which must be undertaken by the
researcher, as it is learned ‘[o]nly through the fieldwork experience’.118 This has impli-
cations for supervision and the degree to which an HDR student is restricted to utilising
those methods or theoretical perspectives with which his or her supervisor is familiar.
Social science more than natural science is forced to operate at a remove from the reality it
studies. It must work, therefore, through a chain of inferences. In a formulation which should
carry familiar overtones for the lawyer, social science works with quantified circumstantial
evidence.121
In other words, they suggest congruence in the logical reasoning processes underpinning
both research method and building a case based in evidence. In addition, litigation across
many areas of law often requires the use of evidence gained from empirical data, and hence
requires lawyers to have an understanding of how such data is produced. 122 Corbin and
Dow suggest that this includes
knowing when scientific data are useful in resolving legal issues, knowing what sorts of data
are useful, knowing how to interpret and evaluate such data and how to draw conclusions
from them, and, for lawyers in particular, knowing how to make effective use of scientific
data in litigation.123
Burns and Hutchinson have similarly emphasised the importance of social science
research training by reference to the importance of ‘empirical facts’ in legal proceedings
and judicial decision-making.124
Such skills are also useful in academia, including when trying to attract research fund-
ing.125 Hutchinson and Duncan note that ‘competition for limited research funds is being
more intense’, while ‘interdisciplinary work is highly valued’.126 Changes to Australian
research funding to emphasise ‘outcomes with commercial and community benefit’
may also have an impact.127 As Vick explained:
In purely pragmatic terms, interdisciplinarity offers an opportunity for product differen-
tiation in an increasingly competitive academic market … Interdisciplinary research is per-
ceived to be popular with research funding bodies, and for legal academics in particular it
provides access to research grants of a magnitude not usually available for ‘pure’ legal
research.128
For law HDR students, undertaking empirical research can make it easier to produce a
contribution to scholarship that meets the requirements of originality. 129 Schmidt and
Halliday also suggest it may be less boring and frustrating than doctrinal work. 130
The capacity to understand and evaluate ‘law in the real world’ will be beneficial in
other contexts too, such as consultancy, government, law reform and advocacy. It may
form a sound basis to recommend change to law or legal policy; authors have noted the
importance of ‘bridg[ing] the policy/research divide’ in law as in other disciplines. 131
There are also examples of notorious misunderstandings and misuse of research findings
in law. For example, the Minneapolis Domestic Violence Experiment, conducted in the
1980s, is a classic study in the real-world application of research findings, with unfortunate
274 F. BELL
practical consequences. 132 In a subtler example, Lacey refers to Dworkin and MacKin-
non’s anti-pornography ordinance133 – city ordinances declaring pornography to be a vio-
lation of women’s civil rights, later struck down on freedom of speech grounds – as
illustrating the difficulties in translating a theoretical critique into a policy response.134
Undertaking empirical projects may be a way of helping particular communities to
have their voices heard, and can provide a sense of meaningful engagement with what
matters about the law – such as its effect on people’s lives – in contradistinction to
‘ivory tower’ syndrome. On the other hand, such goals, while noble, can also increase
the time, difficulty and stress of doing empirical research. The researcher may feel a greater
obligation to or communion with research participants, for example, 135 which may be
heightened if communities or individuals are seeking, or require, legal assistance. 136
There is a particular power in empirical work that enables subjects to speak for themselves:
Lacey has explained that socio-legal studies
subject[s] legal practices to a (broadly speaking) empirical inquiry which scrutinizes not
merely the legal articulation of the relevant rules and processes but the meaning and effects
of those rules and processes as interpreted and enforced, and as experienced by their
subjects.137
The way that research subjects describe and assign meaning to particular events is thus the
focus of study – without any assumptions that any one perspective represents the ultimate
‘truth’ about legal proceedings or interactions. This focus, of course, undeniably implicates
the researcher in the obtaining, interpretation and construction of ‘data’. This is pertinent
for law, given the ‘translation’ role that lawyers and legal academics occupy, and the way
that lawyers are already implicated in the ascertainment of ‘facts’ in a legal context.138
Seuffert has explained that, in contrast to traditional assumptions about a lawyer’s neutral
role in eliciting information:
Knowledge is produced in all lawyer-client interactions in countless acts of interpretation:
knowledge about the client, her stories and her desires, knowledge about the lawyer and
her role and knowledge about the law and the client’s and the lawyer’s positions in relation
to the law. This knowledge production is informed by the context in which it takes place,
including the perspectives and experiences of the lawyer and client.139
Problems in communication between lawyers and clients can, as Seuffert’s study ident-
ified, have serious consequences for vulnerable clients, echoing the role of the researcher
vis-à-vis research subjects.140
GRIFFITH LAW REVIEW 275
Likewise, two decades earlier, Sarat and Silbey criticised what they suggest had become a
conventional ‘form’ of law and society research: ‘begin with a policy problem, locate it in a
general theoretical context, present an empirical study to speak to that problem, and con-
clude with recommendations, suggestions or cautions’.149 In their discussion of key studies
of the time,150 they elucidate some of their concerns about the ‘pull of the policy audience’,
not least among them the legitimation of the policy elite and their goals. A consequence of
this is a tendency to ‘[emphasize] the centrality of the state in law and thus [diminish] the
critical potential of sociolegal scholarship’.151
The unifying strand of the critiques made by Sarat and Silbey, Lacey, and Hunter,
focuses on this faith in the possibility of unearthing objective ‘truths’ via empirical
methods. For example, in their critique of Blumberg’s (1967) work, Sarat and Silbey
wrote that:
For Blumberg the results of his inquiry involve neither an interpretation nor a social con-
struction of reality. They are presented as if his observations provide immediate, unmediated
access to the actual operations of the criminal court … It is … in his view, the version, the true
and accurate version.152
276 F. BELL
This goes beyond a methodological concern about mode of analysis – it is the very con-
cept that an answer exists and is discoverable or ascertainable, with which the authors take
issue.
Likewise, Hunter takes issue with what she terms the ‘new legal realism’ (referring to
empirical legal studies) for its avoidance of political agenda; in proclaiming neutrality, it
is ‘positivist but non-normative’.153 Echoing Vick, however, she notes that this type of pol-
icy-oriented, pragmatic empiricism has been encouraged also by institutional structures,
as fiscal imperatives compel academics to seek grants and consultancies, and research out-
puts are measured in economic terms.154 Hutchinson and Duncan wrote:
Within the universities, there is an emphasis on increasing links with industry and funded
applied research, rather than on purely theoretical research. Governments are encouraging
institutional specialisation and centres of excellence, by funding research infrastructure
and research training.155
Though there are many practical and strategic reasons for legal researchers to undertake
empirical projects, the critical and theoretical potentiality of empiricism should not be
overlooked. To a large extent, arguments for empiricism’s theoretical possibility resonate
with claims about the value of interdisciplinarity to law. 156 The critical appraisal of a
reductionist or instrumental approach to empiricism does not deny the importance of
methodological rigour but recognises what empiricism offers by way of critique, self-
reflection and deep understanding of the social impact of law. In this formulation, empiri-
cism is more than simply an extension of scientific methods to socio-legal research. Hun-
ter calls for an aggregation of ‘critical theoretical, progressive political, policy oriented and
empirical approaches to law’.157 She provides case studies of three different research pro-
jects where the original policy goals were modified, subverted or themselves interrogated
in response to empirical findings and the critical stance of the researchers.158
6. Conclusion
There are many reasons for legal scholars to venture into empiricism. The diversity of
empirical projects in law indicates that there is no unitary or ideal approach to empiricism
and no reason to take a narrow approach to what constitutes an empirical project. Regard-
less of the actual methods used, whether qualitative or quantitative, or the type of analysis
undertaken, empiricism has a useful place in the law school. The failure of more legal scho-
lars to engage in empirical projects speaks to both the predominance of doctrinal methods
(despite some indications of change) and the absence of training and supervision. How-
ever, it also calls up a more pervasive discomfort with interdisciplinarity and absorptions
of the theoretical as well as methodological lessons of other disciplines, such as sociology,
anthropology and cultural studies. Lacey and Hunter, and others, have argued for a more
‘critical’ approach to empirical work in law, wherein analysis of law’s effects includes a
153 Hunter (2008a), p 123.
154 Hunter (2008a), p 125, citing Collier (2004).
155Hutchinson and Duncan (2012), p 86.
156
For example, Economides (2014).
157Hunter (2008a), p 126.
158Hunter (2008a), citing Day Sclater and Kaganas (2003); Kaganas and Day Sclater (2004); Sommerlad and Sanderson
Although basically empirical studies can be undertaken in all areas of law and legal
institutions the results of empirical research are particularly present in company law,
criminal justice, tort and family law. The reason for this lies in the easier accessibility
of certain legal subjects to non-lawyers. For example in criminal law sociologists
provided groundbreaking studies of the police and prosecuting authorities. These
studies contributed to a deep understanding of legal phenomena in this field.
In the UK the Oxford Centre for Socio-Legal Studies is an important body for socio-
legal research. The staff of the Oxford Centre for Socio-Legal Studies comprises
lawyers as well as social scientists and research staff from other disciplines who work
together. The above mentioned Centre published path-breaking empirical research
in the fields of tort law and the compensation for personal injury, the financial
implications of divorce and the resolution of family disputes and business disputes.
There are also other centres for empirical research in the UK, such as the Oxford
Centre for Family Law and Policy.
Moreover there are also private social research companies that carry out empirical
research into legal issues, such as The Policy Studies Institute.
Finally there are some freelance researchers which do empirical studies in law who
have undertaken a wide range of empirical projects funded by Government and
other research funders on topics such as legal aid, legal service delivery, county court
litigation.
b) Who makes use of empirical studies in law?
(1) Policy-makers:
The following discussion gives some examples in which Law Commissions and
Committees used empirical material for their proposals for the reform of law. The
areas comprise family law and legal profession:
In 1966 the Law Commission used empirical material to predict how a new divorce
law would look like in practice.[18] These predictions influenced the reform of divorce
law of this time.
Furthermore empirical studies were the basis for influential reports and studies,
such as those of the Finer Committee on One-Parent Families and its predecessors
which were the Morton Commission in 1956 and the Gorell Commission in 1912.
Figures drawn from empirical studies influenced acts of legislation like the
Legitimacy Act 1959, the Divorce Reform Act 1969 and the Family Law Reform Act
1987. The Divorce Reform Act 1969 was inter alia based on figures of Wimperis and
figures of the General Register Office.
The NSW Law Reform Commission started in 1976 conducting empirical research in
the field of legal profession. The Commission had to examine the law and practice of
the legal profession, including its structure, organisation and regulation, exclusive
areas of work, professional ethics, complaints against lawyers, guarantee and
supervision of trust accounts and legal education. The proposals finally made were
based on statiscal analyses, surveys and questionnaires.
Furthermore in some cases empirical research is undertaken after a new law was
introduced in order to look at the effects of the new law. The empiricist has the task
to examine whether the intended effects of the legislator were realized. For instance
the marriage law in Belgium was reformed in 1976. The purpose of the new law was
to establish legally the equality between husband and wife in a marriage. Ten years
later researchers used empirical methods to find out whether equality between
husband and wife exists as a result of the legislation.The results of these studies were
that the new marriage law did not change the behaviour of spouses, but that
cultural and economic factors are more important for the equal status of wife and
husband.
Judiciary:
Furthermore the judiciary has benefited from empirical legal research.[25]
The case Heil v Rankin is a good example for judicial use of empirical research. This
case deals with damages in personal injury cases for non-pecuniary loss.
In 1996, the Law Commission stated that current awards of damages for non-
pecuniary loss for serious personal injury were substantially below the level that they
should be, in the light of prevailing social, economic and industrial conditions. The
Law Commission formulated a report which contained recommendations on
increased damages in personal injury cases. The Commission wanted the Court of
Appeal and the House of Lords to lay down guidelines in a series of cases which
would raise damages. This was a new approach of empirical studies in order to avoid
legislation and thus the intervention of the Parliament. The guidelines should
facilitate awards of compensation that were fair, just and reasonable. The
Commission recommended in its Law Com No. 257 Recommendations on General
Damages in Personal Injury Cases to increase the damages and gave a group of
cases to the Court of Appeal and the House of Lords. The Courts heard several cases
and got written material. The defendants argued as the Law Commission had
argued in its recommendations. In its 35th annual report 2000 [27] the Law
Commission wrote that in Heil v. Rankin the Court of Appeal and House of Lords
partly implemented their recommendations. Therefore this empirical approach was
successful.
Another aspect which shows the benefiting of the judiciary from empirical research
is Hood’s worK on discrimination in the criminal courts. These works led to a major
programme of judicial education on equal treatment of parties which was organized
by the Judicial Studies Board.[29]
Other empirical work that influenced judicial behaviour was work on child
protection cases written by Brophy and public perceptions of the judiciary written by
Genn.
Lawyers:
Lawyers need to do research. That means they have to do legal research on case law,
statutes and regulations. In addition, very often they need to find empirical
information to support their arguments.[31] Lawyers need to find for instance
statistics, financial analyses and information from disciplines such as medicine,
technology, business.
In the USA the first case in which a lawyer used empirical studies for his
argumentation was the case Muller v. Oregon. Louis Brandeis who was later on a
judge of the Supreme Court, litigated the Muller Case as Attorney General of Oregon.
He supported his argument that factory hours should be shorter for women than for
men on a number of sociological research studies from the United States and
Europe. In the end Louis Brandeis won the case.
There are different views on the question whether empirical studies are of any value
for legal research.
a) Deech’s view:
On the one hand Deech thinks that particularly family law has been over-influenced
by empirical research findings which were to her of dubious validity. According to
Deech law reformers pay too much attention to the research of social scientists and
too little to legal standards. She is of the opinion that the intellectual challenge and
content of the law has been apparently reduced.[38]
Because of her fear that empirical research becomes more influential than legal
issues in law, she criticizes the use of empirical data in law in many ways in order to
stop the influence of empirical data in legal issues.
First, to her, the predictions of the Law Commissions based on empirical studies
were often wrong.[40] The Law Commissions seem to have not understood the figures
presented by empiricists properly. The effects of the new acts of legislation were
opposite to the intention of the Law Commissions.
Second, according to Deech the Law Commission misused statistics in family law in
various ways.The researchers have certain opinions on the results they wish to get
from their empirical studies before they start researching. The statistics are seen in
international comparison while the national differences are ignored. According to
Deech this is not possible because figures in different countries have to be treated
differently because of the differences in the circumstances. Every country has its
own national characteristics and attititudes. Moreover the figures used for policy
predictions are selective. That means that the Law Commission could have drawn
contrasting conclusions from the statistics used but they emphasized certain
aspects while ignoring other factors.[43] Furthermore, in some cases the figures used
for policy analyses are incomplete because there are missing important factors in
the statistics to explain certain results.[44] Some empirical studies are based on a very
small sample which cannot be representative.[45]
Deech is afraid that empirical studies get more value in law than they deserve. She is
anxious that empirical research gets more important than the legal aspects like
statutes, regulations. She wants to avoid that empirical research in law is over-
valued.
b) Second opinion:
On the other hand the more generally accepted view says that empirical studies
have little influence. The relationship between empirical research and policy or
empirical studies and law reform is very tenuous.[47] The reason for that is that policy-
makers very rarely make use of the results of empirical studies. There are much more
empirical studies that are undertaken for government departments than there are
studies that are really used for new developments of policy.[48] Therefore according to
this opinion empirical studies are under-valued in legal research.
Furthermore the critical aspects which Deech describes are not right according to
Eekelaar and Maclean.[49] The critic of Deech is based on the wrong assumption that
the data drawn from empirical research are neutral and need no evaluation by
policy-makers which is not the case. It is always necessary to evaluate empirical work
in a critical way. Eekelar and Maclean[50] state that empirical studies have to be seen
only as an additional element to legal research and not as a replacement of
traditional legal scholarship.
c) My opinion:
In my opinion empirical research helps us to bring the black letter law into line with
reality.
It is necessary to see that empirical research is only additional to black letter law and
that the skills of lawyers cannot be replaced by sociologists. The fear of Deech[51] that
empirical research in law could get too much influence is exaggerated. Rather
empirical research in law is used in not enough fields. So far, empirists mainly
undertook research in areas such as criminal, tort and family law. However there are
other areas of law which could have been enriched by empirical work. I think that
one of the reasons for the relatively small extent of empirical studies in legal issues is
that the empirical methodology is compared to the black letter approach to law
relatively young. In the beginning of empirical studies the empiricists had difficulties
to be accepted. Therefore there is a slow development of the empirical methodology
in law which has up to now not come to an end.
The value of empirical studies in law still needs to be recognized. Therefore I believe
that empirical work in legal education at university is very important.
First he/she has to find a worthwhile research topic. Second, the researcher needs to
plan his study. That means one needs to think about the appropriate method one
can use in order to get the results needed. After that the empiricist has to draw a
research plan. Third, the researcher needs to carry out his/her study and thus using
the research method in practice.[53] In the end the researcher needs to analyse the
research made and write it down. The research results can then be used by for
instance policy-makers.
The methods used for empirical research are basically the qualitative method –
interview – and the quantitative method – questionnaire -. Both methods have
advantages. To get better results it is often useful to combine the two methods.
The following discussion will first describe the characteristics of the qualitative
method, then the features of the quantitative method and in the end suggest the
combination of the two.
a) Interviews:
Before starting an interview it is necessary to consider which are the right questions
to ask and who are the right people to talk to.[54] That means that the academic
needs to plan asking those questions which help achieving the aim of the research.
Moreover the researcher should, in order to achieve the best representative results,
talk to a wide range of people from different groups. This includes also to talk to
interviewees who are more difficult to reach than others.
The considerations what are the right questions to ask and who are the right people
to talk to does not mean at all that the researchers exclusively are looking for
respondents and such type of questions to obtain the answers they expected. [55]
There are broadly two types of interviews: structured and unstructured interviews.
Whether an interview is structured or unstructured depends on the way in which
questions are posed by the interviewer, whether they are open-ended, requiring an
opinion or detailed factual information, or whether they are closed and can be
answered by reference to a pre-determined attitude scale.[57] Open questions give
the respondent the possibility to give a spontaneous answer in his/her own words.
Closed questions direct the respondent to select an answer from different
alternatives.
The type of interview (highly or loosely structured) depends on various factors: the
topic of research, the number and kinds of interviewees, the type of access possible
and the location of the interviewees, the amount of research budget, the time
provided for interviews and the number of staff assisting the research.
Having considered these factors the researcher needs to identify the kind of
interview which best fits his purpose of research.
Pilot interviews are helpful to gather basic information about the field before
imposing more precise and inflexible methods.
After the interviews were conducted it is necessary to analyse the results and write
them down by using for example statistics.
b) Questionnaires:
The use of questionnaires is a quantitative method. The study will be carried out on a
large scale and the information gathered allows complex statistical analysis.[63] This
kind of methods can reveal much about the weight of experience or opinion within a
given population.
The wording and the vocabulary of the questions have to be short and simple so that
the respondents understand the questions in the same way as the researcher. The
researcher cannot explain the questions to the respondents in a questionnaire if the
wording is ambiguous.
Questionnaires are often used in postal surveys where the views of large populations
are needed.
In the end it is always important to pay attention to ethical issues while undertaking
empirical research, such as data protection and respect of privacy.
Conclusion:
The discussion has shown that the empirical methodology gets an increasingly
important role in law. The use of empirical methods in legal issues will be further
extended. The use of empirical studies in the legal education will contribute to the
broader use of this methodology in law. Therefore the value of empirical legal
research will increase as well. Legal scholars, sociologists, economists and
psychologists need to work together to increase the use of empirical methods in
legal topics. This will contribute to a deeper understanding of judges, lawyers and all
kinds of legal profession for the role of law in society. They will not only have
knowledge about the law in books but also about the law in action. This will reduce
the gap between the society and the legal system which sometimes exist. There are
many reasons for legal scholars to venture into empiricism. The diversity of empirical
projects in law indicates that there is no unitary or ideal approach to empiricism and
no reason to take a narrow approach to what constitutes an empirical project.
Approaching an empirical project with a comprehensive understanding of what has
gone before – whether the lens is socio-legal, policy-oriented or descriptive –
promotes methodological rigor, which ultimately serves both pragmatic and
theoretical ends
References:
Internet
https://www.questionpro.com/blog/empirical-research/
https://www.grin.com/document/110305
http://www.ucl.ac.uk/laws/genn/empirical/consultation/index.shtml?chpt2
http://www.ucl.ac.uk/laws/genn/empirical/consultation/index.shtml?chpt3
http://www.lawcom.gov.uk/files/lc268.pdf
http://www.agd.nsw.gov.au/lawlink/lrc/ll_lrc.nsf/pages/LRC_history4
http://library.kentlaw.edu/Resources/EmpTutorial/
Articles
Deech R, (1990) Divorce law and empirical studies, 106 The Law Quarterly Review, pp.
229 - 245
Eekelaar J and Maclean M, Divorce law and empirical studies – A reply (1990), 106, The
Law Quarterly Review, pp. 621 ff.