Published
Published
Published
No. 13-2365
Appeal from the United States District Court for the District of
Maryland, at Greenbelt. Roger W. Titus, Senior District Judge.
(8:09-cv-02573-RWT)
Argued:
Decided:
applicants,
which
the
Equal
Employment
Opportunity
and
male
job
applicants.
The
district
court
granted
as
unreliable
under
this
testimony,
the
Federal
district
Rule
court
of
Evidence
found
the
702.
agency
For
I.
Freeman
is
provider
of
integrated
services
for
background
criminal
justice
required
for
checks
histories.
all
of
job
Criminal
applicants,
and
applicants
background
credit
history
credit
and
checks
were
checks
for
sensitive
criminal
histories
financial
background
revealed
information.
check
policies
certain
excluded
prohibited
3
Freemans
credit
applicants
criteria.
and
whose
If
an
11,
2011,
after
which
it
no
longer
conducted
credit
checks.
In 2008, after an applicant who was denied a position filed
a charge of discrimination, the EEOC began an investigation of
Freemans
notified
credit
Freeman
check
it
policy.
was
On
expanding
September
this
25,
2008,
investigation
to
it
the
conciliation
706
and
707
of
failed,
the
Title
VII. 2
EEOC
42
filed
suit
under
U.S.C.
2000e-5,
impact on black and male job applicants, 3 and that the credit
checks had a disparate impact on black job applicants.
The
case
proceeded
by
Kevin
to
discovery.
Murphy,
an
The
EEOC
produced
industrial/organizational
which
purported
to
replicate
Murphys
results.
Then, eight days after its expert disclosure deadline, the EEOC
produced an amended report from Murphy with slightly altered
calculations.
In response to
pending,
served
Freeman
yet
another
supplemental
expert
sur-reply
Murphys
and
granted
testimony
on
errors
and
analytical
the
Freemans
basis
completely
that
motion
it
to
was
unreliable
exclude
rife
under
with
Federal
II.
Federal Rule of Evidence 702 governs the admissibility of
expert evidence.
if
it
rests
reliable
foundation
and
is
relevant.
Westberry v. Gislaved Gummi AB, 178 F.3d 257, 260 (4th Cir.
1999) (quoting Kumho Tire Co. v. Carmichael, 526 U.S. 137, 141
(1999)).
on
validity
that
the
court
finds
to
be
useful. 4
or
be
to
of
or
Westberry,
178
gatekeeping
F.3d
inquiry
at
will
261.
The
scope
depend
upon
the
review
exclude
expert
evidence
for
F.3d
261.
Westberry,
178
discretion
if
it
district
at
relies
the
courts
particular
expert
courts
an
on
of
abuse
A
an
decision
of
district
error
See id.
of
to
admit
or
to
discretion.
See
court
its
law
or
abuses
a
clearly
below
committed
clear
error
of
judgment
in
the
analytical
fallacies
in
Murphys
reports,
making
it
Freeman provided
J.A. 1061.
whom
failed
the
checks.
J.A.
1063.
However,
Freeman,
background
investigations
and
more
than
300
credit
J.A. 461-62.
utilize
purported
sample
to
size
analyze
from
all
the
relevant
background
time
checks
period,
with
but
verified
outcomes.
Most troubling, the district court found a mind-boggling
number
of
database.
errors
and
unexplained
discrepancies
in
Murphys
for whom the EEOC is seeking back pay, 29 had at least one error
or omission.
Seven were listed in the database without a race code, one was
incorrectly coded as passing the criminal background check, two
were incorrectly coded as failing the criminal background check,
one ha[d] an incorrect race code, five ha[d] incorrect gender
codes, nine [we]re listed twice and double-counted in Murphys
results, and three who failed the credit check [we]re not coded
with a credit check result.
J.A. 1064.
8
in
subsequently-filed,
supplemental
reports.
The
incorrect
of
race
several individuals.
J.A. 1065.
that
to
Murphy
managed
and
pass/fail
status
for
introduce
fresh
errors
into
his
new
Id.
sheer
analysis
renders
reasonably
cannot
number
say
it
mistakes
outside
differ.
the
of
Kumho,
district
and
the
526
omissions
range
U.S.
court
where
at
its
Murphys
experts
153.
abused
in
We
might
therefore
discretion
in
III.
We affirm the district courts grant of summary judgment 8 to
Freeman solely on the basis that the district court did not
abuse
its
discretion
in
excluding
EEOCs
expert
reports
as
could
seek
inconsequential
utterly
relief,
in
unreliable
light
as
of
analysis.
any
error
Murphys
We
in
this
regard
was
pervasive
errors
and
decline
to
reach
any
other
concur
in
Judge
Gregorys
opinion,
write
conduct.
The
Commissions
work
of
serving
the
expert
testimony
from
witness
whose
work
has
been
pursuing
course
that
does
not
serve
it
or
the
I.
As in other cases, the EEOC proffered expert testimony to
establish the alleged disparate impact of Freemans background
check
policies.
Yet
the
expert
testimony
here
was
fatally
reports
contained
fallacies,
reflected
meaningless,
skewed
plethora
cherry-picked
statistic,
11
and
of
data,
included
analytical
produced
mind-boggling
number of errors.
(D.
Md.
2013).
when
Murphy
submitted
late-in-the-day
fallacies.
Id.
at
796.
The
slapdash
nature
of
Murphys work convinced the district court that the EEOC had
only a theory in search of facts to support it.
The
majority
opinion
rightly
agrees
Id. at 803.
with
the
district
courts view, as Murphys work simply did not meet the standards
for expert testimony that Federal Rule of Evidence 702 provides.
But this was not a close question, and three problems merit
special recognition.
First, courts often caution experts against drawing broad
conclusions from incomplete data.
In Lilly v. Harris-Teeter
Supermarket, 720 F.2d 326 (4th Cir. 1983), for instance, this
Court criticized an expert for using data from only a limited
set of relevant locations and years to draw conclusions about a
much broader class.
this data, however, is that its scope -- covering the stores and
warehouse for only 1976 and only the stores for 1975 -- is
insufficient to prove discrimination from 1974 through 1978.);
see also EEOC v. Am. Natl Bank, 652 F.2d 1176, 1195 (4th Cir.
1981)
(deeming
expert
evidence
unreliable
where
it
drew
Tyger
Constr. Co. v. Pensacola Constr. Co., 29 F.3d 137, 144 (4th Cir.
1994).
Yet as the majority notes, Murphy made the very mistake
identified
relevant
in
Lilly:
periods
and
he
omitted
locations.
important
The
information
EEOC
challenged
from
credit
2011;
its
criminal-background-check
claims
spanned
2008
relevant
and
--
ignoring
available
at
data
least
for
each
two-and-a-half
claim.
By
years
of
arbitrarily
putting aside those years, Murphy ignored 300 credit checks and
1,500 criminal background checks.
Worse
check
still,
data
Murphy
from
21
ignored
of
relevant
Freemans
39
criminal
different
locations.
Neither Murphy nor the agency explained these omissions.
Although the EEOC speculates that Freeman produced incomplete
data, the record says differently.
F. Appx 433, 437 (7th Cir. 2001); Fail-Safe, LLC v. A.O. Smith
Corp., 744 F. Supp. 2d 870, 891 (E.D. Wis. 2010); In re Bextra &
Celebrex Mktg.
Sales
Practices
&
Prod.
Liab.
Litig.,
524
F.
Cherry-picking data
data
that
Murphy
included
consisted
of
19
This 100%
of
fails
intended
certainly
to
thought
among
skew
so,
his
few
the
selections
results.
terming
Murphys
suggests
The
work
that
district
an
he
court
egregious
Finally,
Murphys
analysis
contained
many
obvious
errors
faulty
methods
and
lack
of
investigation.
Brown
v.
Burlington N. Santa Fe Ry. Co., 765 F.3d 765, 773 (7th Cir.
2014); see also Dart v. Kitchens Bros. Mfg. Co., 253 F. Appx
395, 399 (5th Cir. 2007) (noting that basic mathematical errors
and flaws in methodology were appropriate reasons to exclude an
expert); cf. Overton v. City of Austin, 871 F.2d 529, 539 (5th
Cir. 1989) (per curiam) ([A] trial court should not ignore the
imperfections
of
the
data
used[.]).
For
example,
Murphys
problems lingered.
and
gender
information.
well
as
race
information,
inaccurately
claiming
incomplete
other applicants.
gender
information.
And
he
double-counted
16
B.
These problems would be troubling enough standing alone,
but
they
are
even
more
disquieting
in
the
context
of
what
There, the
however,
unanimously
affirmed
district
courts
again
sample.
drew
conclusions
from
skewed,
unrepresentative
eleventh-hour
effort
to
patch
his
mistakes,
his
methodology
Id. at
to
craft
it,
administered
by
persons
with
no
only
by
the
witness
himself.
Id.
at
754.
That
flawed
decade
ago,
approach
in
is
Cooper
not
v.
just
Southern
recent
Co.,
problem.
Murphy
drew
454,
456-57
(2006)
(per
curiam).
The
Eleventh
Circuit
basic
allegations
expert report.
of
the
plaintiffs
in
the
guise
of
an
counter
[Freeman]s
arguments
with
new
expert
analyses.
Freeman, 961 F. Supp. 2d at 797. The EEOC nevertheless insists
that the tardy reports were merely supplements.
But [t]o
construe Rule 26(e) supplementation to apply whenever a party
wants to bolster or submit additional expert opinions would
wreak havoc in docket control and amount to unlimited expert
opinion preparation.
Campbell v. United States, 470 F. Appx
153, 157 (4th Cir. 2012) (quotation marks and alterations
omitted).
18
Id.
Id.
In Boelk v. AT & T
premised
on
foreseeab[ility].
common
sense,
Id. at *8.
obvious[ness],
and
court held that such testimony was not the appropriate subject
of expert testimony and did not create a genuine dispute of
material fact at summary judgment.
theme,
the
court
dubbed
Murphys
speculative to be useful.
rejected
Murphys
incorrectly
Id.
conclusions,
accused
another
Id.
Echoing a familiar
testimony
too
general
and
expert
of
that
Murphy
making
had
unfounded
II.
Despite Murphys record of slipshod work, faulty analysis,
and statistical sleight of hand, the EEOC continues on appeal to
defend his testimony.
A+
report,
the
EEOC
says
that
it
meets
some
is
admissible
only
if
it
rests
on
reliable
data,
sufficiently
principles,
called
methods,
into
or
their
question.
application
Kumho
Tire
Co.
are
v.
is
court
may
conclude
that
there
simply
too
great
an
analytical gap between the data and the opinion offered, and
accordingly choose to exclude the opinion.
EEOC,
however,
ignores
this
threshold
analysis
by
theoretical,
rare
case.
See,
e.g.,
Reply
Br.
15
The
agencys
20
contention
ignores
Dauberts
Rather,
courts widely agree that trial judges may evaluate the data
offered to support an experts bottom-line opinions to determine
if
that
testimony
data
provides
adequate
as
reliable.
support
Milward
v.
to
mark
Acuity
the
experts
Specialty
Prods.
Grp., Inc., 639 F.3d 11, 15 (1st Cir. 2011) (quotation marks and
alteration omitted); accord Blunt v. Lower Merion Sch. Dist.,
767 F.3d 247, 276 (3d Cir. 2014); In re TMI Litig., 193 F.3d
613, 697 (3d Cir. 1999); United States v. City of Miami, 115
F.3d 870, 873 (11th Cir. 1997).
simply
meritless,
but
unsupported
and
without
legal
foundation.
and
some
of
which
derives
from
public
actions
that
ordinary
litigant
given
the
vast
disparity
21
of
resources
EEOC v. Great
In
deciding
when
to
act,
the
sometimes-competing
responsibilities.
agency
the
must
employer
serve
from
employees
engaging
in
any
Commission
On
the
interest
unlawful
must
one
by
hand,
the
preventing
employment
42 U.S.C. 2000e-5(a).
balance
an
practice
authority,
parties
they
and
discretion
investigate
or
will
affect
sue.
EEOC
all
those
v.
Propak
Logistics, Inc., 746 F.3d 145, 156 (4th Cir. 2014) (Wilkinson,
J., concurring).
public
officials,
high
and
petty,
to
maintain
some
appreciation for the extent of the burden that their actions may
impose.
Id.
It would serve
discharge
the
responsibilities
delegated
23
to
it
or
face
the