Spear Man

Download as doc, pdf, or txt
Download as doc, pdf, or txt
You are on page 1of 5

Spearman's rank correlation coefficient

A Spearman correlation of 1 results when the two


variables being compared are monotonically related, even
if their relationship is not linear. In contrast, this does not
give a perfect Pearson correlation.

When the data are roughly elliptically distributed


and there are no prominent outliers, the Spearman
correlation and Pearson correlation give similar values.

The Spearman correlation is less sensitive than the


Pearson correlation to strong outliers that are in the tails of
both samples.

In statistics, Spearman's rank correlation coefficient


or Spearman's rho, named after Charles Spearman and
often denoted by the Greek letter ρ (rho) or as rs, is a non-
parametric measure of statistical dependence between two
variables. It assesses how well the relationship between two
variables can be described using a monotonic function. If
there are no repeated data values, a perfect Spearman
correlation of +1 or −1 occurs when each of the variables is
a perfect monotone function of the other.

Definition and calculation


The Spearman correlation coefficient is often thought of as being the Pearson correlation
coefficient between the ranked variables. In practice, however, a simpler procedure is
normally used to calculate ρ. The n raw scores Xi, Yi are converted to ranks xi, yi, and
the differences di = xi − yi between the ranks of each observation on the two variables
are calculated.
If there are no tied ranks, then ρ is given by:[1][2]

If tied ranks exist, Pearson's correlation coefficient between ranks should be used for the
calculation

One has to assign the same rank to each of the equal values. It is an average of their
positions in the ascending order of the values.
In the table below, notice how the rank of values that are the same as the mean of what
their ranks would otherwise be.
Variable Xi Position in the descending order Rank xi
0.8 5 5

1.2 4

1.2 3

2.3 2 2
18 1 1

Related quantities
There are several other numerical measures that quantitify the extent of
statistical dependence between pairs of observations: these are discussed at correlation
and dependence. The most common of these is the Pearson product moment correlation
coefficient.

An alternative name for the Spearman rank correlation is the "grade correlation";
[3] in this, the "rank" of an observation is replaced by the "grade". In continuous
distributions, the grade of an observation is, by convention, always one half less than the
rank, and hence the grade and rank correlations are the same in this case. More
generally, the "grade" of an observation is proportional to an estimate of the fraction of a
population less than a given value, with the half-observation adjustment at obsefved
values. Thus this corresponds to one possible treatment of tied ranks. While unusual,
the term "grade correlation" is still in use.
Interpretation

A positive Spearman correlation coefficient corresponds to an increasing monotonic


trend between X and Y.
A negative Spearman correlation coefficient corresponds to a decreasing
monotonic trend between X and Y.

The sign of the Spearman correlation indicates the direction of association


between X (the independent variable) and Y (the dependent variable). If Y tends to
increase when X increases, the Spearman correlation coefficient is positive. If Y tends to
decrease when X increases, the Spearman correlation coefficient is negative. A
Spearman correlation of zero indicates that there is no tendency for Y to either increase
or decrease when X increases. The Spearman correlation increases in magnitude as X
and Y become closer to being perfect monotone functions of each other. When X and Y
are perfectly monotonically related, the Spearman correlation coefficient becomes 1. A
perfect monotone increasing relationship implies that for any two pairs of data values
Xi, Yi and Xj, Yj, that Xi − Xj and Yi − Yj always have the same sign. A perfect monotone
decreasing relationship implies that these differences always have opposite signs.

The Spearman correlation coefficient is often described as being


"nonparametric." This can have two meanings. First, the fact that a perfect Spearman
correlation results when X and Y are related by any monotonic function can be
contrasted with the Pearson correlation, which only gives a perfect value when X and Y
are related by a linear function. The other sense in which the Spearman correlation is
non-parametric is that its exact sampling distribution can be obtained without requiring
knowledge of the joint probability distribution of X and Y.

Example
In this example, we will use the raw data in the table below to calculate the
correlation between the IQ of a person with the number of hours spent in front of TV per
week.
IQ, Xi Hours of TV per week, Yi
106 7
86 0
100 27
101 50
99 28
103 29
97 20
113 12
112 6
110 17
First, we must find the value of the term . To do so we use the following steps,
reflected in the table below.
Sort the data by the first column (Xi). Create a new column xi and assign it the ranked
values 1,2,3,...n.
Next, sort the data by the second column (Yi). Create a fourth column yi and similarly
assign it the ranked values 1,2,3,...n.
Create a fifth column di to hold the differences between the two rank columns (xi and yi).
Create one final column to hold the value of column di squared.
IQ, Xi Hours of TV per week, Yi rank xi rank yi di
86 0 1 1 0 0
97 20 2 6 −4 16
99 28 3 8 −5 25
100 27 4 7 −3 9
101 50 5 10 −5 25
103 29 6 9 −3 9
106 7 7 3 4 16
110 17 8 5 3 9
112 6 9 2 7 49
113 12 10 4 6 36
With found, we can add them to find . The value of n is 10. So these
values can now be substituted back into the equation,

which evaluates to ρ = −0.175757575...

This low value shows that the correlation between IQ and hours spent watching
TV is very low. In the case of ties in the original values, this formula should not be used.
Instead, the Pearson correlation coefficient should be calculated on the ranks (where
ties are given ranks, as described above).

Determining significance
One approach to testing whether an observed value of ρ is significantly different
from zero (r will always maintain 1 ≥ r ≥ −1) is to calculate the probability that it would be
greater than or equal to the observed r, given the null hypothesis, by using a permutation
test. An advantage of this approach is that it automatically takes into account the number
of tied data values there are in the sample, and the way they are treated in computing
the rank correlation.
Another approach parallels the use of the Fisher transformation in the case of the
Pearson product-moment correlation coefficient. That is, confidence intervals and
hypothesis tests relating to the population value ρ can be carried out using the Fisher
transformation:

If F(r) is the Fisher transformation of r, the sample Spearman rank correlation coefficient,
and n is the sample size, then

is a z-score for r which approximately follows a standard normal distribution under the
null hypothesis of statistical independence (ρ = 0).[5][6]
One can also test for significance using

which is distributed approximately as Student's t distribution with n − 2 degrees of


freedom under the null hypothesis. A justification for this result relies on a permutation
argument.

A generalization of the Spearman coefficient is useful in the situation where there


are three or more conditions, a number of subjects are all observed in each of them, and
it is predicted that the observations will have a particular order. For example, a number
of subjects might each be given three trials at the same task, and it is predicted that
performance will improve from trial to trial. A test of the significance of the trend between
conditions in this situation was developed by E. B. Page and is usually referred to as
Page's trend test for ordered alternatives.

Correspondence analysis based on Spearman's rho


Classic correspondence analysis is a statistical method which gives a score to
every value of two nominal variables, in this way that Pearson's correlation coefficient
between them is maximized.
There exists an equivalent of this method, called grade correspondence analysis,
which maximizes Spearman's rho or Kendall's tau.

You might also like