Questions tagged [order-statistics]
The order statistics of a sample are the values placed in ascending order. The i-th order statistic of a statistical sample is equal to its i-th smallest value; so the sample minimum is the first order statistic & the sample maximum is the last. Sometimes 'order statistic' is used to mean the whole set of order statistics, i.e. the data values disregarding the sequence in which they occurred. Use also for related quantities such as spacings.
504 questions
1
vote
1
answer
88
views
Distribution of $Z$ = min($y_1, y_2, ... y_n$) $-$ max($x_1, x_2, ... x_n$) [closed]
Given two samples $x_1, x_2, ... x_n$ and $y_1, y_2, ... y_n$, whose values are in [0, 1], what is the distribution of $Z$ = min({$y_1, y_2, ... y_n$}) $-$ max($x_1, x_2, ... x_n$)? It is usually the ...
- 1,649
0
votes
0
answers
49
views
Conditional expectation of order statistics when observing ratio/difference
Suppose two independent ordered draws from some continuous and bounded distribution $F_{[0,\bar{x}]}$ with $f>0$ everywhere, represented by the order statistics $$X_{(1:2)}=\min(X_1,X_2)\text{, and ...
- 65
6
votes
1
answer
132
views
What is $\mathbb E[M\times\sum{X_i}]$ in normal distribution, $M$ being the sample median?
Given $X_{1},\ldots,X_{n}$ an iid sample of a standard normal distribution, let $M=M(X_1,\ldots,X_n)$ be the median of this sample. What is the value of$$\mathbb E\left[M(X_1,\ldots,X_n)\times\sum_{i=...
- 63
0
votes
0
answers
21
views
What are the alternative summary measures of a maximum order statistic when the expectation of the underlying distribution is not finite?
Suppose, $n$ units are placed on a life test. The time-to-failure follows a continuous probability distribution with non-existing finite moments(like a lower-truncated Cauchy or inverse Lomax). Let, $...
- 305
3
votes
1
answer
172
views
Can median or mode of the order statistics be obtained?
Suppose $X_1, X_2,\cdots, X_n$ is a random sample of size $n$ from a continuous probability distribution with cumulative distribution function (CDF) $F(x)$ and probability density function (PDF) $f(x)$...
- 305
1
vote
0
answers
49
views
About 'Suppose $Z_i$ are i.i.d. $N(0, 1).$ And let $M_n = \max\{Z_1, \ldots, Z_n\}$, show that $P(M_n > t) \leq n(1 - \Phi(t))$'
Re question of https://stats.stackexchange.com/users/395275/lisa-w
Suppose $Z_i$ are i.i.d. $N(0, 1).$ And let $M_n = \max\{Z_1, \ldots, Z_n\}$, show that $P(M_n > t) \leq n(1 - \Phi(t))$
I notice ...
- 2,474
6
votes
1
answer
119
views
Suppose $Z_i$ are i.i.d. $N(0, 1).$ And let $M_n = \max\{Z_1, \ldots, Z_n\}$, show that $P(M_n > t) \leq n(1 - \Phi(t))$
Show that $P(M_n > t) \leq n(1 - \Phi(t))$
My work:
\begin{align}
& P(M_n > t) \leq P\left(\bigcup_{i=1}^n (Z_i > t) \right) \\ \leq {} & \sum_{i=1}^n P(Z_i > t)= n(1 - \Phi(t))
\...
- 145
5
votes
1
answer
216
views
In a sum of high-variance lognormals, what fraction comes from the first term?
If $X_i \overset{\textrm{iid}}{\sim} \text{Lognormal}(0, \sigma^2)$ for $i=1,\ldots,n$ and $Y_1 = X_1 / \sum_{j=1}^n X_j$, then I would expect that a particular* limiting distribution of $Y_1$, ...
- 195
2
votes
1
answer
102
views
Approximation of the expected value of the $i$-th standard normal order statistic in a sample of size n
For random variables $X_1, \cdots, X_n$, we denote the order statistics by
\begin{align}
X_{(1)} & = \min (X_1,\ldots, X_n) \\[6pt]
X_{(2)} & = \text{second-smallest of } X_1,\ldots, X_n \\
&...
- 195
3
votes
1
answer
60
views
Rough answer for the maximum of absolute value of $n$ standard gaussians (Computer Age Statistical Inference Problem 1.3)
I am working through "Computer Age Statistical Inference" as a self-study and am stuck on the follow exercise (1.3):
The details of equation 1.6 are unimportant for the exercise, so far as ...
- 115
4
votes
1
answer
117
views
Need help in calculating $\mathbb{E}(\frac{1}{x_{(2)}-x_{(1)}}\int_{x_{(1)}}^{x_{(2)}} f(t) \ dt)$, where $x_{(i)}$ are related Beta distribution
Suppose $Y, Z \stackrel{\text{iid}}{\sim}\mathrm{Uniform}(0,1)$.
Let $a = g(\min(y,z)),\ b=g(\max(y,z)).$
How can I calculate the expectation $$\mathbb{E}\left[\frac{1}{b-a}\int_a^b f(t) \ dt\right]$$ ...
- 161
2
votes
0
answers
32
views
constant approximation based on "sorted uniform distribution" and beta distribution [closed]
Let $X_1, X_2 \stackrel{\text{iid}}{\sim}\mathrm{Uniform}(0,1)$ and then sort $X_1,X_2$ to get $X_{(1)} < X_{(2)}$.
Based on the pdfs of $X_{(i)}$, we know $X_{(1)} \sim \mathrm{Beta}(1,2)$ and $...
- 161
0
votes
0
answers
85
views
MLE and UMVUE from an ordered sample of the exponential distribution
I am having a lot of trouble with every part of the problem below.
Now, finding MLE's is simple in principle. I just find the distribution for $Y$ and then use calculus to find the value of $\sigma$ ...
- 155
4
votes
1
answer
323
views
Exercise about Order statistics from uniform distribution
I'm trying to solve an exercise about order statistics.
The exercise is the following:
Let $U_{(1)}< \ldots <U_{(n)}$ be the order statistics from Uniform distribution U(0,1).
Show that $(-\log[...
- 43
0
votes
0
answers
55
views
Sufficient Statistic for Truncated Normal
I am doing exercise 3.18 of "The Bayesian Choice":
Give a sufficient statistic associated with a sample $x_1,...,x_n$
from a truncated normal distribution $$ f (x|\theta) \propto \exp(-(x
...
- 281
1
vote
0
answers
15
views
Hoeffding’s formula for Locally most powerful rank tests
Suppose we have a testing problem with $$H_0: X_1,X_2, . . . ,X_n \ \text{are i.i.d. random variables with a continuous cdf} \ F(x) \ \text{and pdf} \ f(x)$$ and $$H_1: X_1,X_2, . . . ,X_n \ \text{are ...
- 121
1
vote
0
answers
39
views
How should I best to use reported stats on the Tippy-top?
Suppose I have a large population, in the millions, drawn from some underlying distribution, which we will take as a member of a known distributional family with unknown parameters. Assume the ...
- 3,247
1
vote
2
answers
226
views
Can I estimate the mean of a dataset if I have its standard deviation and a portion of the full data that is higher than some threshold?
I have a partial set of measurement data that is limited due to my tool's sensitivity. I know that the data is approximately normally distributed and I have a standard deviation from another data set ...
- 21
1
vote
2
answers
556
views
Showing that $X_{(1)}$ is sufficient for shifted exponential distribution
If the pdf of a random sample is $f(x)=e^{-(x-θ)}$ where $x \geq θ$,
Show that $T=X_{(1)}$ is a sufficient statistic for $θ$.
Can one show that $T$ is a sufficient statistic for $θ$ in the following ...
- 21
4
votes
1
answer
176
views
Distribution of minimum gap of $n$ points in the unit interval
I am trying to find the expected minimum and maximum distance between consecutive points on the unit positive rea interval .I have tried the following so far :Given $n$ uniform random variables on the ...
- 447
1
vote
0
answers
41
views
Which statistical test is suitable to compare order statistics of two independent samples?
Say I want to compare two order statistics (say the 2nd largest value or min value) of two samples. Let's not make any distributional assumptions except that the variance is finite?
Is something like ...
0
votes
0
answers
171
views
How to find the MGF of the max of a set of i.i.d. exponential random variables
As the title suggests, I would like to find the MGF of the max of iid exponential random variables. Assume $Z=\max(x_{1},...,x_{n})$, where $x_{i}$ is distributed as exponential($\beta$) and has pdf $\...
0
votes
1
answer
88
views
Max of the running average of the kth through nth elements for a given probability distribution
This question is based slightly on https://www.reddit.com/r/AskStatistics/comments/16bqit0/calculating_probability_when_phacking_is_allowed/
Given a variable $X$, let $A_j$ be the average of $X_1$ ...
- 111
2
votes
1
answer
100
views
Finding Sample Range of Fisher's z-distribution via Approximating Hypergeometric $\,_2F_1\left(\frac{1}{2},\frac{x+1}{2};\frac{3}{2};-z^2\right)$
Recently, I have encountered Hypergeometric function $\,_2 F_1\left(\frac{1}{2},\frac{x+1}{2};\frac{3}{2};-z^2\right)$ in the context of order statistics.
In particular, I am trying to evaluate an ...
- 23
2
votes
1
answer
185
views
Covariance between two binomial random variables or expectation of product of binomial random variables
I have an empirical distribution $S_n(x)$ (= proportion of samples less than equal to x) from a random sample $X_1, X_2, ..., X_n$ for a random variable $X \sim F_X$. Consider the random variable $T_n(...
- 61
2
votes
1
answer
61
views
The difference of $\sum_{i=1}^{n}X_{i}$ and $\sum_{i=1}^{n}X_{(i)}$
Here is a exercise from *Mathematical Statistics. Jun Shao. Second edition. EX2.20
Let $X_1,..., X_n$ be $i.i.d.$ random variables having the exponential distribution $E(a,\theta)$, $a\in R$, and $\...
- 81
1
vote
0
answers
49
views
Order statistics for non independent variables
I have three random variables $X_1, X_2, X_3$ where $X_1$ is from distribution $F_1$.
$X_2=X_3$ are from distribution $F_2$ and they happen to be identical.
My question is what will be the order ...
- 163
1
vote
0
answers
70
views
Properties of the inverse normal cdf and permutation probabilities as models for horse racing
Let $T_i$ be the running time of horse $i$ and $T_i \sim N(\theta_i,1)$ and the $T_i$'s are independent. Then Henery (1981) showed that the probability $P(T_1<T_2<\cdots <T_n)$ can be ...
- 11
0
votes
1
answer
49
views
Most probable value for the successor (in ascending order) of a known statistical unit
Let $n$ be an integer $>1$.
Suppose a sample $(x_{k})_{k\in[[ 1;n]]}$ is taken from a known distribution on $\mathbb{R}$.
Given $x_1$ and supposing $\exists k\in[[2,n]], x_k>x_1$, what is the ...
- 1
1
vote
0
answers
68
views
Power of Uniform Order Statistics
I know that if $U$ is a uniform r.v. in $(0,1)$, then $U^a\sim Beta(1/a,1)$ with $a>0$.
On the other hand, if $U_{(1)}\leq \cdots\leq U_{(n)}$ are the uniform order statistics, then, with $U_{(0)}=...
- 111
0
votes
2
answers
151
views
Proving that if an equally smallest order statistic is exponentially distributed then the random variables are exponentially distributed
The question I'm stuck on states to prove that if $X_{(1)}$ is exponentially distributed, then so is $X_1$, where $X_1,\dots,X_n$ is a sample of i.i.d. random variables and $X_{(1)}\leq\dots\leq X_{(n)...
- 345
5
votes
1
answer
418
views
Asymptotic efficiency of IQR
I was wondering about the asymptotic efficiency of the Interquartile Range (IQR) in the Gaussian case. I have calculated it empirically using a Monte Carlo estimator, and it appears to be equal to ...
- 51
0
votes
1
answer
95
views
Asymptotic distribution of $n^r \frac{U_{(1)}}{U_{(n)}}$: figuring possible $r>0$
Consider the i.i.d. sample $U_1, U_2 \cdots, U_n$ from the uniform distribution $U(0, 1)$. I should find a possible values of $r>0$ to have an asymptotic distribution of
$$ n^r \frac{U_{(1)}}{U_{(n)...
- 123
0
votes
0
answers
42
views
Is modeling the extreme value of a distribution a basic probability result?
I was reading briefly about the field of EVT - extreme value theory, and the associated distributions that arise from modeling the maximum of a finite sample. It's not quite clear to me the nature of ...
- 64.8k
1
vote
0
answers
132
views
Is my logic about comparing the 70th/90th percentile from two respective datasets correct or is there a proof to do this?
Larry and Tony work for different companies. Larry's salary is the $90th$ percentile of the salaries in his company, and Tony`s salary is the $70th$ percentile of the salaries in his company.
Which ...
user263327
10
votes
4
answers
387
views
Why is median not a sufficient statistic? [duplicate]
Suppose a random sample of $n$ variables from $N(\mu,1)$, $n$ odd. The sample median is $M=X_{(n+1)/2}$, the order statistic of the middle of the distribution.
How to prove that sample median is not a ...
- 101
1
vote
0
answers
77
views
Order Statistics - Percentile Range of Normal Mixture of Normals
Say I have draw N values from a normal distribution [$\mu_1$, $\sigma_1$]. Below are 10 sampled points compared to the normal distribution they're sampled from
I then create a normal mixture of ...
- 11
4
votes
1
answer
523
views
How to compute the correlation between the min and max of two random variables?
A joint bivariate function (PDF) with variables $A,B$ is given in the function:
$f_{A,B}(a,b) = Cab(a+b), \quad 0<a<1, \quad 0<b<1.$
where $C$ is just a constant. Assume that $Q=\min(A,B)$...
- 167
0
votes
1
answer
164
views
Correlation Between Min and Max of Two Different Uniform Distribution
$\textbf{This is a self-study problem that I am interested in knowing the correct answer.}$ $\textbf{However I do not trust my computations and I need help.}$
$Y$ is Uniform(0, 2); $Z$ is Uniform(1, 3)...
- 167
1
vote
1
answer
47
views
Non-IID Uniform Distribution
$A$ is uniform (0, 2) and $B$ is uniform(1, 3). Find the Cov$(W, Z)$, where $W=\min(A,B)$ and $Z=\max(A,B).$
Since $WX = AB,$ then by independence of $A$ and $B$, $E(WZ) = E(A)E(B),$ so that
$$Cov(WZ)...
- 33
1
vote
0
answers
89
views
Permutation and order statistic
Let $X_1,…,X_n$ be i.i.d. random variables. Are these two equalities correct?
$P[X_{(2)}<x_2,…,X_{(n)}<x_n| X_{(1)}=x_1]=\\
=n!P[X_{2}<x_2,…,X_{n}<x_n| X_{1}=x_1]=\\
=n! P[X_{2}<x_2]…P[...
- 211
1
vote
1
answer
54
views
Equality between order statistics and certain generalized means?
Question
Suppose I have a random variable $X$ with CDF, $F(x)$, and I want to model an IID sample $\{X_1, \cdots, X_n \}$ of size $n$.
For any order statistic $X_{(k)}$ for this sample where $1 \leq k ...
- 9,680
2
votes
1
answer
178
views
CDF of max of $n$ cauchy variates
Suppose $X_1,X_2,\cdots,X_n$ are iid copies of a standard cauchy variate with pdf
$$ f(x)=\frac{1}{\pi(1+x^2)},0<x< \infty. $$
Define:
$$ Y=1+ \underset{1 \leq i \leq n}\max X_i.$$ I want to ...
- 447
3
votes
2
answers
68
views
What is the reasoning behind the string of equality $P(x_{(n)} \le t) = P(X_i \le t, \ \text{for each $i$}) = \{\Phi(t - \theta)\}^n$? [duplicate]
I am currently studying the textbook In All Likelihood by Yudi Pawitan. Example 2.4 of chapter 2.2 Examples says the following:
Example 2.4: Suppose $x$ is a sample from $N(\theta, 1)$; the ...
- 2,204
2
votes
2
answers
62
views
Statistical notation question: How do I represent sorting variables, individually and by each other, symbolically?
I'd like to write a formula for a correlation coefficient that involves sorting continuous observations, both within a variable and by another variable. For example, I'd like to say that $r$ is ...
- 642
5
votes
1
answer
44
views
How should I estimate the variance in a sample or population from the sample range?
Suppose I wish to know the variance within a sample or of the population from which it is drawn. However, I do not have true measurements for most of my "observations". Think of them as like ...
- 3,247
1
vote
0
answers
74
views
A question about order statistics
Let $X_1,\dots,X_n\overset{iid}{\sim}F_X$ be random variables. Let $b\in(0,\infty)$, and consider the transformation:
$$
Y_i=bF_X(X_i)\\
i=1,\dots,n
$$
How do I calculate the order statistic $Y_{(n)}?$...
2
votes
1
answer
139
views
Making sense of this section on likelihood of order statistics
I am currently studying the textbook In All Likelihood by Yudi Pawitan. In chapter 2 Elements of likelihood inference, the author presents the following example:
Example 2.4: Suppose $x$ is a sample ...
- 2,204
1
vote
1
answer
502
views
Roll 4 Dice, What's the Expected Value of the Sum of the highest 3?
After writing a simulation in python (code at bottom) I realized my calculations are incorrect but can't figure out where I went wrong.
Let {$D_1$, $D_2$, $D_3$, $D_4$} be the ordered dice rolls. Let $...
12
votes
1
answer
27k
views
Why does R say 'cannot compute exact p-values with ties' when I can do it with pen and paper?
Suppose I have two sets of three numbers: $x_1, x_2, x_3$ and $y_1, y_2, y_3$ and I want to test the Null hypothesis that they are drawn from the same distribution using the Wilcoxon-Mann-Whitney test....
- 892