What Are the Properties of the Maximum and Minimum of Exponential Random Variables?
At a glance
- 1. State the assumptions
Assume the variables are independent and use the rate parameterization, where an exponential variable with rate λ has mean 1/λ.
- 2. Find the minimum
Multiply the survival probabilities: the minimum is exponential with rate equal to the sum of the individual rates.
- 3. Find the maximum distribution
Use the probability that every variable is at most t; for independent variables, multiply their cumulative distribution functions.
- 4. Compute moments
For identically distributed variables, use the independent spacings between ordered observations to find the maximum's mean and variance.
Let be independent exponential random variables. This assumption matters: knowing only their individual exponential distributions does not determine the distribution of their minimum or maximum if they may be dependent.
We use the rate parameterization: means has density for , and mean . Some texts use a scale parameter instead; the scale is the reciprocal of the rate.
The minimum is exponential
Define . For , the minimum exceeds exactly when every variable exceeds . Independence gives
Thus is exponential with rate . In particular,
A related result is that the probability that is the smallest is . For independent continuous variables, ties have probability zero. A variable with a larger rate is more likely to be the first to occur, because a larger rate means a smaller average waiting time.
The maximum’s distribution
Define . The maximum is at most precisely when all variables are at most , so for ,
For , this CDF is zero. Differentiating the product gives its density for :
Unlike the minimum, the maximum is generally not exponential. For example, if all rates are equal to , its CDF is , which is not the CDF of an exponential variable when .
For possibly unequal rates, its expectation can also be written using inclusion–exclusion:
This follows by integrating from zero to infinity.
Identically distributed variables: mean and variance
When are independent and all have rate , the ordered values are . Their successive spacings are independent exponentials: the spacing from to has rate , taking . The maximum is the sum of all these spacings. Therefore,
where and . The variance formula uses the independence of the spacings and the fact that an exponential variable with rate has variance .
Worked example: three variables with rate 2
Suppose are independent with . Then the minimum has rate , so
The maximum has CDF for , and its density is . Since and ,
The minimum is much shorter on average than any one variable, while the maximum is longer; neither result says the maximum itself is exponential.
Common mistakes
- Confusing rate and scale. With rate , the mean is . If a problem gives the mean as a parameter, convert it to a rate before using these formulas.
- Assuming the maximum is exponential. The product formula gives its CDF; for , that CDF is not exponential.
- Forgetting independence. Multiplying survival probabilities or CDFs requires independence. Without it, the joint distribution is needed.
- Using the equal-rate moment formulas for unequal rates. The harmonic-sum expressions apply when every variable has the same rate. Use the general CDF or inclusion–exclusion expression when rates differ.
References
- A First Course in Probability, Sheldon Ross
Spotted an error? Send a correction. Read how we write and check articles in our editorial policy.