What Is the Sum of Independent Chi-Squared Distributions?
At a glance
- 1. Check independence
Confirm that the chi-squared random variables are mutually independent; the simple addition rule depends on this assumption.
- 2. Add degrees of freedom
For independent variables, add their degrees of freedom to get the distribution of their sum.
- 3. State the result
The sum has a chi-squared distribution with the total degrees of freedom.
- 4. Check variations
Dependence, unequal scale factors, or other modifications can change the result.
If you add independent chi-squared random variables, the result is another chi-squared random variable. Its degrees of freedom are the sum of the degrees of freedom of the terms. The key condition is independence: knowing only that each variable has a chi-squared distribution is not enough to guarantee the rule.
The addition rule
Let be mutually independent, with
where is the degrees of freedom for . Then
For two variables, this says that if and independently, then . The degrees of freedom add; they are not averaged or multiplied.
Why the rule works
A chi-squared distribution with degrees of freedom is a gamma distribution with shape and scale . Its moment-generating function is
For independent random variables, the moment-generating function of a sum is the product of their moment-generating functions. Therefore,
This is the moment-generating function of a chi-squared distribution with degrees of freedom, which gives the result.
There is also a direct interpretation. A chi-squared variable with integer degrees of freedom can be written as the sum of squares of independent standard normal variables. If independent chi-squared variables are added, all those squared normal terms are pooled together, so their count—and thus the degrees of freedom—adds.
Worked example
Suppose and , and suppose and are independent. Then
You can check the result using the mean and variance. A chi-squared variable with degrees of freedom has mean and variance . Thus, for the sum,
and, because of independence,
Those are the mean and variance of . The distributional result is stronger than matching these two moments, but the check is useful for catching arithmetic mistakes.
When the rule does not apply
The variables are dependent. Without independence, the moment-generating function of the sum generally cannot be found by multiplying the individual moment-generating functions. The sum may still be chi-squared in a particular model, but you cannot conclude that just from the separate marginal distributions.
For example, if and you define , then both variables have the same chi-squared distribution, but . This is a scaled chi-squared variable, not generally .
The terms have different scale factors. A sum such as does not generally follow the simple addition rule when the constants differ. The standard rule applies to an unscaled sum. If every term has the same positive multiplier , the result is , which is scaled chi-squared, not an ordinary chi-squared distribution unless .
The variables are noncentral chi-squared. For independent noncentral chi-squared variables with degrees of freedom and noncentrality parameters , their sum is noncentral chi-squared with degrees of freedom and noncentrality parameter . This is a related addition rule, but the result is not the ordinary central chi-squared distribution unless the total noncentrality is zero.
Common mistakes
- Adding degrees of freedom without checking independence. Independence is the condition that supports the usual result.
- Confusing a sum with a difference. The addition rule does not say that differences of chi-squared variables are chi-squared.
- Ignoring coefficients. A weighted sum such as is not covered by the unweighted addition rule.
- Treating a matching mean and variance as proof. They are useful checks, but identifying a distribution requires a valid distributional argument, such as the moment-generating-function calculation above.
When the variables are independent and unscaled, add their degrees of freedom. If the setup includes dependence, weights, or noncentrality, identify that structure before choosing a distribution for the sum.
References
- Mathematical Statistics and Data Analysis, 3rd Edition — John A. Rice
- Statistical Inference, 2nd Edition — George Casella and Roger L. Berger
Spotted an error? Send a correction. Read how we write and check articles in our editorial policy.