How Does a Poisson Distribution Converge to Normal?
At a glance
- 1. Let the mean grow
Consider Poisson random variables whose parameter λ increases without bound.
- 2. Standardize the count
Subtract λ and divide by the standard deviation, √λ.
- 3. Apply the limit
The standardized variable converges in distribution to a standard normal variable.
- 4. Approximate probabilities
Use the normal CDF, with a continuity correction for integer-valued counts.
Try it: Normal probability calculator
A Poisson random variable takes nonnegative integer values, while a normal random variable is continuous. Even so, a Poisson distribution becomes increasingly bell-shaped as its mean grows. The precise convergence statement concerns a standardized Poisson variable: subtract its mean and divide by its standard deviation.
This result is useful for estimating Poisson probabilities when the mean is large. It also explains why the normal approximation has mean λ and variance λ, and why a continuity correction is used when approximating probabilities for integer counts.
The convergence statement
Let . Its mean and variance are both λ, so its standard deviation is . Then, as ,
The arrow means convergence in distribution. Equivalently, for every real number ,
where is the cumulative distribution function of the standard normal distribution.
In unstandardized terms, this says that for large λ, is approximately normal with mean λ and variance λ:
The parameter λ need not be an integer. The limit holds as the Poisson mean increases through positive real values.
Why the normal limit appears
The moment-generating function of a Poisson variable is . For the standardized variable , its moment-generating function is
To see the limit, expand : after the linear term cancels, the exponent begins with , while the next term is and vanishes as λ grows. The limiting function is the moment-generating function of , which gives the stated convergence.
There is also an intuitive connection to the central limit theorem. When λ is an integer, a Poisson variable can be written as the sum of λ independent Poisson variables. A sum of many independent contributions, when centered and scaled, is the setting of the central limit theorem. The moment-generating-function argument also covers noninteger λ.
Approximating a Poisson probability
For a large mean, approximate by a normal variable with the same mean and variance. Since the Poisson variable is discrete and the normal variable is continuous, shift integer cutoffs by half a unit. For example,
For an interval , approximate it using the normal interval from to .
Worked example: a Poisson mean of 100
Suppose and you want to estimate . The normal approximation is , with standard deviation 10. Apply the continuity correction and standardize:
So the normal approximation estimates the probability at about 0.853. Without the continuity correction, the calculation would use and give about 0.8413. The correction matters because it accounts for the full width of the integer count at the boundary.
When the approximation is useful
The approximation improves as λ increases, because the Poisson distribution becomes less skewed. Its skewness is , which tends to zero. There is no single cutoff that guarantees adequate accuracy for every problem: a rough approximation may be acceptable at a smaller mean, but a tail probability or a high-precision answer may require a larger mean or an exact Poisson calculation.
The approximation is often reasonable for probabilities near the center of the distribution once the mean is moderately large. Be more cautious in extreme tails, where small differences in the shape can have a noticeable effect on the probability being estimated.
Common mistakes
- Leaving the variable unstandardized in the limit statement. The variable that converges to is , not itself. The unstandardized approximation is , whose mean and variance change with λ.
- Using as the variance. It is the standard deviation; the variance is λ.
- Forgetting the continuity correction. A Poisson probability is a sum over integer values, so half-unit adjustments generally give a better normal approximation to count probabilities.
- Treating the approximation as exact. For a small mean or a probability far into a tail, calculate the Poisson probability directly when possible.
- Assuming a fixed Poisson distribution converges just because sample size grows. The normal limit here requires the Poisson mean itself to grow. A fixed describes one fixed distribution.
References
- An Introduction to Probability Theory and Its Applications, Volume I — William Feller
- Probability: Theory and Examples — Rick Durrett
Spotted an error? Send a correction. Read how we write and check articles in our editorial policy.