Why Does Sampling Density Scale as n^(1/p)?
At a glance
- 1. Set the dimension
Let n be the number of samples and p the number of dimensions in a fixed region.
- 2. Count per direction
For roughly even coverage, divide the samples among p dimensions: about n^(1/p) positions per direction.
- 3. Invert for spacing
The typical distance between neighboring samples scales as n^(-1/p).
- 4. Check the meaning
This is linear density or resolution per dimension, not the probability density function of the sampled data.
The phrase sampling density proportional to n^(1/p) usually refers to how finely n samples cover a region with p dimensions. If the samples are spread roughly evenly, there are about n^(1/p) sample positions along each coordinate direction. The typical gap between neighboring positions therefore scales as n^(-1/p).
The word density can also mean the number of sample points per unit area or volume, or it can mean a probability density function. Those are different quantities. The distinction matters when interpreting the formula.
Why the exponent is 1/p
Imagine dividing a unit-length interval into m equal pieces. In p dimensions, dividing every coordinate direction into m pieces produces approximately m^p small cells. If you want one sample per cell, the total number of samples is
Solving for the number of positions along one direction gives
The spacing between positions is the reciprocal of that number:
This is the basic reason for the exponent: the sample count grows across all p dimensions at once. In three dimensions, for instance, doubling the number of positions along each axis multiplies the total number of grid cells by .
The relation is a scaling rule, not an exact formula for every sampling design. Constants depend on the region’s size and shape, boundary effects, and how the points are arranged. For a region with volume , a characteristic spacing is on the order of .
Worked example: 1,000 samples in three dimensions
Suppose you want to cover the unit cube with samples, using a regular grid. There are dimensions, so the number of positions along each axis is
A grid with 10 positions along each of three axes has positions. The spacing is about unit in each direction. Thus the per-direction sampling density is 10 positions per unit length, while the point count per unit volume is 1,000 points per unit volume.
If you instead use 1,000 independent uniform random points, they will not form a perfect grid. Their typical nearest-neighbor distance still has the same order of magnitude, , though the exact distance varies from point to point and includes geometric constants.
What happens in higher dimensions?
For the same sample count, the number of positions per direction falls as the dimension rises. With 1,000 samples in four dimensions, positions per coordinate direction as a rough scale, rather than 10. You cannot have 5.62 actual grid positions; the value indicates the resolution scale. A complete equal grid would require an integer number of positions in each direction, so its total count would be a perfect p-th power.
This rapid loss of coverage is one aspect of the curse of dimensionality. To halve the spacing in every direction, you need roughly times as many samples. That is 8 times as many in three dimensions, but 1,024 times as many in ten dimensions.
Random sampling and local density
For independent samples from a probability density function , the function describes where samples are more likely to occur; it does not itself grow as . With draws, the expected number of observations near a location does grow with . In a small region of volume where is nearly constant, the expected count is approximately .
A small ball of radius in p dimensions has volume proportional to . The expected number of samples in that ball is therefore roughly , up to the volume constant for a p-dimensional ball. Setting this count to about one gives the local nearest-sample distance scale
Where the sampling distribution is denser, nearby samples tend to be closer together. For uniform sampling in a fixed region, this reduces to the general spacing rule, with the region’s volume contributing a constant factor.
Common mistakes
- Calling the volume density: In a fixed unit-volume region, the number of points per unit volume is . The value is a per-direction count or linear resolution.
- Confusing density with spacing: More samples mean larger per-direction density, scaling as , but smaller gaps, scaling as .
- Treating the rule as exact for random points: Random samples are unevenly spaced. The power gives a typical scale, not a guarantee that every gap has that length.
- Ignoring dimension: The exponent depends on the dimension of the region being covered. Adding a dimension changes the rate at which sample count improves spatial resolution.
References
- A Probabilistic Theory of Pattern Recognition, Luc Devroye, László Györfi, and Gábor Lugosi
Spotted an error? Send a correction. Read how we write and check articles in our editorial policy.