1. Moments
Moments are measures that describe the shape and spread of a distribution relative to its mean.
They are the expected values of powers of deviations from a central value.
Types of Moments
- Raw Moments (about the origin)
μr′=N∑xr
- r = order of the moment (1, 2, 3…)
- N = number of observations
- Central Moments (about the mean)
μr=N∑(x−xˉ)r
- r = order
- μ1=0 (by definition)
- μ2=Variance
- μ3 and μ4 are used for skewness and kurtosis
2. Skewness
Skewness measures the asymmetry of a probability distribution around its mean.
- Symmetrical distribution → Skewness = 0
- Positive skew (Right-skewed) → Tail on right side, Skewness > 0
- Negative skew (Left-skewed) → Tail on left side, Skewness < 0
Formula (using central moments)
Skewness=μ23/2μ3
- μ3 = third central moment
- μ2 = variance
Interpretation
| Skewness |
Shape |
| 0 |
Symmetrical |
| >0 |
Positive (Right-skewed) |
| <0 |
Negative (Left-skewed) |
Example: Income distributions are usually positively skewed (few high incomes).
3. Kurtosis
Kurtosis measures the peakedness or flatness of a distribution compared to the normal distribution.
- High kurtosis (Leptokurtic) → Sharp peak, heavy tails
- Low kurtosis (Platykurtic) → Flat peak, light tails
- Normal distribution (Mesokurtic) → Kurtosis ≈ 3
Formula (using central moments)
Kurtosis=μ22μ4
- μ4 = fourth central moment
- μ2 = variance
Interpretation
| Type |
Shape |
| Leptokurtic |
Peaked, heavy tails |
| Mesokurtic |
Normal, moderate tails |
| Platykurtic |
Flat, light tails |
Summary Table
| Measure |
What it Measures |
Formula (Central Moments) |
Notes |
| Moment (r-th) |
Shape/Spread |
μr=N∑(x−xˉ)r |
r=1: 0, r=2: Variance |
| Skewness |
Asymmetry |
μ23/2μ3 |
>0: right, <0: left |
| Kurtosis |
Peakedness |
μ22μ4 |
>3: leptokurtic, <3: platykurtic |
Key Points to Remember
- Central moments are preferred over raw moments for shape analysis.
- Skewness tells direction of asymmetry.
- Kurtosis tells height/flatness of the distribution peak.
- Both skewness and kurtosis are dimensionless (unit-free).