Continuous Probability Distributions

Continuous Probability Distributions

A continuous probability distribution describes the probability of a continuous random variable, which can take an infinite number of values within a certain range. Unlike discrete random variables, which take specific, countable values, continuous random variables can take any value within an interval (which could be finite or infinite). Examples of continuous random variables include measurements like height, weight, time, or temperature.

A continuous probability distribution is described by a probability density function (PDF), rather than a probability mass function (PMF), which is used for discrete random variables. The PDF provides the likelihood of the random variable taking a particular value in an infinitesimally small interval.

Key Properties of Continuous Probability Distributions

1. Probability Density Function (PDF):

   • A continuous random variable $X$ is associated with a probability density function $f(x)$, which describes the relative likelihood that $X$ takes on the value $x$. The probability that $X$ lies in the interval $[a, b]$ is given by the integral of the PDF over that interval:
   $$P(a \leq X \leq b) = \int_a^b f(x) \, dx$$
   • The PDF itself is non-negative, and the total area under the curve of the PDF over the entire range of possible values is equal to 1:
   $$\int_{-\infty}^{\infty} f(x) \, dx = 1$$

2. Probability for a Specific Value:

   • For a continuous random variable, the probability that the variable takes any specific value $x$ is always zero. That is:
   $$P(X = x) = 0$$
   • This is because the probability is measured over intervals, and the probability of a point (in a continuous range) is infinitesimally small.

3. Cumulative Distribution Function (CDF):

   • The cumulative distribution function $F(x)$ is the probability that the random variable $X$ is less than or equal to $x$. It is defined as:
   $$F(x) = P(X \leq x) = \int_{-\infty}^x f(t) \, dt$$
   • The CDF is non-decreasing and ranges from 0 to 1 as $x$ moves from negative infinity to positive infinity.

Common Continuous Probability Distributions

There are several important continuous probability distributions, each suited to different types of random phenomena. Some of the most widely used continuous distributions include the Normal distribution, Exponential distribution, Uniform distribution, and Beta distribution.

1. Normal Distribution (Gaussian Distribution)

The normal distribution is one of the most important and widely used continuous distributions in statistics. It is characterized by a bell-shaped curve, which is symmetric about its mean $\mu$.

• PDF of a normal distribution with mean $\mu$ and standard deviation $\sigma$:

  $$f(x) = \frac{1}{\sigma \sqrt{2 \pi}} e^{-\frac{(x - \mu)^2}{2 \sigma^2}}$$

• Key Properties:

  • The mean $\mu$ and standard deviation $\sigma$ completely define the distribution.
  • The total area under the curve is 1, and approximately 68% of the data lies within one standard deviation from the mean, 95% within two standard deviations, and 99.7% within three standard deviations.

• Applications:

  • The normal distribution is commonly used in natural and social sciences to model measurements like height, weight, test scores, and errors in measurement.

Example: The heights of adult men in a population are approximately normally distributed with a mean of 70 inches and a standard deviation of 3 inches. The probability that a randomly selected man is between 67 and 73 inches tall is the area under the normal curve between these two values.

2. Exponential Distribution

The exponential distribution is used to model the time between events in a process that occurs at a constant rate, such as the time between arrivals of customers at a service station.

• PDF of an exponential distribution with rate parameter $\lambda$ (where $\lambda = 1/\mu$, the mean of the distribution):

  $$f(x) = \lambda e^{-\lambda x} \quad \text{for} \quad x \geq 0$$

• Key Properties:

  • The mean of the exponential distribution is $\mu = \frac{1}{\lambda}$.
  • The exponential distribution has the memoryless property, meaning the probability of an event occurring in the future is independent of how much time has already passed.

• Applications:

  • Commonly used to model the time between events in queuing systems, reliability of mechanical systems, or the time until a radioactive particle decays.

Example: The time between arrivals of buses at a station follows an exponential distribution with a mean of 10 minutes. The probability that a bus arrives in the next 5 minutes is the area under the exponential curve between 0 and 5.

3. Uniform Distribution

The uniform distribution is a simple continuous distribution where all outcomes are equally likely within a specified range. It is used to model situations where each value in an interval is equally probable.

• PDF of a uniform distribution between $a$ and $b$:

  $$f(x) = \frac{1}{b - a} \quad \text{for} \quad a \leq x \leq b$$
  • The mean of the uniform distribution is $\mu = \frac{a + b}{2}$, and the variance is $\sigma^2 = \frac{(b - a)^2}{12}$.

• Key Properties:

  • The distribution is constant between $a$ and $b$.
  • The probability that $X$ lies in an interval is proportional to the length of that interval.

• Applications:

  • Often used in simulations where each outcome in a range should have equal likelihood, such as random number generation.

Example: A die with outcomes ranging from 1 to 6 is modeled by a discrete uniform distribution. If we have a continuous uniform distribution over the interval [0, 1], then any value between 0 and 1 is equally likely.

4. Beta Distribution

The beta distribution is defined on the interval [0, 1] and is often used to model probabilities, proportions, or rates. It has two shape parameters, $\alpha$ and $\beta$, which control the shape of the distribution.

• PDF of a beta distribution:

  $$f(x; \alpha, \beta) = \frac{x^{\alpha - 1} (1 - x)^{\beta - 1}}{B(\alpha, \beta)} \quad \text{for} \quad 0 \leq x \leq 1$$

  Where $B(\alpha, \beta)$ is the beta function, which normalizes the distribution.

• Key Properties:

  • The mean of the beta distribution is $\mu = \frac{\alpha}{\alpha + \beta}$.
  • The variance is $\sigma^2 = \frac{\alpha \beta}{(\alpha + \beta)^2 (\alpha + \beta + 1)}$.

• Applications:

  • The beta distribution is commonly used in Bayesian statistics, modeling of proportions, or any scenario where values are confined to the interval [0, 1].

Example: A quality control process is modeled using a beta distribution to estimate the proportion of defective products in a production line. The parameters $\alpha$ and $\beta$ would be estimated based on past data.

Expectation and Variance of Continuous Distributions

For any continuous random variable $X$ with a probability density function $f(x)$, the expectation (mean) and variance are calculated as follows:

1. Expectation (Mean):

   $$E[X] = \int_{-\infty}^{\infty} x f(x) \, dx$$

2. Variance:

   $$\text{Var}(X) = E[(X - \mu)^2] = \int_{-\infty}^{\infty} (x - \mu)^2 f(x) \, dx$$

   Where $\mu = E[X]$ is the mean.

Summary

• Continuous probability distributions describe the probability of a continuous random variable taking any value in a range of values.
• The probability is represented by a probability density function (PDF), and the total area under the curve of the PDF is equal to 1.
• Common continuous distributions include:
  • Normal distribution: Bell-shaped curve, used in many natural phenomena.
  • Exponential distribution: Models the time between events in a Poisson process.
  • Uniform distribution: All outcomes are equally likely within an interval.
  • Beta distribution: Models probabilities and proportions, defined on the interval [0, 1].

Continuous distributions are useful in modeling real-world phenomena that are measured on continuous scales, such as time, height, and temperature.