Probability of an Event

Probability of an Event

Probability is a measure of the likelihood or chance that a specific event will occur. It quantifies uncertainty and is an essential concept in statistics and many fields such as science, economics, and engineering. The probability of an event provides a way to assess the likelihood of outcomes in uncertain situations.

1. Basic Definition

The probability of an event is defined as the ratio of the number of favorable outcomes to the total number of possible outcomes in a sample space, assuming all outcomes are equally likely.

Mathematically, the probability $P(A)$ of an event $A$ is:

$$P(A) = \frac{\text{Number of favorable outcomes for event } A}{\text{Total number of possible outcomes in the sample space}}$$

Where:

• $P(A)$ is the probability of event $A$,
• The sample space is the set of all possible outcomes in the experiment.

The probability value always lies between 0 and 1, inclusive:

$$0 \leq P(A) \leq 1$$

• A probability of 0 means the event is impossible (it will never happen).
• A probability of 1 means the event is certain (it will definitely happen).
• A probability of 0.5 means there is an equal chance for the event to occur or not occur.

---

2. Sample Space

The sample space (denoted as $S$) is the set of all possible outcomes of an experiment. For example:

• If you roll a fair six-sided die, the sample space $S$ is $S = \{1, 2, 3, 4, 5, 6\}$.
• If you flip a fair coin, the sample space $S$ is $S = \{\text{Heads}, \text{Tails}\}$.

The probability of any event depends on the sample space, as the event is evaluated within the context of all possible outcomes.

---

3. Types of Events

• Simple Event: An event that consists of a single outcome. For example, in rolling a six-sided die, the event of rolling a "3" is a simple event.

• Compound Event: An event that consists of two or more outcomes. For example, the event of rolling an even number on a die (which includes 2, 4, and 6) is a compound event.

• Certain Event: An event that is guaranteed to happen. For example, in any die roll, the outcome will be a number between 1 and 6, so the event of rolling a number between 1 and 6 is certain.

• Impossible Event: An event that cannot happen. For example, rolling a 7 on a fair six-sided die is an impossible event.

---

4. Classical Probability (Theoretical Probability)

In situations where all outcomes in the sample space are equally likely, the classical probability formula is used. If there are $n$ total outcomes in the sample space and $m$ outcomes that favor event $A$, then the probability of event $A$ is:

$$P(A) = \frac{m}{n}$$

For example, when rolling a fair die:

• The sample space $S = \{1, 2, 3, 4, 5, 6\}$, so $n = 6$.
• The event of rolling an even number is $A = \{2, 4, 6\}$, so $m = 3$.
• The probability of rolling an even number is:

$$P(A) = \frac{3}{6} = 0.5$$

---

5. Empirical (Experimental) Probability

Empirical probability is based on observations or experiments. It is calculated by performing an experiment multiple times and recording the frequency of the event occurring.

The formula for empirical probability is:

$$P(A) = \frac{\text{Number of times event } A \text{ occurs}}{\text{Total number of trials}}$$

For example, if you flip a coin 100 times and get heads 48 times, the empirical probability of getting heads is:

$$P(\text{Heads}) = \frac{48}{100} = 0.48$$

---

6. Axioms of Probability

The probability of an event is governed by certain rules, known as axioms of probability, which are as follows:

1. Non-negativity: The probability of any event is non-negative.

   $$P(A) \geq 0 \quad \text{for any event } A$$

2. Normalization: The probability of the entire sample space is 1.

   $$P(S) = 1$$

   This means the sum of the probabilities of all possible outcomes in the sample space is 1.

3. Additivity: For any two mutually exclusive events $A$ and $B$ (events that cannot both occur at the same time), the probability of either event occurring is the sum of their individual probabilities:

   $$P(A \cup B) = P(A) + P(B) \quad \text{if } A \cap B = \emptyset$$

---

7. Complementary Events

For any event $A$, the complement of $A$ (denoted $A^c$) is the event that $A$ does not occur. The probability of the complement of $A$ is:

$$P(A^c) = 1 - P(A)$$

This is because the total probability for all possible outcomes must be 1. If $A$ occurs with probability $P(A)$, then $A^c$ (the event that $A$ does not occur) must occur with probability $1 - P(A)$.

For example, if the probability of it raining tomorrow is $P(\text{Rain}) = 0.8$, then the probability of it not raining is:

$$P(\text{No Rain}) = 1 - P(\text{Rain}) = 1 - 0.8 = 0.2$$

---

8. Conditional Probability

Conditional probability refers to the probability of an event occurring given that another event has already occurred. The conditional probability of event $A$ given event $B$ is denoted as $P(A \mid B)$, and it is calculated using the formula:

$$P(A \mid B) = \frac{P(A \cap B)}{P(B)} \quad \text{if } P(B) > 0$$

Where:

• $P(A \mid B)$ is the probability of event $A$ occurring given that event $B$ has occurred,
• $P(A \cap B)$ is the probability of both events $A$ and $B$ occurring,
• $P(B)$ is the probability of event $B$ occurring.

---

9. Law of Total Probability

The Law of Total Probability helps to compute the probability of an event by considering all possible conditions or partitions of the sample space. If the sample space is partitioned into events $B_1, B_2, \dots, B_n$, then the probability of event $A$ can be written as:

$$P(A) = \sum_{i=1}^{n} P(A \mid B_i) P(B_i)$$

This law is useful when dealing with complex situations where event $A$ is conditioned on several different scenarios.

---

10. The Addition Rule

The addition rule helps to calculate the probability of the union of two events. If $A$ and $B$ are two events, then:

$$P(A \cup B) = P(A) + P(B) - P(A \cap B)$$

Where:

• $P(A \cup B)$ is the probability that at least one of the events $A$ or $B$ occurs,
• $P(A \cap B)$ is the probability that both events $A$ and $B$ occur.

---

Summary

• Probability quantifies the likelihood of an event occurring, ranging from 0 (impossible) to 1 (certain).
• The probability of an event can be computed using classical methods (when all outcomes are equally likely), empirical methods (based on observed data), or conditional probability.
• Key concepts in probability include complementary events, conditional probability, the addition rule, and the Law of Total Probability.
• Probability theory is foundational to many statistical and real-world applications, helping to model uncertainty and make informed decisions.