I. Experiment, Sample Space, Events
Probability is a measure that is associated with how certain we are of outcomes of a particular experiment or activity.
An experiment is a planned operation or procedure that can be infinitely repeated and has a well defined set of possible outcomes. If the result is not predetermined, then the experiment is said to be a random experiment. An outcome is the specific result of a single execution of the experiment model.
The sample space of an experiment is the set of all possible outcomes. Four ways to represent a sample space are: to list the possible outcomes, to create a tree diagram, a sample space diagram or to create a Venn diagram. The uppercase letter S is used to denote the sample space. For example, if you flip one fair coin, S = {H, T} where H = heads and T = tails are the outcomes.
An event is any combination of outcomes. Upper case letters like A and B represent events. For example, if the experiment is to flip one fair coin, event A might be getting at most one head. The probability of an event A is written P(A).
The probability of any outcome is the long-term relative frequency of that outcome. Probabilities are between zero and one, inclusive (that is, zero and one and all numbers between these values). P(A) = 0 means the event A can never happen. P(A) = 1 means the event A always happens. P(A) = 0.5 means the event A is equally likely to occur or not to occur. For example, if you flip one fair coin repeatedly (from 20 to 2,000 to 20,000 times) the relative frequency of heads approaches 0.5 (the probability of heads).
Equally likely means that each outcome of an experiment occurs with equal probability. For example, if you toss a fair, six-sided die, each face (1, 2, 3, 4, 5, or 6) is as likely to occur as any other face. If you toss a fair coin, a Head (H) and a Tail (T) are equally likely to occur. If you randomly guess the answer to a true/false question on an exam, you are equally likely to select a correct answer or an incorrect answer.
Calculating Probability with Equally Likely Outcomes
To calculate the probability of an event A when all outcomes in the sample space are equally likely, count the number of outcomes for event A and divide by the total number of outcomes in the sample space.
For example, if you toss a fair dime and a fair nickel, the sample space is {HH, TH, HT, TT} where T = tails and H = heads. The sample space has four outcomes. Event A = getting one head. There are two outcomes that meet this condition {HT, TH}, so P(A) = 2/4 = 0.5.
Suppose you roll one fair six-sided die, with the numbers {1, 2, 3, 4, 5, 6} on its faces. Let event E = rolling a number that is at least five. There are two outcomes {5, 6}. P(E) = 2/6 as the number of repetitions grows larger and larger.
This important characteristic of probability experiments is known as the law of large numbers which states that as the number of repetitions of an experiment is increased, the relative frequency obtained in the experiment tends to become closer and closer to the theoretical probability. Even though the outcomes do not happen according to any set pattern or order, overall, the long-term observed relative frequency will approach the theoretical probability. (The word empirical is often used instead of the word observed.)
“OR” Event/UnionAn outcome is in the event A OR B if the outcome is in A or is in B or is in both A and B. For example, let A = {1, 2, 3, 4, 5} and B = {4, 5, 6, 7, 8}. A OR B = {1, 2, 3, 4, 5, 6, 7, 8}. Notice that 4 and 5 are NOT listed twice. The set notation ∪ for union can also be used. So
“A or B” and “A ∪ B” mean the same thing.
"AND" Event/Intersection
An outcome is in the event A AND B if the outcome is in both A and B at the same time. For example, let A and B be {1, 2, 3, 4, 5} and {4, 5, 6, 7, 8}, respectively. Then A AND B = {4, 5}. The set notation ∩ for intersection can also be used. So "A and B" and "A∩B" mean the same thing.
ComplementThe complement of event
A is denoted
A' (read "
A prime").
A' consists of all outcomes that are
NOT in
A. Notice that
P(A) +
P(A') =
1.
For example, let S = {1, 2, 3, 4, 5, 6} and let A = {1, 2, 3, 4}. Then, A' = {5, 6}. P(A) =4/6 and P(A') = 2/6, and P(A) + P(A') = 4/6 + 2/6 = 1.
Conditional Probability
The conditional probability of A given B is written P(A|B).
P(A|B) is the probability that event A will occur given that the event B has already occurred. A conditional reduces the sample space. We calculate the probability of A from the reduced sample space B.
The formula to calculate P(A|B) is:
P(A|B) = P(A and B) / P(B)
where P(B) is greater than zero.
Notes:
Random experiments are often conducted repeatedly, so that the collective results may be subjected to statistical analysis. A fixed number of repetitions of the same experiment can be thought of as a composed experiment, in which case the individual repetitions are called trials.
For example, if one were to toss the same coin one hundred times and record each result, each toss would be considered a trial within the experiment composed of all hundred tosses. The outcome is the result of a single flip.
Gemini Ai