Lecture Outline

• Introduction to probability
• Sample Space & Events
• Mutually Exclusive Events
• Union & Intersection
• Joint Probability
• Complementary Events
• Conditional Probability
• Multiplication Law of Probability
• Independent Events
• Dependent Events
• Addition Law of Probability
• Marginal Probability
• Sensitivity & Specificity
• Bayes’ Law
• Bayesian Inference
 Introduction

• The theory of probability provides the foundation for statistical inference.

• The concept of probability is not foreign to health workers and is frequently encountered in
everyday communication.

For example;

i. A physician say that a patient has a 50–50 chance of surviving a certain operation.

ii. A physician may say that she is 95 percent certain that a patient has a particular disease.

iii. A public health nurse may say that nine times out of ten a certain client will break an
appointment.

• As these examples suggest, most people express probabilities in terms of percentages.

Introduction

• In dealing with probabilities mathematically, it is more convenient to express

probabilities as fractions.

• Thus, we measure the probability of the occurrence of some event by a number

between zero and one.

• The more likely the event, the closer the number is to one; and the more unlikely the
event, the closer the number is to zero.

• An event that cannot occur has a probability of zero, and an event that is certain to
occur has a probability of one.
Sample Space (S)

• The sample space is the set of all possible outcomes.

• The sample space is represented by the symbol S.

• There are 2 possible outcomes with the sample space of tossing a coin;
S = {Head, Tail}

• There are 6 possible outcomes with the sample space of rolling a dice;
S = {1, 2, 3, 4, 5, 6}

• There are 52 possible outcomes with the sample space of drawing a card;
S = {2♠, 2♣, 2♦, 2♥, 3♠, 3♣, 3♦, 3♥, ..., A♠, A♣, A♦, A♥}
Event

• An event is a subset of a sample space S.

• In referring to probabilities of events, an event is any set of outcomes of interest.

• The symbol { } is used as shorthand for the phrase “the event.”

• The probability of an event E, denoted by P(E) or Pr(E), always satisfies 0 ≤ Pr(E) ≤ 1.

Probability

The probability of an event is the relative frequency of this set of outcomes over an
indefinitely large (or infinite) number of trials.
Probability (Example)
The primary aim of a study by Carter et al. was to investigate the effect of the age
at onset of bipolar disorder on the course of the illness. One of the variables
investigated was family history of mood disorders. Table shows the frequency of a
family history of mood disorders in the two groups of interest (Early age at onset
defined to be 18 years or younger and Later age at onset defined to be later than 18
years). Suppose we pick a person at random from this sample. What is the
probability that this person will be 18 years old or younger ?
Table: Frequency of Family History of Mood Disorder
by Age Group Among Bipolar Subjects
 Mutually Exclusive

Two events A and B are mutually exclusive, or disjoint, if A ∩ B = Φ, that is, if A and B
have no elements in common.

or

Two events A and B are mutually exclusive if they cannot both happen at the same time.

If outcomes A and B are two events that cannot both happen at the same time, then;

Pr(A or B) = Pr(A) + Pr(B)

Mutually Exclusive (Examples)

Example-1: Hypertension

• Let A be the event that a person has normotensive diastolic blood pressure (DBP)
readings (DBP < 90), and
• Let B be the event that a person has borderline DBP readings (90 ≤ DBP < 95).
• Suppose that Pr(A) = 0.7, and Pr(B) = 0.1.
• Let Z be the event that a person has a DBP < 95.
• Then Pr (Z) = Pr (A) + Pr (B) = 0.8

The events A and B are mutually exclusive because they cannot occur at the same time.

Example-2: Hypertension

• Let X be diastolic blood pressure (DBP),

• Let C be the event X ≥ 90, and
• Let D be the event 75 ≤ X ≤ 100.

Events C and D are not mutually exclusive, because they both occur when 90 ≤ X ≤ 100.
Union

The union of the two events A and B, denoted by the symbol A∪B, is the event containing
all the elements that belong to A or B or both.

There are two special cases in the union.

i. A ∪ B can be mutually exclusive

ii. A ∪ B can be not mutually exclusive

The given figure diagrammatically depicts A ∪ B both for the case in which A and B are
and are not mutually exclusive.
Union (Examples)

Example: when A ∪ B is mutually exclusive

Example Hypertension:
• Let events A is defined as A = {X < 90},
• Let events B is defined as B = {90 ≤ X < 95},
• where X = diastolic blood pressure (DBP).
• Then A ∪ B = {X < 95}.

Example: when A ∪ B is not mutually exclusive

Example Hypertension:
• Let events C is defined as C = {X ≥ 90},
• Let events D is defined as D = {75 ≤ X ≤ 100},
• where X = diastolic blood pressure (DBP).
• Then C ∪ D = {X ≥ 75}.
Joint Probability or Intersection

• Sometimes we want to find the probability that a subject picked at random from a
group of subjects possesses two characteristics at the same time. Such a probability
is referred to as a joint probability.

• The intersection of two events A and B, denoted by the symbol A ∩ B, is the event
containing all elements that are common to A and B.

• A ∩ B is depicted diagrammatically in the figure.

Joint Probability or Intersection (Example-1)
Example-1: What is the probability that a person picked at random from the 318
subjects will be Early (E) and will be a person who has no family history of mood
disorders (A)?
Table: Frequency of Family History of Mood Disorder
by Age Group Among Bipolar Subjects

• The joint probability may be written in symbolic notation as P(E ∩ A).

• The symbol ∩ is read either as “intersection” or “and”.
• The statement indicates the joint occurrence of conditions E and A.
• The number of subjects satisfying both of the desired conditions is found at the
intersection of the column labeled E and the row labeled A and is seen to be 28.
• Since the selection will be made from the total set of subjects, the denominator is 318.
• Thus, we may write the joint probability as P(E ∩ A) = 28/318 = 0.881
Joint Probability or Intersection (Example-2)

Example-2: Hypertension

• Let events C is defined as C = {X ≥ 90} ,

• Let events D is defined as D = {75 ≤ X ≤ 100},

• where X = diastolic blood pressure (DBP).

• Then C ∩ D = {90 ≤ X ≤ 100}.

Joint Probability or Intersection (Example-3)

Example-3: Classroom

• Let E be the event that a person selected at random in a classroom is majoring in

engineering, and

• Let F be the event that the person is female.

• Then E ∩ F is the event of all female engineering students in the classroom.

Complementary Events
Complementary Events (Example-1)
Complementary Events (Example-2)
Complementary Events (Example-3)
Independent Events

Two events A and B are called independent events if

Pr (A ∩ B) = Pr (A) × Pr (B)

If we want to compute the probability of two or several events occurring simultaneously,

and If the events are independent, then we can use the multiplication law of probability to
do so.
Conditional Probability

When probabilities are calculated with a subset of the total group as the denominator, the
result is a conditional probability.

• If two events are independent, then

Pr(A ∩ B) = Pr(A) × Pr(B)

• The conditional probability can be calculated by dividing both sides by Pr(A) or Pr(B)
(depending what is the given condition should go in the denominator), then

Pr(B) = Pr(A ∩ B)/Pr(A) = Pr(B | A)

 Conditional Probability (Example)

Suppose we pick a subject at random from the 318 subjects and find that he is 18 years
or younger (E). What is the probability that this subject will be one who has no family
history of mood disorders (A)?

Table: Frequency of Family History of Mood Disorder

by Age Group Among Bipolar Subjects

Solution

• The total number of subjects is no longer of interest, since, with the selection of an Early
subject, the Later subjects are eliminated.

Continue on next slide…

Conditional Probability (Example)

• We may define the desired probability, then, as follows: What is the probability that a
subject has no family history of mood disorders (A), given that the selected subject is
Early (E)?

• This is a conditional probability and is written as P(A | E) in which the vertical line is
read “given.”

• The 141 Early subjects become the denominator of this conditional probability, and
28, the number of Early subjects with no family history of mood disorders, becomes
the numerator.

• Our desired probability, then, is