Sets, Functions, and Matrices Overview
Sets, Functions, and Matrices Overview
Copyright © McGraw-Hill Education. All rights reserved. No reproduction or distribution without the prior written consent of McGraw-Hill Education.
Chapter Summary
⚫ Sets
⚫ The Language of Sets
⚫ Set Operations
⚫ Set Identities
⚫ Functions
⚫ Types of Functions
⚫ Operations on Functions
⚫ Computability
⚫ Sequences and Summations
⚫ Types of Sequences
⚫ Summation Formulae
⚫ Set Cardinality
⚫ Countable Sets
⚫ Matrices
⚫ Matrix Arithmetic
Sets
Section 2.1
Section Summary
⚫ Definition of sets
⚫ Describing Sets
⚫ Roster Method
⚫ Set-Builder Notation
⚫ Some Important Sets in Mathematics
⚫ Empty Set and Universal Set
⚫ Subsets and Set Equality
⚫ Cardinality of Sets
⚫ Tuples
⚫ Cartesian Product
Introduction
⚫ Sets are one of the basic building blocks for the types of
objects considered in discrete mathematics.
⚫ Important for counting.
⚫ Programming languages have set operations.
⚫ Set theory is an important branch of mathematics.
⚫ Many different systems of axioms have been used to
develop set theory.
⚫ Here we are not concerned with a formal set of axioms for
set theory. Instead, we will use what is called naïve set
theory.
Sets
⚫ A set is an unordered collection of objects.
⚫ the students in this class
⚫ the chairs in this room
⚫ The objects in a set are called the elements, or members of
the set. A set is said to contain its elements.
⚫ The notation a ∈ A denotes that a is an element of the
set A.
⚫ If a is not a member of A, write a ∉ A
Describing a Set: Roster Method
⚫ S = {a,b,c,d}
⚫ Order not important
S = {a,b,c,d} = {b,c,a,d}
⚫ Each distinct object is either a member or not; listing more
than once does not change the set.
S = {a,b,c,d} = {a,b,c,b,c,d}
⚫ Elipses (…) may be used to describe a set without listing
all of the members when the pattern is clear.
S = {a,b,c,d, ……,z }
Roster Method
⚫ Set of all vowels in the English alphabet:
V = {a,e,i,o,u}
⚫ Set of all odd positive integers less than 10:
O = {1,3,5,7,9}
⚫ Set of all positive integers less than 100:
S = {1,2,3,……..,99}
⚫ Set of all integers less than 0:
S = {…., -3,-2,-1}
Some Important Sets
N = natural numbers = {0,1,2,3….}
Z = integers = {…,-3,-2,-1,0,1,2,3,…}
Z⁺ = positive integers = {1,2,3,…..}
R = set of real numbers
R+ = set of positive real numbers
C = set of complex numbers.
Q = set of rational numbers
Set-Builder Notation
⚫ Specify the property or properties that all members must
satisfy:
S = {x | x is a positive integer less than 100}
O = {x | x is an odd positive integer less than 10}
O = {x ∈ Z⁺ | x is odd and x < 10}
⚫ A predicate may be used:
S = {x | P(x)}
⚫ Example: S = {x | Prime(x)}
⚫ Positive rational numbers:
Q+ = {x ∈ R | x = p/q, for some positive integers p,q}
Interval Notation
[a,b] = {x | a ≤ x ≤ b}
[a,b) = {x | a ≤ x < b}
(a,b] = {x | a < x ≤ b}
(a,b) = {x | a < x < b}
{} also used.
John Venn (1834-1923)
Cambridge, UK
Russell’s Paradox
⚫ Let S be the set of all sets which are not members of
themselves. A paradox results from trying to answer the
question “Is S a member of itself?”
⚫ Related Paradox:
⚫ Henry is a barber who shaves all people who do not shave
themselves. A paradox results from trying to answer the
question “Does Henry shave himself?”
⚫ This is equivalent to
A⊆B and B⊆A
Proper Subsets
Definition: If A ⊆ B, but A ≠B, then we say A is a proper
subset of B, denoted by A ⊂ B. If A ⊂ B, then
is true.
U
Venn Diagram B
A
Set Cardinality
Definition: If there are exactly n distinct elements in S where n
is a nonnegative integer, we say that S is finite. Otherwise it is
infinite.
Definition: The cardinality of a finite set A, denoted by |A|, is
the number of (distinct) elements of A.
Examples:
1. |ø| = 0
2. Let S be the letters of the English alphabet. Then |S| = 26
3. |{1,2,3}| = 3
4. |{ø}| = 1
5. The set of integers is infinite.
Power Sets
Definition: The set of all subsets of a set A, denoted P(A),
is called the power set of A.
Example: If A = {a,b} then
P(A) = {ø, {a},{b},{a,b}}
Cartesian Product
Definition: The Cartesian Product of two sets A and B,
denoted by A × B is the set of ordered pairs (a,b) where a
∈ A and b ∈ B .
Example:
A = {a,b} B = {1,2,3}
A × B = {(a,1),(a,2),(a,3), (b,1),(b,2),(b,3)}
Solution: {1,2,3,4,5} U
A B
Intersection
⚫ Definition: The intersection of sets A and B, denoted by
A ∩ B, is
• Example: Let A be the math majors in your class and B be the CS majors. To count
the number of students who are either math majors or CS majors, add the number of
math majors and the number of CS majors, and subtract the number of joint
CS/math majors.
• We will return to this principle in Chapter 6 and Chapter 8 where we will derive a
formula for the cardinality of the union of n sets, where n is a positive integer.
Review Questions
Example: U = {0,1,2,3,4,5,6,7,8,9,10} A = {1,2,3,4,5}, B ={4,5,6,7,8}
1. A∪B
Solution: {1,2,3,4,5,6,7,8}
2. A∩B
Solution: {4,5}
3. Ā
Solution: {0,6,7,8,9,10}
4.
Solution: {0,1,2,3,9,10}
5. A – B
Solution: {1,2,3}
6. B – A
Solution: {6,7,8}
Symmetric Difference
(optional)
Definition: The symmetric difference of A and B, denoted
by is the set
Example:
U = {0,1,2,3,4,5,6,7,8,9,10}
A = {1,2,3,4,5} B ={4,5,6,7,8} U
What is : A B
⚫ Solution: {1,2,3,6,7,8}
Venn Diagram
Set Identities
⚫ Identity laws
⚫ Domination laws
⚫ Idempotent laws
⚫ Complementation law
⚫ Associative laws
⚫ Distributive laws
⚫ Absorption laws
⚫ Complement laws
Proving Set Identities
⚫ Different ways to prove set identities:
1. Prove that each set (side of the identity) is a subset of the
other.
2. Use set builder notation and propositional logic.
3. Membership Tables: Verify that elements in the same
combination of sets always either belong or do not belong
to the same side of the identity. Use 1 to indicate it is in
the set and a 0 to indicate that it is not.
Proof of Second De Morgan Law
Example: Prove that
Solution: We prove this identity by showing that:
1) and
2)
Solution:
A B C
1 1 1 1 1 1 1 1
1 1 0 0 1 1 1 1
1 0 1 0 1 1 1 1
1 0 0 0 1 1 1 1
0 1 1 1 1 1 1 1
0 1 0 0 0 1 0 0
0 0 1 0 0 0 1 0
0 0 0 0 0 0 0 0
Generalized Unions and
Intersections
⚫ Let A1, A2 ,…, An be an indexed collection of sets.
We define:
Jalen Williams D
F
Kathy Scott
Functions
⚫ A function f: A → B can also be defined as a subset of
A×B (a relation). This subset is restricted to be a relation
where no two elements of the relation have the same first
element.
⚫ Specifically, a function f from A to B contains one, and
only one ordered pair (a, b) for every element a∈ A.
and
Functions
Given a function f: A → B:
⚫ We say f maps A to B or
f is a mapping from A to B.
⚫ A is called the domain of f.
⚫ B is called the codomain of f.
⚫ If f(a) = b,
⚫ then b is called the image of a under f.
⚫ a is called the preimage of b.
⚫ The range of f is the set of all images of points in A under f. We
denote it by f(A).
⚫ Two functions are equal when they have the same domain, the same
codomain and map each element of the domain to the same element of
the codomain.
Representing Functions
⚫ Functions may be specified in different ways:
⚫ An explicit statement of the assignment.
Students and grades example.
⚫ A formula.
f(x) = x + 1
⚫ A computer program.
⚫ A Java program that when given an integer n, produces the nth
Fibonacci Number (covered in the next section and also inChapter
5).
Questions
f(a) = ? z A B
a
The image of d is ? z x
b
The domain of f is ? A y
c
The codomain of f is ? B
d z
The preimage of y is ? b
f(A) = ? {y,z}
The preimage(s) of z is (are) ? {a,c,d}
Question on Functions and Sets
⚫ If and S is a subset of A, then
A B
a
f {a,b,c,} is ? {y,z}
x
b
f {c,d} is ? {z} y
c
d z
Injections
Definition: A function f is said to be one-to-one , or
injective, if and only if f(a) = f(b) implies that a = b for all
a and b in the domain of f. A function is said to be an
injection if it is one-to-one.
A B
a x
v
b
y
c
z
d
w
Surjections
Definition: A function f from A to B is called onto or
surjective, if and only if for every element there is
an element with . A function f is
called a surjection if it is onto.
A B
a x
b
y
c
z
d
Bijections
Definition: A function f is a one-to-one correspondence,
or a bijection, if it is both one-to-one and onto (surjective
and injective).
A B
a x
b
y
c
d z
w
Showing that f is one-to-one or onto
Showing that f is one-to-one or onto
Example 1: Let f be the function from {a,b,c,d} to {1,2,3}
defined by f(a) = 3, f(b) = 2, f(c) = 1, and f(d) = 3. Is f an
onto function?
Solution: Yes, f is onto since all three elements of the
codomain are images of elements in the domain. If the
codomain were changed to {1,2,3,4}, f would not be onto.
Example 2: Is the function f(x) = x2 from the set of
integers to the set of integers onto?
Solution: No, f is not onto because there is no integer x
with x2 = −1, for example.
Inverse Functions
Definition: Let f be a bijection from A to B. Then the
inverse of f, denoted , is the function from B to A
defined as
No inverse exists unless f is a bijection. Why?
Inverse Functions
A f
B A B
a V V
a
b b
W W
c c
d X X
d
Y Y
Questions
Example 1: Let f be the function from {a,b,c} to {1,2,3}
such that f(a) = 2, f(b) = 3, and f(c) = 1. Is f invertible and
if so what is its inverse?
and
Composition Questions
Example 2: Let g be the function from the set {a,b,c} to itself
such that g(a) = b, g(b) = c, and g(c) = a. Let f be the function
from the set {a,b,c} to the set {1,2,3} such that f(a) = 3, f(b)
= 2, and f(c) = 1.
What is the composition of f and g, and what is the
composition of g and f.
Solution: The composition f∘g is defined by
f∘g (a)= f(g(a)) = f(b) = 2.
f∘g (b)= f(g(b)) = f(c) = 1.
f∘g (c)= f(g(c)) = f(a) = 3.
Note that g∘f is not defined, because the range of f is not a subset
of the domain of g.
Composition Questions
Example 2: Let f and g be functions from the set of
integers to the set of integers defined by f(x) = 2x + 3 and
g(x) = 3x + 2.
What is the composition of f and g, and also the
composition of g and f ?
Solution:
f∘g (x)= f(g(x)) = f(3x + 2) = 2(3x + 2) + 3 = 6x + 7
g∘f (x)= g(f(x)) = g(2x + 3) = 3(2x + 3) + 2 = 6x + 11
Graphs of Functions
⚫ Let f be a function from the set A to the set B. The graph
of the function f is the set of ordered pairs {(a,b) | a ∈A
and f(a) = b}.
Example:
Floor and Ceiling Functions
f(2) = 2! = 1 ∙ 2 = 2
f(6) = 6! = 1 ∙ 2 ∙ 3∙ 4∙ 5 ∙ 6 = 720
f(20) = 2,432,902,008,176,640,000.
Partial Functions (optional)
Definition: A partial function f from a set A to a set B is an
assignment to each element a in a subset of A, called the
domain of definition of f, of a unique element b in B.
⚫ The sets A and B are called the domain and codomain of f,
respectively.
⚫ We day that f is undefined for elements in A that are not in the
domain of definition of f.
⚫ When the domain of definition of f equals A, we say that f is a
total function.
Example: f: N → R where f(n) = √n is a partial function from
Z to R where the domain of definition is the set of nonnegative
integers. Note that f is undefined for negative integers.
Sequences and
Summations
Section 2.4
Section Summary
⚫ Sequences.
⚫ Examples: Geometric Progression, Arithmetic Progression
⚫ Recurrence Relations
⚫ Example: Fibonacci Sequence
⚫ Summations
⚫ Special Integer Sequences (optional)
Introduction
⚫ Sequences are ordered lists of elements.
⚫ 1, 2, 3, 5, 8
⚫ 1, 3, 9, 27, 81, …….
⚫ Sequences arise throughout mathematics, computer
science, and in many other disciplines, ranging from
botany to music.
⚫ We will introduce the terminology to represent sequences
and sums of the terms in the sequences.
Sequences
Definition: A sequence is a function from a subset of the
integers (usually either the set {0, 1, 2, 3, 4, …..} or {1,
2, 3, 4, ….} ) to a set S.
⚫ The notation an is used to denote the image of the
integer n. We can think of an as the equivalent of f(n)
where f is a function from {0,1,2,…..} to S. We call an a
term of the sequence.
Sequences
Example: Consider the sequence where
Geometric Progression
Definition: A geometric progression is a sequence of the form:
where the initial term a and the common ratio r are real
numbers.
Examples:
1. Let a = 1 and r = −1. Then:
3. Let a = 1 and d = 2:
Strings
Definition: A string is a finite sequence of characters from
a finite set (an alphabet).
⚫ Sequences of characters or bits are important in computer
science.
⚫ The empty string is represented by λ.
⚫ The string abcde has length 5.
Recurrence Relations
Definition: A recurrence relation for the sequence {an} is
an equation that expresses an in terms of one or more of
the previous terms of the sequence, namely, a0, a1, …, an-1,
for all integers n with n ≥ n0, where n0 is a nonnegative
integer.
⚫ A sequence is called a solution of a recurrence relation if
its terms satisfy the recurrence relation.
⚫ The initial conditions for a sequence specify the terms that
precede the first term where the recurrence relation takes
effect.
Questions about Recurrence Relations
Example 1: Let {an} be a sequence that satisfies the recurrence
relation an = an-1 + 3 for n = 1,2,3,4,…. and suppose that a0 =
2. What are a1 , a2 and a3?
[Here a0 = 2 is the initial condition.]
Answer:
f2 = f1 + f0 = 1 + 0 = 1,
f3 = f2 + f1 = 1 + 1 = 2,
f4 = f3 + f2 = 2 + 1 = 3,
f5 = f4 + f3 = 3 + 2 = 5,
f6 = f5 + f4 = 5 + 3 = 8.
Solving Recurrence Relations
⚫ Finding a formula for the nth term of the sequence
generated by a recurrence relation is called solving the
recurrence relation.
⚫ Such a formula is called a closed formula.
⚫ Various methods for solving recurrence relations will be
covered in Chapter 8 where recurrence relations will be
studied in greater depth.
⚫ Here we illustrate by example the method of iteration in
which we need to guess the formula. The guess can be
proved correct by the method of induction (Chapter 5).
Iterative Solution Example
Method 1: Working upward, forward substitution
Let {an} be a sequence that satisfies the recurrence relation an =
an-1 + 3 for n = 2,3,4,…. and suppose that a1 = 2.
a2 = 2 + 3
a3 = (2 + 3) + 3 = 2 + 3 ∙ 2
a4 = (2 + 2 ∙ 3) + 3 = 2 + 3 ∙ 3
.
.
.
an = an-1 + 3 = (2 + 3 ∙ (n – 2)) + 3 = 2 + 3(n – 1)
Iterative Solution Example
Method 2: Working downward, backward substitution
Let {an} be a sequence that satisfies the recurrence relation an =
an-1 + 3 for n = 2,3,4,…. and suppose that a1 = 2.
an = an-1 + 3
= (an-2 + 3) + 3 = an-2 + 3 ∙ 2
= (an-3 + 3 )+ 3 ∙ 2 = an-3 + 3 ∙ 3
.
.
.
represents
⚫ Examples:
Product Notation (optional)
⚫ Product of the terms
from the sequence
⚫ The notation:
represents
Geometric Series
Sums of terms of geometric progressions
∴
if r ≠1
if r = 1
Some Useful Summation Formulae
Geometric Series: We
just proved this.
Later we
will prove
some of
these by
induction.
Proof in text
(requires calculus)
Cardinality of Sets
Section 2.5
Section Summary
⚫ Cardinality
⚫ Countable Sets
⚫ Computability
Cardinality
Definition: The cardinality of a set A is equal to the cardinality
of a set B, denoted
|A| = |B|,
if and only if there is a one-to-one correspondence (i.e., a
bijection) from A to B.
⚫ If there is a one-to-one function (i.e., an injection) from A to B,
the cardinality of A is less than or the same as the cardinality of
B and we write |A| ≤ |B|.
⚫ When |A| ≤ |B| and A and B have different cardinality, we say
that the cardinality of A is less than the cardinality of B and
write |A| < |B|.
Cardinality
⚫ Definition: A set that is either finite or has the same
cardinality as the set of positive integers (Z+) is called
countable. A set that is not countable is uncountable.
⚫ The set of real numbers R is an uncountable set.
⚫ When an infinite set is countable (countably infinite) its
cardinality is ℵ0 (where ℵ is aleph, the 1st letter of the
Hebrew alphabet). We write |S| = ℵ0 and say that S has
cardinality “aleph null.”
Showing that a Set is Countable
⚫ An infinite set is countable if and only if it is possible to
list the elements of the set in a sequence (indexed by the
positive integers).
⚫ The reason for this is that a one-to-one correspondence f
from the set of positive integers to a set S can be expressed
in terms of a sequence a1,a2,…, an ,… where a1 = f(1),
a2 = f(2),…, an = f(n),…
Hilbert’s Grand Hotel David Hilbert
The Grand Hotel (example due to David Hilbert) has countably infinite number of rooms,
each occupied by a guest. We can always accommodate a new guest at this hotel. How is
this possible?
2 4 6 8 10 12 ……
Then f is a bijection from N to E since f is both one-to-one and
onto. To show that it is one-to-one, suppose that f(n) = f(m).
Then 2n = 2m, and so n = m. To see that it is onto, suppose
that t is an even positive integer. Then t = 2k for some
positive integer k and f(k) = t.
Showing that a Set is Countable
Example 2: Show that the set of integers Z is countable.
Solution: Can list in a sequence:
0, 1, − 1, 2, − 2, 3, − 3 ,………..
Or can define a bijection from N to Z:
⚫ When n is even: f(n) = n/2
⚫ When n is odd: f(n) = −(n−1)/2
The Positive Rational Numbers are
Countable
⚫ Definition: A rational number can be expressed as the
ratio of two integers p and q such that q ≠ 0.
⚫ ¾ is a rational number
⚫ √2 is not a rational number.
Example 3: Show that the positive rational numbers are
countable.
Solution:The positive rational numbers are countable
since they can be arranged in a sequence:
r1 , r2 , r3 ,…
The next slide shows how this is done. →
The Positive Rational Numbers are
Countable
First row q = 1.
Second row q = 2.
etc.
And so on.
1, ½, 2, 3, 1/3,1/4, 2/3, ….
Strings
Example 4: Show that the set of finite strings S over a finite
alphabet A is countably infinite.
Assume an alphabetical ordering of symbols in A
Solution: Show that the strings can be listed in a sequence.
First list
1. All the strings of length 0 in alphabetical order.
2. Then all the strings of length 1 in lexicographic (as in a
dictionary) order.
3. Then all the strings of length 2 in lexicographic order.
4. And so on.
This implies a bijection from N to S and hence it is a countably
infinite set.
The set of all Java programs is
countable.
Example 5: Show that the set of all Java programs is countable.
Solution: Let S be the set of strings constructed from the characters
which can appear in a Java program. Use the ordering from the
previous example. Take each string in turn:
⚫ Feed the string into a Java compiler. (A Java compiler will determine if
the input program is a syntactically correct Java program.)
⚫ If the compiler says YES, this is a syntactically correct Java program,
we add the program to the list.
⚫ We move on to the next string.
In this way we construct an implied bijection from N to the set of
Java programs. Hence, the set of Java programs is countable.
The Real Numbers are Georg Cantor
(1845-1918)
Uncountable
Example: Show that the set of real numbers is uncountable.
Solution: The method is called the Cantor diagnalization argument, and is a proof by
contradiction.
1. Suppose R is countable. Then the real numbers between 0 and 1 are also countable (any
subset of a countable set is countable - an exercise in the text).
2. The real numbers between 0 and 1 can be listed in order r1 , r2 , r3 ,… .
3. Let the decimal representation of this listing be
3 2 matrix
Notation
⚫ Let m and n be positive integers and let
Does AB = BA?
Solution:
AB ≠ BA
Identity Matrix and Powers of Matrices
Definition: The identity matrix of order n is the m n
matrix In = [δij], where δij = 1 if i = j and δij = 0 if i≠j.
AIn = ImA = A
when A is an m n matrix
r times
Transposes of Matrices
Definition: Let A = [aij] be an m n matrix. The
transpose of A, denoted by At ,is the n m matrix
obtained by interchanging the rows and columns of A.