Dr.
VIDHYA B
ASSISTANT PROFESSOR
Department of Computer Science with Data Analytics
Sri Ramakrishna College of Arts & Science
Coimbatore - 641 006
Tamil Nadu, India
1
Glimpses of Machine Learning
AGENDA
Glimpses of Machine Learning
Introduction
Evolution of Machine Learning
Human Learning & its types
What is Machine Learning?
Process of Machine Learning
Well posed Learning Problem
Glimpses of Machine Learning
Artificial Intelligence, is the process of imparting data,
information, and human intelligence to machines.
The main goal of Artificial Intelligence is to develop self-reliant
machines that can think and act like humans.
These machines can mimic human behavior and perform tasks by
learning and problem-solving.
Most of the AI systems simulate natural intelligence to solve
complex problems.
Eg: AI-driven product - Amazon Echo
Glimpses of Machine Learning
Machine Learning is a discipline of computer science that uses
computer algorithms and analytics to build predictive models that
can solve business problems.
Deep learning is a subset of
machine learning that deals
with algorithms - structure and
function of the human brain.
Deep learning algorithms can
work with an enormous
amount of both structured
and unstructured data.
Deep learning’s core concept
lies in artificial neural
networks, which enable
machines to make decisions.
INTRODUCTION TO MACHINE
LEARNING
People attention was grasped to a fast-evolving field in
computer science or more specifically artificial intelligence – i.e.
machine learning (ML)
When a computer program defeated the ruling world champion
in a game which is considered to need a lot of intelligence to
play.
The computer program was IBM’s Deep Blue and it defeated
world chess champion, Gary Kasparov.
INTRODUCTION TO MACHINE
LEARNING
Machine learning is a technology area finding
its application in almost every sphere of life as
follows:
It can recommend toys to toddlers.
It can suggest a technology book to a geek or a
rich title in literature to a writer.
It predicts the future market to help amateur
traders compete with seasoned stock traders.
It helps an oncologist find whether a tumour is
malignant or benign.
It helps in optimizing energy consumption thus
helping the cause of Green Earth.
INTRODUCTION TO MACHINE
LEARNING
Google has become one of the front-runners focusing a
lot of its research on machine learning and artificial
intelligence-
Google self-driving car and Google Brain being two most
ambitious projects of Google in its journey of innovation
in the field of machine learning.
INTRODUCTION TO MACHINE
LEARNING
The foundation of machine learning started in the 18th and 19th
centuries.
The first related work started at 1763, Thomas Bayes’s work ‘An
Essay towards solving a Problem in the Doctrine of Chances’ was
published two years after his death.
This is the work underlying Bayes Theorem, a fundamental work
on which a number of algorithms of machine learning is based
upon. In 1812, the Bayes theorem was actually formalized by the
French mathematician Pierre-Simon Laplace.
in 1805, the method of least squares, which is the foundational
concept to solve regression problems, was formalized.
In 1913, Andrey Markov came up with the concept of Markov
chains.
INTRODUCTION TO MACHINE
The
LEARNING
real start of focused work in the field of machine learning is
considered to be Alan Turing’s seminal work in 1950. Turing posed
the question ‘Can machines think?’ or in other words, ‘Do machines
have intelligence?’.
He was the first to propose that machines can ‘learn’ and become
artificially intelligent.
In 1952, Arthur Samuel of IBM laboratory started working on
machine learning programs, and first developed programs that could
play Checkers.
In 1957, Frank Rosenblatt designed the first neural network
program simulating the human brain.
The journey of machine learning has been fascinating can be
formulated as:
In 1969 nearest neighbour algorithm,
In 1982 recurrent neural network,
In 1995 support vector machines and random forest
algorithms.
The latest feather in the cap of machine learning development
has been Google’s AlphaGo program.
EVOLUTION OF MACHINE LEARNING
FIG. 1.1 Evolution of machine learning
HUMAN LEARNING
In cognitive science, learning is typically referred to as the process of
gaining information through observation.
To do a task in a proper way, need to have prior information on one or
more things related to the task
TYPES OF HUMAN LEARNING
Learning under expert Learning guided by
guidance knowledge gained from Learning by Self
experts
WHAT IS MACHINE LEARNING?
The ability of a computer to learn without being Explicitly
programmed”.
According to Tom M. Mitchell, Professor of Machine Learning
Department, School of Computer Science, Carnegie Mellon
University, defined machine learning as:
‘A computer program is said to learn from experience E
with respect to some class of tasks T and performance
measure P, if its performance at tasks in T, as measured by
P, improves with experience E.’
WHAT IS MACHINE LEARNING?
Example: Learning to play checkers
E represents the experience of playing the game,
T represents the task of playing checkers
P is the performance measure indicated by the percentage
of
games won by the player.
The same mapping can be applied for any other machine learning
problem, for example, image classification problem.
In context of image classification,
E represents the past data with images having labels or assigned
classes (for example whether the image is of a class cat or a class
dog or a class elephant etc.),
T is the task of assigning class to new, unlabelled images and
P is the performance measure indicated by the percentage of
images correctly classified.
WHY MACHINE LEARNING?
• Lets take a problem ….
• Write a code to differentiate Orange and Apple.
WHY MACHINE LEARNING?
• How would you write code for identify the black and white
image?
WHY MACHINE LEARNING?
What will be the behavior of your Algorithm for other images
with Different shapes?
WHY MACHINE LEARNING?
• SOLUTION:
• CLASSIFIER
• FUNCTION TAKES INPUT, CLASSIFY AND LABELS THE DATA
AS OUTPUT
• Y=F(X)
• X- INPUT/FEATURE
• Y- OUTPUT/ LABELS
Machines Learning Process
The basic machine learning process can be divided into three
parts.
[Link] Input: Past data or information is utilized as a basis
for future decision-making
[Link]: The input data is represented in a broader
way through the underlying algorithm
[Link]: The abstracted representation is
generalized to form a framework for making decisions
FIG. 1.2 Process of machine learning
Machines Learning Process
Typical process of learning from classroom and books and preparing
for the examination.
Creating an outline of topics and a conceptual mapping of those
outlined topics with the entire knowledge pool.
Eg: Vertebrates are further grouped as mammals, reptiles,
amphibians, fishes, and birds. Here, we have mapped animal groups
and their salient characteristics.
Invertebrate: Do not have backbones and skeletons
Vertebrate
Fishes: Always live in water and lay eggs
Amphibians: Semi-aquatic i.e. may live in water or land; smooth
skin; lay eggs
Reptiles: Semi-aquatic like amphibians; scaly skin; lay eggs; cold-
blooded
Birds: Can fly; lay eggs; warm-blooded
Mammals: Have hair or fur; have milk to feed their young; warm-
blooded
Machines Learning Process
Abstraction:
Knowledge is fed in the form of input data.
The data cannot be used in the original shape and form.
Hence a model is created having the following forms:
Computational blocks like if/else rules
Mathematical equations
Specific data structures like trees or graphs
Logical groupings of similar observations
Machines Learning Process
Abstraction:
The choice of model is taken based on multiple aspects, some of which are
listed below:
The type of problem to be solved: Whether the problem is related to forecast
or prediction, analysis of trend, understanding the different segments or
groups of objects, etc.
Nature of the input data: How exhaustive the input data is, whether the data
has no values for many fields, the data types, etc.
Domain of the problem: If the problem is in a business critical domain with a
high rate of data input and need for immediate inference, e.g. fraud detection
problem in banking domain.
Machines Learning Process
Generalization:
To take future decisions, part of generalization is used. Two
problems encountered are:
The trained model is aligned with the training data too much,
hence may not portray the actual trend.
The test data possess certain characteristics apparently
unknown to the training data.
An approximate or heuristic approach, much like gut-feeling-based
decision-making in human beings, has to be adopted.
This approach has the risk of not making a correct decision – quite
obviously because certain assumptions that are made may not be
true in reality
Machines Learning Process
Well Posed Learning Problem:
Framework for defining new problem:
What is the problem?
Why does the problem need to be solved?
How to solve the problem?
Step 1: What is the Problem?
A number of information should be collected to know what is
the problem. Informal description of the problem, e.g. I need
a program that will prompt the next word as and when I type
a word.
Formalism
Use Tom Mitchell’s machine learning formalism stated above
to define the T, P, and E for the problem.
For example:
Task (T): Prompt the next word when I type a word.
Experience (E): A corpus of commonly used English words
and phrases.
Performance (P): The number of correct words prompted
considered as a percentage (which in machine learning
Machines Learning Process
Step 3: How would I solve the problem?
•Try to explore how to solve the problem manually.
•Detail out step-by-step data collection, data preparation, and
program design to solve the problem. Collect all these details and
update the previous sections of the problem definition, especially the
assumptions.
Summary
•Step 1: What is the problem?
Describe the problem informally and formally and list assumptions
and similar problems.
•Step 2: Why does the problem need to be solved?
List the motivation for solving the problem, the benefits that the
solution will provide and how the solution will be used.
•Step 3: How would I solve the problem?
Describe how the problem would be solved manually to flush domain
knowledge.
Machines Learning Process
Step 2: Why does the problem need to be solved?
Motivation
•What is the motivation for solving the problem? What requirement
will it fulfil?
•For example, does this problem solve any long- standing business
issue like finding out potentially fraudulent transactions? Or the
purpose is more trivial like trying to suggest some movies for
upcoming weekend.
Solution benefits
•Consider the benefits of solving the problem. What capabilities does
it enable?
•It is important to clearly understand the benefits of solving the
problem. These benefits can be articulated to sell the project.
Solution use
How will the solution to the problem be used and the life time of the
solution is expected to have?