Advanced Concepts of
Modeling in AI
• Artificial Intelligence, or AI for short, refers to any technique that enables computers
to mimic human intelligence. An artificially intelligent machine works on algorithms
and data fed to it and gives the desired output.
• Machine Learning, or ML for short, enables machines to improve at tasks with
experience. The machine here learns from the new data fed to it while testing and
uses it for the next iteration. It also takes into account the times when it went wrong
and considers the exceptions too.
• Input (past or historical data) is given to the ML model and the model
generates output by learning from the input data.
• Examples of Machine Learning (ML)
• Object Classification Identifies and labels objects present withinan
image or data point. It determines the category an object belongs
to.
• Anomaly Detection helps us find the unexpected things hiding in
our data. For example, tracking your heart rate, and finding a
sudden spike could be an anomaly, flagging a potential issue
• Deep Learning, or DL for short, enables software to train itself to
perform tasks with vast amounts of data. Since the system has got huge
set of data, it is able to train itself with the help of multiple machine
learning algorithms working altogether to perform a specific task.
• Input is given to an ANN, and after processing, the output is generated
by the DL block.
• Examples of Deep Learning (DL)
• Object classification in deep learning tackles the task of identifying
and labeling objects within an image. It essentially uses powerful
algorithms to figure out what's ina picture and categorize those
things.
• Digit Recognition in deep learning tackles the challenge of
training computers to identify handwritten digits (0-9) within
images.
• Artificial Intelligence is the umbrella term which holds both Deep Learning as well as
Machine Learning. Deep Learning, on the other hand, is the very specific learning approach
which is a subset of Machine Learning as it comprises of multiple Machine Learning
algorithms.
What is Data?
• Data is information in any form
• For e.g. A table with information
about fruits is data
• Each row will contain information
about different fruits
• Each fruit is described by certain
features
What do you mean by Features?
• Columns of the tables are called
features
• In the fruit dataset example,
features may be name, color, size,
etc.
• Some features are special, they are
called labels
What are Labels?
• Data Labeling is the process of
attaching meaning to data
• It depends on the context of the
problem we are trying to solve
• For e.g. if we are trying to predict
what fruit it is based on the color
of the fruit, then color is the
feature, and fruit name is the label.
• Data can be of two types –
Labeled and Unlabeled
Labeled Data
• Data to which some tag/label is attached.
• For e.g. Name, type, number, etc.
Unlabeled Data
• The raw form of data
• Data to which no tag is attached.
What do you mean by a training data set?
The training data set is a collection of examples given to the model
to analyze and learn.
Just like how a teacher teaches a topic to the class through a lot of
examples and illustrations.
Similarly, a set of labeled data is used to train the AI model.
What do you mean by a testing data set?
The testing data set is used to test the accuracy of the model.
Just like how a teacher takes a class test related to a topic to
evaluate the understanding level of students.
Test is performed without labeled data and then verify results with
labels.
Modelling
• AI Modelling refers to developing algorithms, also called models
which can be trained to get intelligent outputs.
• That is, writing codes to make a machine artificially intelligent.
Rule Based Approach
• Rule Based Approach refers to the AI modelling where the relationship or patterns in data are
defined by the developer.
• The machine follows the rules or instructions mentioned by the developer, and performs its
task accordingly.
• A drawback/feature for this approach is that the learning is static. The
machine once trained, does not take into consideration any changes
made in the original training dataset.
• Once trained, the model cannot improvise itself on the basis of
feedbacks.
• Thus, machine learning gets introduced as an extension to this as in that
case, the machine adapts to change in data and rules and follows the
updated path only, while a rule-based model does what it has been
taught once.
Learning Based Approach
• A learning-based approach is a method where a computer learns how
to do something by looking at examples or getting feedback, similar to
how we learn from experience.
• Instead of being explicitly programmed for a task, the computer learns
to perform it by analyzing data and finding patterns or rules on its
own.
• We can say that it refers to the
AI modelling where the
machine learns by itself.
• Under the Learning Based
approach, the AI model gets
trained on the data fed to it and
then is able to design a model
which is adaptive to the change
in data.
Categories of Machine learning based models
• Learning-based
approaches are indeed
a broad category that
encompass both
machine learning and
deep learning.
Machine learning can
further be divided into
three parts:
Supervised Learning
• In a supervised learning model, the dataset which is fed to the machine is labelled.
• In other words, we can say that the dataset is known to the person who is training
the machine only then he/she is able to label the data.
• A label is some information which can be used as a tag for data.
Unsupervised Learning
• An unsupervised learning model works on unlabelled dataset.
• This means that the data which is fed to the machine is random and
there is a possibility that the person who is training the model does
not have any information regarding it.
• The unsupervised learning models are used to identify relationships,
patterns and trends out of the data which is fed into it. It helps the
user in understanding what the data is about and what are the major
features identified by the machine in it.
Reinforcement Learning
• This learning approach enables the
computer to make a series of
decisions that maximize a reward
metric for the task without human
intervention and without being
explicitly programmed to achieve the
task.
• Reinforcement learning is a type of
learning in which a machine learns
to perform a task through a repeated
trial-and-error method.
What makes it different?
1. For supervised learning and unsupervised learning, you need to have a pretty
good idea of the data that you have, what’s going on, and how to solve the
problem.
2. However, you will frequently encounter situations where you have to deal
with large complex problem spaces.
3. You may need to respond to unforeseen environments, and you don’t have
sufficient data on those specific scenarios.
4. The environment may change. Hence your system needs to be adaptive.
Reinforcement Learning will be important because it doesn’t require a lot of
pre- existing knowledge or data to provide useful solutions.
Summary of ML Models
• Supervised learning models
are used when we want to
determine relationships
through training.
• Unsupervised learning models
are used when we want to
discover new patterns from
data.
• Reinforcement learning
models are used when we want
to implement machine learning
through a reward mechanism.
• There are two types of Supervised Learning models: Classification
model and Regression model.
Classification Model
• Classification Model Here the data is
classified according to the labels.
• For example, in the grading system,
students are classified on the basis of
the grades they obtain with respect to
their marks in the examination.
• This model works on discrete dataset
which means the data need not be
continuous.
• Examples of the Classification Model In this case, the model would be
trained on historical weather data that includes temperature
information labeled as "hot" or "cold".
• The model would learn the patterns that differentiate hot and cold
weather based on factors like:
• Location (average temperatures vary geographically)
• Season (summer vs. winter)
• High and low temperatures
• Humidity
• Classifying emails as spam or not:
Regression Model
• Regression: Such models work on continuous data. For example, if
you wish to predict your next salary, then you would put in the
data of your previous salary, any increments, etc., and would train
the model. Here, the data which has been fed to the machine is
continuous.
Regression algorithms predict a continuous value based on the
input variables.
Continuous values as Temperature, Price, Income, Age, etc.
• In this example, we have input data with no class labels (unlabeled
data), and this input data comprises of birds and animals.
• Note that, even though there were no class labels, the
unsupervised learning model was able to divide this data into two
clusters based on clustering.
• The two clusters have been formed based on the similarity of
characteristics. The first cluster comprises all the animals, and the
second cluster comprises all the birds.
Difference between Clustering and Classification
Classification uses predefined classes in which objects are assigned.
Clustering finds similarities between objects and places them in the
same cluster and it differentiates them from objects in other clusters.
Association
• Association Rule is an unsupervised learning method that is used to find interesting
relationships between variables from the database.
• Based on the purchase pattern of customers A and B, can you predict any Customer X
who buys bread will most probably buy?
Sub-Categories of Deep Learning
• Deep Learning enables software to train itself to perform tasks with vast amounts
of data.
• In deep learning, the machine is trained with huge amounts of data which helps it
to train itself around the data. Such machines are intelligent enough to develop
algorithms for themselves.
• There are two types of Deep Learning models:
a) Artificial Neural Networks (ANN)
b) Convolution Neural Network (CNN)
• Artificial Neural networks(ANN) - Artificial Neural networks are modelled on the
human brain and nervous system. They are able to automatically extract features
without input from the programmer. Every neural network node is essentially a
machine learning algorithm. It is useful when solving problems for which the data
set is very large.
• Convolutional Neural Network (CNN) - Convolutional Neural Network is a Deep
Learning algorithm which can take in an input image, assign importance (learnable
weights and biases) to various aspects/objects in the image and be able to
differentiate one from the o.
Neural Network
• Neural networks are loosely modelled after how neurons in the human brain
behave.
• The key advantage of neural networks is that they are able to extract data
features automatically without needing the input of the programmer.
• A neural network is essentially a system of organizing machine learning
algorithms to perform certain tasks.
• It is a fast and efficient way to solve problems for which the dataset is very
large, such as in images.
• A Neural Network is divided into multiple layers and each layer is further divided into
several blocks called nodes. Each node has its own task to accomplish which is then
passed to the next layer.
• Neural Network consists of an input layer, hidden layer which performs computation
using weights and biases on each node and finally, information is passed through
these layers to reach the output layer.
• The first layer of a Neural Network is known as the input layer. The job of an input
layer is to acquire data and feed it to the Neural Network. No processing occurs at the
input layer.
• Next to it, are the hidden layers. Hidden layers are the layers in which the whole
processing occurs. Their name essentially means that these layers are hidden and are
not visible to the user. Each node of these hidden layers has its own machine learning
algorithm which it executes on the data received from the input layer.
• The hidden layer performs computation by means of weights and biases
Information passes from one layer to the other after the value found from this
calculation passed through a selected activation function.
• The process of finding the right output begins with trial and error until the
network finally learns.
• With each try, the weights are adjusted based on the error found between the
desired output and the network output.
There can be multiple hidden layers in a neural network system and their number
depends upon the complexity of the function for which the network has been
configured. Also, the number of nodes in each layer can vary accordingly.