Data and Artificial

Intelligence
LETS TEACH MACHINE HOW TO LEARN FROM DATA
Role of Data Scientist and Data Analyst
 Who Is a Data Scientist?

A data scientist is the person who gathers data from multiple sources and applies machine learning,
predictive analytics, and sentiment analysis to extract critical information from the collected data sets.
 Skills Required to Become a Data Scientist

Knowledge of Experience in SQL

Python and R

Knowledge of Machine
Learning

Understanding of Multiple Ability to Work with

Analytics Function Unstructured Data
 Who Is a Data Analyst?

A data analyst is the person who can do basic descriptive statistics, visualize data, and
communicate data points for conclusions.
 Skills Required to Become a Data Analyst

Knowledge of Understanding of R and Understanding of Pig and

Data Wrangling
Mathematical Statistics Python Hive
 Types of Analytics

Descriptive Predictive
Analytics Analytics

Prescriptive Analytics
 Descriptive Analytics

The type of analytics that describes the past and answers the question: “What has happened?”.

Data Aggregation What has happened?

Descriptive Analytics

Data Mining
 Predictive Analytics

The type of analytics that has the ability to understand the future and answer the question: “What might
happen?”.

What might happen?

Statistical Model

Predictive Analytics

Forecast Technique
 Prescriptive Analytics

The type of analytics that is used to advice the users on possible outcome and answer the question: “What should
be done?”.

Optimization What should be done?

Prescriptive Analytics

Simulation
Algorithms
 What Is Machine Learning?

The capability of Artificial Intelligence systems to learn by extracting patterns

from data is known as Machine Learning.
MACHINE
LEARNING
LETS TEACH MACHINE HOW TO LEARN FROM DATA

© Amit Mishra
 Machine Learning

A Foody

© Amit Mishra
© Amit Mishra
 LOGIC

INPUT OUTPUT

A TRAINED BRAIN
© Amit Mishra
 Machine Learning

A Naive Machine

© Amit Mishra
 To minimize the difference
between predicted output &
actual output

f(x)
INPUTS Learns the
parameters
of the
function –
OLD OUTPUT An
Algorithm

A Chosen Statistical Function

© Amit Mishra
 To minimize the difference
between predicted output &
actual output

INPUT

f(x) What is f(x) –

OUTPUT

A Trained Statistical Function

© Amit Mishra
“
Machine Learning is a subfield of artificial intelligence that involved the
development of self-learning algorithms to gain knowledge from that data in
order to make predictions. Instead of requiring humans to manually derive rules
and build models from analysing large amounts of data, machine learning offers a
more efficient alternative for capturing the knowledge in data to gradually
improve the performance of predictive models, and make data-driven decisions.

© Amit Mishra
ARTIFICIAL
INTELLIGENCE
LETS MACHINE SOLVE A PROBLEM FROM DATA

© Amit Mishra
 Can You
define it for
me.. ?

© Amit Mishra
 Yes!.. Artificial Intelligence is a branch of
computer science dedicated to creating
intelligent machines that work and react like a
human brain.

© Amit Mishra
© Amit Mishra
 ARTIFICIAL INTELLIGENCE MACHINE LEARNING
AI stands for Artificial intelligence, where
ML stands for Machine Learning which is
intelligence is defined acquisition of
defined as the acquisition of knowledge or
knowledge intelligence is defined as a
skill
ability to acquire and apply knowledge.
The aim is to increase chance of success The aim is to increase accuracy, but it does
and not accuracy. not care about success
It work as a computer program that does It is a simple concept machine takes data
smart work and learn from data.
The goal is to learn from data on certain
The goal is to simulate natural intelligence
task to maximize the performance of
to solve complex problem
machine on this task.
ML allows system to learn new things from
AI is decision making.
data.
It leads to develop a system to mimic
It involves in creating self learning
human to respond behave in a
algorithms.
circumstances.
ML will go for only solution for that whether it
AI will go for finding the optimal solution.
is optimal or not.
AI leads to intelligence or wisdom. ML leads to knowledge.

© Amit Mishra
DEEP
LEARNING
LETS MACHINE SOLVE A PROBLEM FROM DATA

© Amit Mishra
“
Deep Learning (DL) is a particular kind of Machine Learning (ML) algorithm that is
inspired by the functionality of our brain cells called neurons which led to the
concept of Artificial Neural Network (ANN).

© Amit Mishra
Input Value 1

Input Value 2 OUTPUT VALUES

Input Value 3

INPUT LAYER HIDDEN LAYER OUTPUT LAYER

© Amit Mishra
USE CASES
AI AND MACHINE LEARNING USE CASES

© Amit Mishra
Artificial Intelligence (AI) can be used to create a fully autonomous
car’s to travel between destinations without a human operator.

SELF DRIVING CAR

© Amit Mishra
Sophia — The Humanoid Robot: Sophia is a social humanoid robot
developed by Hong Kong-based company Hanson Robotics. Sophia
is the first humanoid robot which is being granted a ‘robot
citizenship’ by Saudi Arabia.

HUMANOID ROBOT
© Amit Mishra
Snapchats filters use augmented reality and machine learning for
your flower crowns selfies.

SNAPCHAT FILTERS
© Amit Mishra
Netflix — The Application that knows what you want: The Netflix
recommendation system is powered by Machine Learning (ML)
algorithms and that is what makes their system so good in
predicting the movies that you are most likely to watch and hence
show them as suggestions to you.

NETFLIX
© Amit Mishra
Sentiment analysis is a real-time machine learning application that
determines the emotion or opinion of the speaker or the writer. For
instance, if someone has written a review or email (or any form of a
document), a sentiment analyser will instantly find out the actual
thought and tone of the text. This sentiment analysis application can
are used to analyse a review based website, decision-making
applications, etc.

SENTIMENT
ANALYSIS
© Amit Mishra
Image Recognition is one of the most significant and notable Machine
Learning and AI techniques: an approach for cataloguing and
detecting a feature or an object in the digital image. This technique is
being adopted for further analysis, such as pattern recognition, face
detection, or face recognition.

IMAGE
RECOGNITION
© Amit Mishra
Fact Checks! Spotting Fake News, Reporting Articles …

JOURNALISM

© Amit Mishra
You Healthy! Patient diagnoses and treatment …

HEALTHCARE

© Amit Mishra
Hospitality, Hotel Selection, Customer Behavior, Recommendations,
All five stars!! …

TOURISM
© Amit Mishra
You’re Hired! Skills based job search and resume shortlisting and
interview selection, Attrition Rate …

JOB HIRING(HR)
© Amit Mishra
Happy Clients! Service improvising by speech analytics, sentiment
analysis, text analytics, NLP …

CUSTOMER SERVICE
© Amit Mishra
Banks are now using the latest advanced technology machine
learning has to offer to help prevent fraud & protect accounts from
hackers. The algorithms determine what factors to consider to
create a filter to keep harm at bay. Various sites that are
unauthentic will be automatically filtered out and restricted from
initiating transactions.

BANKING
© Amit Mishra
TYPES OF
DATA
LETS CLASSIFY DATASETS

© Amit Mishra
© Amit Mishra
TYPES OF
MACHINE LEARNING
LETS CLASSIFY DIFFERENT TYPE OF MACHINE LEARNING

© Amit Mishra
© Amit Mishra
SUPERVISED LEARNING
AI AND MACHINE LEARNING USE CASES
Supervised learning is when input variables (X) called Features and
output variable (Y) called label or a class use an algorithm to learn the
mapping function from the input to output.

Y = f(X)
The goal is to approximate the mapping function so well that when you
have new input data (X) that you can predict the output variables (Y) for
that data.

© Amit Mishra
UNSUPERVISED LEARNING
AI AND MACHINE LEARNING USE CASES
Unsupervised Learning is when only have input data (X) and no
corresponding output variables.

The goal for unsupervised learning is to model the underlying

structure or distribution in the data in order to learn more about the
data.

Algorithms are left to their own devises to discover and present the
interesting structure in the data.

© Amit Mishra
Reinforcement learning
Reinforcement learning is quite different from the other two types of machine learning. In
reinforcement learning, there’s no training data. The algorithm works on a rewards-based system.
Reinforcement learning involves an autonomous agent that observes the environment and then
selects an action that will lead to rewards. This helps the algorithm improve in the long run on its
own. The best example of the reinforcement learning approach is creating a game.

© Amit Mishra
WHY IS AI & ML ARE
TRENDING NOW?
85% of growth from new Geo-location
types of data with Sensor
Data
Data
Machine generated data Machine
increasing 15x Generated

Social
Networks

Web Logs 2040

Click Streams Digital Universe will
increase by 160 Zettabytes
Documents
Emails 2014
Unstructured Data 31% of enterprises managing more than 1
Petabyte

ERP , CRM 2012

System Data
Digital Universe = 20 Zettabytes
WHY IS AI & ML ARE TRENDING ONLY NOW?
1. More Data
2. Computing Power:
GPU that make parallel processing faster cheaper & powerful
CPU & RAM has became cheaper & faster over the years. (Even normal
commodity systems comes with i3 & 4GB RAM with minimum cost)

3. Ready Algorithms Implementations

a. Because of Better Software Development Approach

4. New Technologies
a. Cloud Computing
b. Big Data
c. Real Time Streaming

5. Packages:
R Programming, Python Programming made it easy

© Amit Mishra
Data Science in PYTHON

1. RAW Data Collection

a. BeautifulSoup library
b. Streaming source – Kafka, Flume

2. Data Presentation & Cleanup

a. Pandas library

3. Data Visualization
a. Matplotlib and Seaborn library

4. ML Modeling
a. Tensorflow/SkLearn library

5. Deployment & BI Reports

a. Tensorflow Serving

© Amit Mishra
Stage 1. Train A Model with Examples Datasets (Training)

Cat

Dog

OUTPUT
Car

Fruit
An Artificial Intelligence
model is a mathematical
function

© Amit Mishra
Stage 2. Predict with the Trained Model

© Amit Mishra
Machine Learning Flow

© Amit Mishra
 Machine Learning Lifecycle

1 2 3 4 5

Define ML use cases Data Exploration Select Algorithm Data Pipeline & Build ML Model
Define Specific ML use Perform exploratory Choose the right ML feature engineering Develop the first iteration
cases for the Project. data analysis to Algorithm for the Task Create the right of the ML Model.
understand the data features from raw data
for the ML Task.

10 9 8 7 6

Monitor Model Operationalize Model Plan for Deployment Present Results Iterate ML Model
Present Results of the Refine the ML Model to
model in a way that improve
demonstrates its value
to stakeholders.
© Amit Mishra
HAPPY LEARNING