Machine Learning Specialization
Welcome
Emily Fox & Carlos Guestrin
Machine Learning Specialization
University of Washington
1
2015 Emily Fox & Carlos Guestrin
Machine Learning Specialization
Machine learning is
changing the world
2015 Emily Fox & Carlos Guestrin
Machine Learning Specialization
Old view of ML
Data
ML
Algorithm
My curve
is better
than your
curve
Write a
paper
2015 Emily Fox & Carlos Guestrin
Machine Learning Specialization
2015 Emily Fox & Carlos Guestrin
Machine Learning Specialization
Search
Retail
Movie
Distribution
Coupons
Disruptive companies
dierentiated by
Networking
INTELLIGENT
APPLICATIONS
Music
Advertising
Campaigning
using
Real Estate
Machine Learning
Human
Resources
Legal
Advice
Dating
Wearables
CRM
Taxis
2015 Emily Fox & Carlos Guestrin
Machine Learning Specialization
The machine learning pipeline
Data
ML
Method
Intelligence
2015 Emily Fox & Carlos Guestrin
Machine Learning Specialization
ML case studies
2015 Emily Fox & Carlos Guestrin
Machine Learning Specialization
Case Study 1:
Predicting house prices
ML
Regression
Method
$
$
+ house
features
8
Intelligence
$ = ??
price ($)
Data
house size
2015 Emily Fox & Carlos Guestrin
Machine Learning Specialization
Case Study 2:
Sentiment analysis
ML
Classification
Method
Data
Sushi was awesome,
the food was awesome,
but the service was awful.
Score(x) < 0
awful
All reviews:
Intelligence
Score(x) > 0
awesome
9
2015 Emily Fox & Carlos Guestrin
Machine Learning Specialization
Case Study 3:
Document retrieval
Data
ML
Clustering
Method
SPORTS
10
ENTERTAINMENT
Intelligence
WORLD NEWS
SCIENCE
2015 Emily Fox & Carlos Guestrin
Machine Learning Specialization
Case Study 4:
Product recommendation
ML
Method
Your past
purchases:
+ purchase
histories of
all
customers
11
Intelligence
Recommended
items:
Customers
Data
Products
2015 Emily Fox & Carlos Guestrin
Machine Learning Specialization
Case Study 4:
Product recommendation
Data
Your past
purchases:
ML
Matrix
Method
Factorization
Customers
features
Intelligence
Recommended
items:
features
features
+ purchase
histories of
all
customers
12
Products
features
features
features
2015 Emily Fox & Carlos Guestrin
Machine Learning Specialization
Case Study 5:
Visual product recommender
ML
Deep
Method
Learning
Data
Input images:
13
Intelligence
Layer 1
Layer 2
x1
z1
x2
Nearest neighbors:
2015 Emily Fox & Carlos Guestrin
Machine Learning Specialization
A unique ML specialization
14
2015 Emily Fox & Carlos Guestrin
Machine Learning Specialization
Not like other ML
courses out there
From use cases to
models & algorithms
15
2015 Emily Fox & Carlos Guestrin
Machine Learning Specialization
First course is about building, evaluating
and deploying intelligence in each case study
Data
Task
16
ML
Method
Model &
parameters
Intelligence
Optimization
algorithm
Evaluation
Use pre-specified
(black box)
2015 Emily Fox & Carlos Guestrin
Machine Learning Specialization
Subsequent courses provide depth in
models & algorithms, but still use case studies
2. Regression
3. Classification
4. Clustering & Retrieval
5. Matrix Factorization &
Dimensionality Reduction
6. Capstone: Build an
Intelligent Application
with Deep Learning
17
2015 Emily Fox & Carlos Guestrin
Machine Learning Specialization
2. Regression
Case study: Predicting house prices
Models
Linear regression
Regularization:
Ridge (L2), Lasso (L1)
Algorithms
Gradient descent
Coordinate descent
Concepts
18
Loss functions, bias-variance
tradeo, cross-validation, sparsity,
overfitting, model selection
2015 Emily Fox & Carlos Guestrin
Machine Learning Specialization
3. Classification
Case study: Analyzing sentiment
Models
Algorithms
Concepts
19
Linear classifiers
(logistic regression, SVMs, perceptron)
Kernels
Decision trees
Stochastic gradient descent
Boosting
Decision boundaries, MLE, ensemble
methods, random forests, CART,
online learning
2015 Emily Fox & Carlos Guestrin
Machine Learning Specialization
4. Clustering & Retrieval
Case study: Finding documents
Models
Nearest neighbors
Clustering, mixtures of Gaussians
Latent Dirichlet allocation (LDA)
Algorithms
KD-trees, locality-sensitive hashing (LSH)
K-means
Expectation-maximization (EM)
Concepts
Distance metrics, approximation
algorithms, hashing, sampling algorithms,
scaling up with map-reduce
20
2015 Emily Fox & Carlos Guestrin
Machine Learning Specialization
5. Matrix Factorization & Dimensionality Reduction
Case study: Recommending Products
Models
Collaborative filtering
Matrix factorization
PCA
Algorithms
Coordinate descent
Eigen decomposition
SVD
Concepts
21
Matrix completion, eigenvalues,
random projections, cold-start
problem, diversity, scaling up
2015 Emily Fox & Carlos Guestrin
Machine Learning Specialization
6. Capstone:
An intelligent application using deep learning
Build & deploy
a recommender using
product images and
text sentiment
22
2015 Emily Fox & Carlos Guestrin
Machine Learning Specialization
This specialization is for you if
23
2015 Emily Fox & Carlos Guestrin
Machine Learning Specialization
Level of the specialization
Motto:
tough concepts made intuitive
and applicable
minimize prereq knowledge
maximize ability to develop and deploy
learn concepts through case studies
24
2015 Emily Fox & Carlos Guestrin
Machine Learning Specialization
Target audience
Software engineer
Scientist
Data enthusiast
25
2015 Emily Fox & Carlos Guestrin
Machine Learning Specialization
Math background
Basic calculus
-Concept of derivatives
Basic linear algebra
-Vectors
-Matrices
-Matrix multiply
26
2015 Emily Fox & Carlos Guestrin
Machine Learning Specialization
Programming experience
Basic Python used
-Can pick up along the way if
knowledge of other language
27
2015 Emily Fox & Carlos Guestrin
Machine Learning Specialization
Computing needs
Basic desktop or laptop
Access to internet
Ability to:
-Install and run Python
-Store a few GB of data
28
2015 Emily Fox & Carlos Guestrin
Machine Learning Specialization
Youll be able to do
amazing things
29
2015 Emily Fox & Carlos Guestrin
Machine Learning Specialization
Our journey together
Course 1:
build intelligent
applications
30
Courses 2-5:
formulate,
implement &
evaluate
ML methods
Course 6:
design & deploy
an exciting
application
2015 Emily Fox & Carlos Guestrin
Machine Learning Specialization
The Capstone Project:
Build and deploy an intelligent
application with deep learning
31
2015 Emily Fox & Carlos Guestrin
Machine Learning Specialization
An intelligent recommender
using images & text
32
2015 Emily Fox & Carlos Guestrin
Machine Learning Specialization
We will do something even more exciting
Text
sentiment
analysis
Computer
vision
Capstone
project
Deep
learning
Recommenders
Deploy
intelligent
web app
33
2015 Emily Fox & Carlos Guestrin
Machine Learning Specialization