Deep learning vs.
machine learning
Thanks to pop culture depictions from 2001: A Space Odyssey to The Terminator, many of us
have some conception of AI. Oxford Languages defines AI as “the theory and development of
computer systems able to perform tasks that normally require human intelligence.” Britannica
offers a similar definition: “the ability of a digital computer or computer-controlled robot to perform
tasks commonly associated with intelligent beings.”
Machine learning and deep learning are both types of AI. In short, machine learning is AI that
can automatically adapt with minimal human interference. Deep learning is a subset of machine
learning that uses artificial neural networks to mimic the learning process of the human brain.
Take a look at these key differences before we dive in further.
Machine learning Deep learning
A subset of AI A subset of machine learning
Can train on smaller data sets Requires large amounts of data
Requires more human intervention to Learns on its own from environment and
correct and learn past mistakes
Shorter training and lower accuracy Longer training and higher accuracy
Makes simple, linear correlations Makes non-linear, complex correlations
Can train on a CPU (central processing Needs a specialized GPU (graphics
unit) processing unit) to train
What is artificial intelligence (AI)?
At its most basic level, the field of artificial intelligence uses computer science and data to
enable problem solving in machines.
While we don’t yet have human-like robots trying to take over the world, we do have examples of
AI all around us. These could be as simple as a computer program that can play chess, or as
complex as an algorithm that can predict the RNA structure of a virus to help develop vaccines.
For a machine or program to improve on its own without further input from human programmers,
we need machine learning.
Deep Blue, the chess-playing computer
Before the development of machine learning, artificially intelligent machines or programs
had to be programmed to respond to a limited set of inputs. Deep Blue, a chess-playing
computer that beat a world chess champion in 1997, could “decide” its next move based
on an extensive library of possible moves and outcomes. But the system was purely
reactive. For Deep Blue to improve at playing chess, programmers had to go in and add
more features and possibilities.
What is machine learning?
Machine learning refers to the study of computer systems that learn and adapt
automatically from experience without being explicitly programmed.
With simple AI, a programmer can tell a machine how to respond to various sets of instructions
by hand-coding each “decision.” With machine learning models, computer scientists can “train” a
machine by feeding it large amounts of data. The machine follows a set of rules—called
an algorithm—to analyze and draw inferences from the data. The more data the machine parses,
the better it can become at performing a task or making a decision.
Here’s one example you may be familiar with: Music streaming service Spotify learns your music
preferences to offer you new suggestions. Each time you indicate that you like a song by
listening through to the end or adding it to your library, the service updates its algorithms to feed
you more accurate recommendations. Netflix and Amazon use similar machine learning
algorithms to offer personalized recommendations.
IBM Watson, the machine learning cousin of Deep Blue
In 2011, IBM Watson beat two Jeopardy champions in an exhibition match using
machine learning.
Watson’s programmers fed it thousands of question and answer pairs, as well as
examples of correct responses. When given just an answer, the machine was
programmed to come up with the matching question. If it got it wrong, programmers
would correct it. This allowed Watson to modify its algorithms, or in a sense “learn” from
its mistakes.
By the time Watson faced off against the Jeopardy champions, in a matter of seconds, it
could parse 200 million pages of information and generate a list of possible answers,
ranked by how likely they were to be right—even if it had never seen the particular
Jeopardy clue before.
Read more: Is Machine Learning Hard? A Guide to Getting Started
What is deep learning?
Where machine learning algorithms generally need human correction when they get something
wrong, deep learning algorithms can improve their outcomes through repetition, without human
intervention. A machine learning algorithm can learn from relatively small sets of data, but a deep
learning algorithm requires big data sets that might include diverse and unstructured data.
Think of deep learning as an evolution of machine learning. Deep learning is a machine
learning technique that layers algorithms and computing units—or neurons—into what is
called an artificial neural network. These deep neural networks take inspiration from the
structure of the human brain. Data passes through this web of interconnected algorithms in a
non-linear fashion, much like how our brains process information.
Figure 1