0% found this document useful (0 votes)
5 views4 pages

Deep Learning Overview and Models

Deep Learning allows software to learn complex tasks from large datasets, primarily using Artificial Neural Networks (ANN) and Convolutional Neural Networks (CNN). ANN mimics the human brain to automatically extract features and is useful for tasks like image recognition and predictive analysis, while CNN specializes in processing visual data by automatically identifying important features. Both models involve multiple layers that process data and adjust parameters through feedback to improve performance.

Uploaded by

ifrazkhan214
Copyright
© All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
5 views4 pages

Deep Learning Overview and Models

Deep Learning allows software to learn complex tasks from large datasets, primarily using Artificial Neural Networks (ANN) and Convolutional Neural Networks (CNN). ANN mimics the human brain to automatically extract features and is useful for tasks like image recognition and predictive analysis, while CNN specializes in processing visual data by automatically identifying important features. Both models involve multiple layers that process data and adjust parameters through feedback to improve performance.

Uploaded by

ifrazkhan214
Copyright
© All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd

Chapter 2 Notes

Deep Learning

Deep Learning
Deep Learning enables software to train itself to perform complex tasks with vast amounts of data. In
deep learning, the machine is trained with huge amounts of data and can learn very complex patterns
from data and give better results than simpler machine learning models.

There are two types of Deep Learning models - Artificial Neural Networks (ANN) and Convolution Neural
Network (CNN).

Neural Networks
Neural networks are loosely modelled after how neurons in the human brain behave. A neural network
is essentially a system of organizing machine learning algorithms to perform certain tasks. It is a fast and
efficient way to solve problems for which the dataset is very large, such as in images.
Neural Network consists of multiple layers. The first layer is called the Input layer and is responsible for
receiving input data. It does not perform any processing, but acquires data and passes it on to the next
layer. The second layer is called the Hidden layer, and are not directly accessible to the user. This is
where the actual processing takes place. There may be multiple hidden layers in a deep neural network.
The hidden layers perform computations using weights and biases on each node. Each node in these
hidden layers has its own machine learning algorithm or a mathematical function that applies to the
data received from the previous layer. The output generated by each node in the hidden layers is then
passed on to the next hidden layer and finally to the final layer called the Output layer. The output layer
provides the final result or prediction to the user.
The neural network then compares the predicted output with the actual desired output and calculates
the difference between them. With each try, the weights are adjusted based on the error found
between the desired output and the network output. This feedback process is repeated multiple times,
adjusting the network’s parameters after each iteration, till the desired level of performance is
achieved.

Artificial Neural Networks (ANN)


Artificial Neural networks are modelled on the human brain and nervous system. They are able to
automatically extract features without input from the programmer. Every neural network node is
essentially a machine learning algorithm. It is useful when solving problems for which the data set is
very large.

Perceptron
A Perceptron is the simplest type of neural unit or a neuron. It takes multiple inputs, applies weights
and biases, sums them up and passes the result or output to the next neuron. A perceptron consists of:
• Inputs (x1, x2, ….)
• Weights (w1, w2, ….)
• Bias (b)
• Summation function, z = w1x1 + w2x2 + ….. + b
• Activation function applies a threshold to decide the output of y=f(z)

For example, you want to go out to the park today. The following are the possible factors that may
influence your decision whether to go out or not. Not all factors are equal; some factors are more
important, while some are not.
In this example, we have four inputs. So, let’s draw the perceptron with four inputs (from X1 to X4).
Next, we have their weights (from W1 to W3). Then, we also have the bias B, with weight WB. Finally,
we sum them all up, compare with the threshold, and we will get our output.

The values for the weights come from experience or personal preference. A person may have an
experience being sunny now would most likely mean a bright day ahead, or he may judge a particular
factor like the weather forecast, more heavily as compared to another person. The values for WB are
also based on personal preference. If a person is more cautious, he may set the value for WB to be
higher, while a person who is more daring will have a lower WB. In this example, we choose 4 as we
want to be more cautious. The ‘yes’ and ‘no’ is converted to numbers 1 and 0. The threshold is set as 0.
From this calculation, the output is 0.5. Since this is higher than the threshold, the result is I will go out
to the park.
Applications of ANN
• Image and Speech recognition – ANN can analyse and interpret images and speech to recognize
objects, faces, speech commands, etc.
• Natural Language processing – ANN enable applications like language translation, chatbots,
voice assistants and sentiment analysis.
• Predictive analysis – ANN is used to make predictions about future trends like stock market
prices, weather forecasting, or disease outbreak predictions.
• Recommendation systems – ANN analyses large amounts of data and provides personalized
recommendations for products, movies, music or content based on user preferences and
behaviour.

Convolutional Neural Network (CNN)


Convolutional Neural Networks are designed to work with images, videos and other visual data. The
CNN model uses special layers called convolutional layers to automatically extract features from image
data. It is a deep learning algorithm which can take in an input image, assign importance (learnable
weights and biases) to various features in the image and be able to differentiate one from the other.

For example, consider a program to recognise different types of handwritten text like letters and digits.
In normal supervised learning model, you will have to mention every detail of the text like thickness of
the text, stroke, curvature, etc. This is very difficult, time-consuming and error-prone. CNN uses layers
that can extract key features from the images and analyses each feature to understand what makes ‘a’
different from ‘b’. When the CNN is presented with a new handwritten image, it classifies it as a letter
or digit.

CNN is used for diagnosing diseases from medical imaging, automatic number plate recognition, etc.

Common questions

Powered by AI

Artificial Neural Networks (ANN) and Convolutional Neural Networks (CNN) serve different purposes within deep learning due to their distinct architectures. ANNs are general-purpose models that consist of layers composed of perceptrons, which are suitable for processing structured data. They are extensively used in applications such as predictive analysis, language processing, and recommendation systems due to their ability to handle large datasets and automatically extract complex features without explicit programming . CNNs, on the other hand, are specialized for handling visual data, including images and videos. They incorporate convolutional layers that automatically extract spatial hierarchies of features, making them particularly well-suited for image and pattern recognition tasks such as diagnosing diseases from medical imaging and automatic number plate recognition . The primary difference lies in CNN’s ability to preserve spatial relationships between pixels, which is crucial for visual data, whereas ANNs lack this specific spatial feature extraction capability .

In the perceptron model, the activation function is pivotal as it determines the perceptron's output based on its inputs and their respective weights. Specifically, the activation function applies a threshold criterion to the weighted sum of input features and a bias term . This process transforms complex input data into a decision, thereby enabling non-linear decision boundaries. As a result, activation functions directly impact the perceptron's ability to classify inputs accurately by deciding whether the inputs' combined weighted sum is above a certain threshold, leading to a binary output, typically 0 or 1. Such functionality is essential for tasks like binary classification where ‘yes’ and ‘no’ decisions need clear delineation .

Convolutional Neural Networks (CNN) differentiate between distinct features in image data through convolutional layers that apply filters to the input images. Each filter used in a convolutional layer processes the image by sliding across it, performing a mathematical operation known as convolution. This process produces feature maps that highlight different aspects of the input, such as edges or textures . The resultant feature maps from different filters capture various spatial hierarchies and patterns within the image. These patterns are then processed through pooling layers that down-sample the feature maps, preserving only the most significant features while discarding redundant information, thus enabling the network to focus on distinguishing essential attributes like curves and shapes that differentiate one object from another. This hierarchical feature extraction process allows CNNs to efficiently differentiate between and classify complex image data .

Convolutional Neural Networks (CNN) outperform other models in applications involving image and video data due to their ability to efficiently extract spatial hierarchies of features. Practical examples include medical imaging diagnostics, where CNNs can accurately identify patterns and anomalies within complex imaging data, as well as automatic number plate recognition, which requires fine-grained analysis of visual patterns . CNNs excel in these domains because their convolutional layers can learn position-invariant features, reducing the need for manual feature extraction and enabling more efficient, accurate analysis and classification of multifactorial visual data compared to traditional models or basic ANNs that lack specialized image processing capabilities .

In a perceptron model, weights and biases are critical components that influence the decision-making process. Weights are assigned to each input feature, determining their importance in the final summation that the perceptron computes . By adjusting these weights, the model can prioritize certain inputs over others based on learned data patterns. Biases provide a way to adjust the output independently of the input values, allowing the activation function's threshold to be re-centered, thereby stabilizing the decision boundary . Together, the weights and biases help the perceptron decide whether the aggregated input values surpass a pre-defined threshold, resulting in a binary decision output like ‘yes’ or ‘no’ .

Recommendation systems utilize Artificial Neural Networks (ANN) to deliver personalized experiences by analyzing user data to identify patterns and preferences. ANNs are adept at processing extensive data sets to extract relevant features that inform recommendations. They harness layers of interconnected nodes to model complex user behavior and capture subtle preferences from historical data . By learning user interactions and feedback over time, ANNs personalize suggestions by associating products, movies, or music with user profiles, improving their predictive capacity for what users might prefer or need next. This personalized recommendation process is effective due to the ANN's ability to automatically learn features and relationships from the data without manual intervention, thus continuously refining personalization strategies to enhance user satisfaction .

Neural networks, particularly deep ones, consist of multiple layers that enable them to learn and represent complex patterns by leveraging their structure of interconnected nodes. Unlike simpler machine learning models that require manual feature extraction, neural networks automatically learn features from raw data through their multiple hidden layers. Each layer in the network processes the data with weights and biases, progressively transforming the input data into more abstract shapes until it reaches the output layer . This layered approach allows neural networks to perform hierarchical representations of the data, which are crucial for capturing the intricacies and variabilities within the data, such as non-linear patterns that simpler models may miss.

Hidden layers in a neural network function similarly to the neurons in the human brain, where both are responsible for processing and transforming input information to yield meaningful outputs. In human brains, neurons transmit electrical signals to perform cognitive tasks; similarly, in neural networks, hidden layers process input data by adjusting weights and applying non-linear transformations through activation functions . Each hidden layer allows for a deeper abstraction and extraction of features, analogous to how neural signals in the brain might integrate complex information from various sensory inputs to inform decisions or actions. Thus, while artificial, hidden layers mimic certain aspects of cognitive processing inherent in biological neural networks by developing layered representations of data that facilitate learning .

Neural networks adjust weights via a process called backpropagation, which is crucial for learning. During each iteration, the network's output is compared with the desired output, and the error is calculated. This error is used to adjust the weights of the network to minimize the error in future predictions. The learning algorithm adjusts the weights by computing the gradient of the error concerning each weight and using this gradient to slightly modify each weight. This process is repeated iteratively, gradually adjusting the weights and improving the accuracy of the network’s predictions until a satisfactory level of performance is achieved .

Feedback processes in neural networks, primarily through backpropagation, are crucial for iterative improvement of the model's accuracy and efficiency. Backpropagation involves adjusting the weights and biases based on the calculated error between the predicted output and the actual desired output. By propagating this error backward through the network, each layer updates its parameters to reduce the discrepancy in subsequent predictions . This iterative refinement process is essential because it enables the network to progressively minimize the error across its weights, facilitating learning. By continuously fine-tuning the network's parameters with each training sample, the feedback mechanism ensures the model adapts to complex patterns, thereby improving its predictive performance over time .

You might also like