MACHINE LEARNING
Introduction:
ML is a branch of artificial intelligence:-
• [Link] computing based systems to make sense
out of data extracting patterns , fitting data to
functions ,etc.
• [Link] bridges in theoretical computer
science and real noise data.
• [Link] is a field of AL that uses algorithms to teach
machines to learn from data and performs tasks
without explicit instructions.
NEED OF MACHINE LEARNING
ML PROCESS:-
PROBLEM EXPLORATION:-
First focus on how the model will be used. In the
process, assess the desired model accuracy and explore
other details, such as if false positives are worse than
false negatives. This phase also includes understanding
what data might be available.
Define Success: Define the problem to be solved. For
example, what should be predicted. This helps define
what data will be needed. Also, make sure it’s clear how
success will be measured.
Evaluate Data: Determine what are the relevant data
sources. In other words, evaluate what data the team
will need, how that data is collected, and where the data
is stored.
DATA ENGINEERING:-
Design and build data pipelines. These pipelines get, clean and
transform data into a format that is more easily used to build a
predictive model. Note that this data might be coming from
multiple data sources, so merging the data is also a key aspect of
data engineering. This is often where the most time is spent in an
ML project.
Obtain Data: Assembling the data. This includes connecting to
remove data stored and databases, which might be in different
formats. For example, some data might be in CSV format, and other
data could be available in JSON via web services.
Scrub Data: The process of re-formatting particular attributes and
correcting errors in data, such as missing values imputation.
Datasets are often missing values, or they may contain values of the
wrong type or range. Cleaning can include removing duplicates,
correcting errors, dealing with missing values, normalization, and
handling data type conversions.
MODEL ENGINEERING:-
This is the phase that most people associate with building a machine learning model.
During this phase, data is used to train and evaluate the model. This is often an iterative
task, where the different models are tried, and the model is tuned.
Select & Train Model: The process of identifying an appropriate model, and then
building / training the model (on training data). The goal of training is to answer a
question or make a prediction correctly as often as possible.
Test Model: Run the model on data that the model has not yet seen (such as testing
data). In other words, perform model testing by using data that was withheld from
training (i.e., backtesting).
Evaluate & Interpret Model: Objectively measure the performance of the model. Note
that basic evaluation explores metrics such as accuracy and precision, to determine if
the model is useable, and which model is best for the specific problem being explored.
This evaluation also includes an understanding of when the model makes mistakes.
More generally, validating the trained model helps to ensure the model meets original
organizational objectives before the ML model is put into production.
Tune Model: This step refers to parameter tuning, which, depending on the model
being used, can be more an art than a science. In short, models typically have
parameters (i.e., dials for tuning the model), which allows the model to get improved
performance via parameter refinement. Simple model parameters may include
attributes such as the number of training steps and the initialization of certain values.
ML OPS:-
Broadly defined, machine learning operations (ML Ops)
spans a wide set of practices, systems, and responsibilities
that data scientists, data engineers, cloud engineers, IT
operations, and business stakeholders use to deploy, scale,
and maintain machine learning solutions.
Deploy Model: Package and put the model to use (i.e.,
into production). While this varies from one group to
another, the team needs to understand the expected model
performance, how the model will be monitored, and in
general, key performance indicators (KPIs) of the model.
Monitor Model: Maintain the model in production. This
includes monitoring the KPIs and proactively working to
ensure stable and robust predictions.
CONCLUSION:-
Machine learning is a subset of AI
Machine learning is a subset of AI, along with deep learning and
neural networks. AI processes data to make predictions and
decisions, while machine learning algorithms use that data to learn
and improve without additional programming.
Machine learning is best suited for large amounts of data
Machine learning is most effective when there is a large amount of
data, such as sensor logs, ATM transactions, or customer
conversation recordings.
Machine learning can automate decision-making
Machine learning can automate decision-making or provide insight
in situations where humans might not be able to.
Machine learning is used in many industries
Machine learning and AI are used in many industries, including
finance, e-commerce, and customer service