Difference between human language and computer language :-
Human language Computer Language
Human language is Machine/computer understands
made up of letters, the language ofnumbers (binary
words and sentences numbers- 0’sand 1’s). Everything
depending on the thatis sent to the machine has to
languages. be converted to numbers.
It is very easy for For machines
humans to process understanding and
andcommunicate in generatingnatural
natural languages like languages is very
English, Hindi etc. complex process.
Our brain keeps on Computer uses NLP
processing the sounds techniques like Text
that it hears around Normalisation, Bag of
itself and tries to make words to convert the
sense out of them all the text to numbers for it to
time. process.
Difference between Script bot and Smart bot :-
Script-bot Smart-bot
a. A scripted chatbot doesn’t carry even a. Smart bots are built
aglimpse of AI. onNLP and ML.
b. Script bots are easy to make Script b. Smart –bots are
botfunctioning is very limited as they comparatively difficult
are less powerful. tomake.
c. Script bots work around a script c. Smart-bots are
whichis programmed in them. flexibleand powerful.
d. No or little language processing skills e. NLP and Machine
learning skills are
required.
e. Limited functionality e. Limited functionality
Example: the bots which are deployed Example: Google
inthe customer care section of various Assistant,Alexa, Cortana,
companies Siri, etc.
UNIT-7: EVALUATION
Problem Scoping ----- > Data Acquisition ---- > Data Exploring ------ > Modelling > Evaluation.
Evaluation is the process of understanding the reliability and final performance of
any AI model by giving the test data set into the model and comparing it`s output
with actual answers.
Confusion Matrix-
1. The comparison between the results of Prediction and reality is called the
ConfusionMatrix.
2. It is a record that helps in evaluation.
3. It is not a calculation; it is a performance measurement for
machine learningclassificationproblems where output can be two or
more classes.
There are four methods to evaluate the model.
1. Define Evaluation.
Evaluation is a process of understanding the reliability of any AI model, based on
outputs by feeding the test dataset into the model and comparing it with actual
answers.
2. Which two parameters are considered for Evaluation of a model?
Prediction and Reality are the two parameters considered for Evaluation of a model.
The “Prediction” is the output which is given by the machine and the
“Reality”is the real scenario, when the prediction has been made?
3. What is True Positive?
• The predicted value matches the actual value
• The actual value was positive and the model predicted a positive value
4. What is True Negative?
• The predicted value matches the actual value
• The actual value was negative and the model predicted a negative value
5. What is False Positive?
• The predicted value was falsely predicted
• The actual value was negative but the model predicted a positive value
• Also known as the Type 1 error
6. What is False Negative?
• The predicted value was falsely predicted
• The actual value was positive but the model predicted a negative value
Two (02) Mark Questions
1. What is Accuracy? Mention its formula.
Accuracy is defined as the percentage of correct predictions out of all theobservations.
Where TP = True Positives, TN = True Negatives, FP = False Positives, and
FN = False Negatives.
2. What is Precision? Mention its formula.
Precision is defined as the percentage of true positive cases versus all the cases where
the prediction is true.
That is, it takes into account the True Positives and False Positives.
3. What is Recall? Mention its formula.
Recall is defined as the fraction of positive cases that are correctly Identified.
1. What is F1 SCORE ? Mention its formula.
F 1 Evaluation metric is more important in any case. F1 score sort maintains a
balance between the precision and recall for the classifier. If the precision is low,
the F1 is low and if the recall is low again F1 score is low.
The F1 score is a number between 0 and 1 and is the harmonic mean of
precision and recall