MODULE-1
INTRODUCTION TO NLP
Natural Language Processing
• Natural Language Processing (NLP) is a branch of AI that teaches
computers to understand, interpret, and generate human language.
• Natural language is an unstructured form. NLP bridges this gap by
allowing machines to process and understand human languages.
NLP TASK
❖Text classification
❖Word sequence Task
❖Text meaning Task
❖Sequence to sequence task
❖Dialog system
Text classification Tasks
• Representation: Bag of words (no word order)
• Goal: Predict tags,categories,sentiment
• Application: filtering spam mail
Classifying documents based on dominant content.
Word Sequence Tasks
• Representation: Sequences(order preservation)
• Goal: Language Modelling
Predict next/previous word
Text generation
• Application: Translation
Chatbots
Ner
Text meaning Task
• Representation: word vectors
• Goal: word meaning representation
Predict next/previous word
Text generation
• Application: similar word
Sentence embeddings
Topic modelling
Question answering
Sequence to Sequence Task
• Representation: Variable Length input
• Goal: Machine Translation
Summarizaation
Text generation
• Application: Encoders nd Decorders which work in complement to
find hidden representation of text and to use hidden representation.
Dialog System
• Goal Oriented: Focus on particular restricted domain
More precision
Less generalizable
Conversational: General context
Less precision
More generalization
NLP Applications
Sentiment Analysis
➢Understanding natural language can be challenging for machines,
especially when dealing with human opinions.
➢Sentiment analysis, also known as opinion mining, is an influential
application of natural language processing.
➢It involves determining the emotional tone behind words to gain an
understanding of the attitudes, opinions, and emotions expressed
within an online mention
Chatbots
• Chatbots are a form of AI that are programmed to interact with
humans.
• An AI chatbot is a computer program using Artificial Intelligence,
especially NLP and ML to understand, process, and respond to human
language in real-time, simulating natural conversations for tasks like
customer service, information retrieval.
• Chatbots streamline customer service, facilitating real-time, 24/7
communication with clients.
• They are capable of understanding customer queries, providing
immediate responses, and even resolving common issues, thereby
boosting the efficiency of customer service operations.
Smart Assistant
• Smart assistants, such as Apple’s Siri, Amazon’s Alexa, or Google
Assistant, are another powerful application of NLP.
• These intelligent systems leverage NLP to comprehend and interpret
human speech, allowing users to interact with their devices using
natural language.
• For example, a user can ask Siri about the weather, command Alexa to
play a song, or instruct Google Assistant to set an alarm, all with their
voice.
Machine Translation
• Services like Google Translate use NLP to understand grammar and
context, enabling real-time text and speech translation between
languages or text-based responses.
Email filtering
• Email filtering is another practical application of natural language
processing.
• Sophisticated email services leverage NLP to categorize, sort, and filter
emails, enhancing the user experience. This technology is used to
detect and filter out spam messages, improving the reliability and
safety of email communication.
Language Translation
• Language translation is a striking demonstration of the power of
natural language processing.
• By enabling real-time translation of text from one language to
another, NLP breaks down language barriers and facilitates global
communication.
• This technology is not limited to translating written words, it can also
transform spoken phrases into another language, making
international dialogue more accessible and effective.