Vision and Mission (Department)
Vision
To develop competent citizens who will be valuable contributors in the field of
Computer Engineering.
Mission
To create an environment which will stimulate research and innovation.
To provide students with comprehensive knowledge of the latest developments in
the field of Computer Engineering.
Module # 1
Introduction
CO : Students will be able to describe the field of natural language processing..
Introduction to Natural Language
Processing
► Natural language processing (NLP) is a branch of artificial intelligence
that helps computers understand, interpret and manipulate human
language.
► Natural Language Processing, usually shortened as NLP, is a branch of
artificial intelligence that deals with the interaction between
computers and humans using the natural language.
► The ultimate objective of NLP is to read, decipher, understand, and
make sense of the human languages in a manner that is valuable.
Introduction to NLP (Contd…)
History of NLP
Levels / Stages / Tasks in NLP
Knowledge in Language Processing
► Engaging in complex language behaviour requires various kinds of
knowledge of language:
► Phonetics and Phonology— knowledge about linguistic sounds.
► Morphology— knowledge of the meaningful components of words.
► Syntax— knowledge of the structural relationships between words.
► Semantics—knowledge of meaning.
► Pragmatics— knowledge of the relationship of meaning to the goals
and intentions of the speaker.
► Discourse— knowledge about linguistic units larger than a single
utterance.
Ambiguity in Natural Language
► Ambiguity can be referred as the ability of having more than one meaning
or being understood in more than one way.
► Natural languages are ambiguous, so computers are not able to understand
language the way people do.
► Different level of Ambiguity:
► Lexical Ambiguity: is the ambiguity of a single word. Eg: book.
► For eg: The word silver can be used as a noun, an adjective, or a verb.
► She bagged two silver medals.
► She made a silver speech.
► His worries had silvered his hair.
► Lexical ambiguity can be resolved by Lexical category disambiguation
i.e, parts-of-speech tagging
Ambiguity in Natural Language (Contd…)
► Syntactic Ambiguity:
► The man saw the girl with the telescope.
► It is ambiguous whether the man saw a girl carrying a telescope, or he saw her
through his telescope.
► The meaning is dependent on whether the preposition ‘with’ is attached to the
girl or the man.
► Semantic Ambiguity: This occurs when the meaning of the words
themselves can be misinterpreted.
► The car hit the pole while it was moving.
► The interpretations can be The car, while moving, hit the pole and The car hit the pole
while the pole was moving.
► The first interpretation is preferred to the second one because we have a model of the
world that helps us to distinguish what is logical (or possible) from what is not.
Ambiguity in Natural Language (Contd…)
► Discourse Ambiguity: Discourse level processing needs a shared
world or shared knowledge and the interpretation is carried out using
this context.
► The horse ran up the hill. It was very steep. It soon got tired.
► The reference of ‘it’ in the two situations cause ambiguity.
► Pragmatic Ambiguity: Pragmatic ambiguity refers to a situation
where the context of a phrase gives it multiple interpretation. One of
the hardest tasks in NLP. The problem involves processing user
intention, sentiment, belief world, modals etc.- all of which are
highly complex tasks.
► I love you too.
► This can be interpreted as
► just like you love me
► just like someone else does
► and I love someone else
Challenges in NLP
► Challenges in natural language processing frequently involve speech
recognition, natural language understanding, and natural language
generation.
► Natural-language understanding (NLU) or natural-language
interpretation (NLI) is a subtopic of natural-language processing in
artificial intelligence that deals with machine reading
comprehension.
► NLU is the post-processing of text, after the use of NLP algorithms
(identifying parts-of-speech, etc.), that utilizes context, to discern
meaning of fragmented and run-on sentences to execute an intent.
► Natural-language generation (NLG) is a software process that
transforms structured data into natural language