0% found this document useful (0 votes)
55 views5 pages

Chomsky's Syntactic Structures Overview

SYNTACTIC STRUCTURE 2

Uploaded by

Michelle Sison
Copyright
© All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
55 views5 pages

Chomsky's Syntactic Structures Overview

SYNTACTIC STRUCTURE 2

Uploaded by

Michelle Sison
Copyright
© All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd

Syntactic Structures by Chomsky (Summary)

07 Oct 2018

This blog is a summary of the ideas outlined in Chomsky’s Syntactic Structures.

Table of Contents

1. Language
1. Grammar
2. Phonemes and Morphemes
3. Markov Processes for language generation
4. Limitations of Phrase structure description
5. Grammatical Transformation
6. Procedure for formalizing computational linguistics
7. Explanation power of linguistics
8. Syntax and Semantics

Language
Any language L is considered to be a set of sentences. Each sentence is finite in length
and is constructed out of a finite set of elements (words). A sentence can be a
sequence of phonemes or letters in an alphabet.

Grammar
Grammar has no relation to semantic meaning of a sentence. A sentence can be
grammatically correct and not have any meaning. Since the probability of grammatically
correct and incorrect sentences occurring in a corpus of text is highly dependent on the
corpus, we cannot leverage statistics to find out if a sentence is grammatically correct or
not. (Although we know that this is not true anymore as we can build robust language
models that care capable of probabilistically generating grammatically correct
sentences).

Conclusion: Grammar is autonomous and independent of meaning, and that


probabilistic models give no particular insight into some of the basic problems of
syntactic structure.

Phonemes and Morphemes


Phonemes are smallest elements in pronunciation. Morphemes are smallest elements
in words.

Markov Processes for language generation


Chomsky talks of a finite state machine (finite state grammar) that can be used for
generation of sentences. He argues that since since English is a non-finite state
language, we cannot use a finite state machine to generate English sentences.

1. Finite state language

a[3]b[4] is finite.
2. Infinite state language

a*b* is infinite.

Similarly, the following demonstrates how English is also infinite.

Suppose S1S1, S2S2 and S3S3 are declarative sentences, we can construct
the following sentences using grammar rules.
If S1S1, then S2S2.
Either S3S3 or S4S4.
Each of the above sentence is also declarative and hence can be expanded
infinitely.

Limitations of Phrase structure description


1. If there are two sentences of the form Z + X + W and Z + Y + W, we can use the
conjunction and and construct a new sentence of the form Z-X+ and +Y-W (Only
if X and Y are constituents)

For eg,

the scene - of the movie - was in Chicago


the scene - of the play - was in Chicago
the scene - of the movie and of the play - was in Chicago
The above assumption does not hold true in the following case where X and Y are
not constituents

the - liner sailed down the - river


the - tugboat chugged up the - river
the - liner sailed down the and the tugboat chugged up the - river
The limitation in this case is that unless X and Y are constituents, we cannot apply
this grammar rule. But it is not possible to incorporate this rule in any phrase
structure grammar. Why? Because we need to know the actual form of the 2
sentences and if X and Y are constituents (for which we need to know their
values).

2. Auxilary Verbs

3. Active passive relation

“John admires sincerity” <-> “sincerity admires John”

“sincerity frightens John” <-> “John frightens sincerity”

These examples demonstrate that even though these sentences are not violating
any grammar rules, they are semantically incorrect and hence pose limitations to
the assumption that grammar does not depend on semantics. These limitations
can be overcome by having extra rules (which cannot be incorporated within the
grammar itself) over the grammar.

Grammatical Transformation
1. In order to overcome the above limitations, we can assume the grammar to have
3 levels of rules:

1. Phrase Structure

2. Transformational Structure

3. Morphophonemics

Given a sentence, we first go through the phrase structure grammar to build a


tree and get to the leaf nodes (terminal words).

We then run through the transformational structural rules (both optional and
obligatory rules) to transform the set of terminal nodes.

We then apply the morphophonemics to arrive at the final sentence.


Procedure for formalizing computational linguistics

Of the 3 approaches outlined in the diagram above, Chomsky proposes to choose the
one in which we can come to a reasonable solution to, hence evaluation. He says,
generating (discovery) of the correct grammar given a data corpus is not feasible (we
know this is not true now, because we can build language models given a huge corpus).

Explanation power of linguistics


Reason to have a separate representation for morphemes and phonemes is
demonstrated here. The phoneme sequence /eneym/ can be understood ambiguously
as both “a name” or a “an aim”.

If our grammar is only a single level system dealing with only phonemes, we have no
way of representing this ambiguity. Therefore we need a second morphological layer.

Syntax and Semantics


The three levels of parsing of grammar gives us the ability to perform the following
representations:

1. Represent sentences that can be understood in more than one way ambiguously.
2. Represent two sentences that are understood in a similar manner similarly on the
transformational level.

Chomsky argues that there cannot be any relation between semantics and grammar i.e
the burden of proof lies on the linguist claiming that the grammar should be dependent
on semantics.

Assertions supporting dependence of grammar on meaning:

1. Two utterances are phonemically distinct if and only if they differ in meanings

This is refuted because of synonyms (utterance tokens that are phonemically


different but means the same thing) and homonyms (utterance tokens that are
phonemically identical but differ in meaning)

2. Morphemes are the smallest elements that have meanings

This is refuted because morpheme such as gl- in “gleam”, “glimmer” and “glow”
does not carry any meaning in itself.

3. Grammatical sentences are those that have semantic significance

4. NP - VP -> actor-action

“the fighting stopped” has no actor-action relation

5. Verb - NP -> action-goal or action-object of action

“I missed the train” has no action-goal relation

6. Active sentence and corresponding passive sentence are synonymous

“everyone in the room knows at least two languages” is not synonymous to “at
least two languages are known by everyone in the room”

Related Posts
 Machine Learning in Production - Rendezvous Architecture 04 Oct 2020
 Common Sense Is Not So Common in NLP 02 May 2020
 Empirical Evaluation of Current Natural Language Understanding (NLU) 01 May
2020

Common questions

Powered by AI

Chomsky strongly defends the idea that grammatical correctness is autonomous from semantics, positing that grammar structures a language independently of meaning. This stance is exemplified by grammatically correct yet meaningless sentences like "Colorless green ideas sleep furiously," and meaningful sentences that defy grammatical rules. He argues that grammar's primary role is structural organization rather than conveying meaning, which differs from traditional views linking syntax tightly with semantics .

Chomsky uses active-passive sentence pairs to illustrate the semantic ambiguity and inadequacy of grammatical transformations that rely strictly on structural forms. For example, the active sentence "everyone in the room knows at least two languages" is semantically non-equivalent to its passive form "at least two languages are known by everyone in the room," illustrating that grammatical rules alone cannot capture meaning transformations .

Chomsky argues that grammar operates independently of semantics, a notion that challenges traditional perspectives which often considered a close relationship between the two. He supports this by pointing out that sentences can be grammatically correct yet semantically nonsensical, and vice versa. The independence is further highlighted through examples of synonyms and homonyms, which show phonemic and semantic variances that grammar alone cannot resolve .

Chomsky argues that phrase structure grammars fall short because they cannot handle transformations involving non-constituents and fail with sentence ambiguity and certain grammatical transformations. He demonstrates inadequacies using examples where phrase coordination does not work, like in differing sentence structures which conjunct non-constituents incorrectly, suggesting that more complex transformational grammar rules are required .

Chomsky highlights the limitations by citing examples where conjunctions fail, such as transforming "the liner sailed down the river" and "the tugboat chugged up the river" to "the liner sailed down and the tugboat chugged up the river" because "the" and "river" are not constituents of a single cohesive phrase, illustrating a lack of agreement that the transformation would require .

The transformational grammar structure involves three main components: Phrase structure to build a syntactic tree and identify terminal nodes, Transformational structure utilizing rules that transform those terminal nodes, and Morphophonemics which applies phonological changes to arrive at the final sentence form. This multi-level system allows for complex linguistic transformations and ambiguity resolution .

Chomsky asserts the necessity for distinct representations of phonemes and morphemes to address ambiguities in language. For instance, the phoneme sequence /eneym/ can represent either "a name" or "an aim." Without a morphological layer to distinguish these interpretations, a grammar system relying solely on phonemes cannot adequately handle such ambiguities .

Chomsky suggests formalizing computational linguistics by seeking an approach that adequately solves given problems, underscoring the infeasibility of discovering correct grammar merely from corpus data. This involves selecting grammatical theories based on their explanatory adequacy rather than empirical fitting to data, a perspective contrary to modern corpus-driven language modeling .

Chomsky critiques the application of Markov processes in language generation by defining English as a non-finite state language, which means it cannot be sufficiently described by a finite state machine such as a Markov process. An example he presents involves constructing complex and infinitely iterable sentences like "Either S3 or S4," illustrating how English grammar can generate structures beyond finite state capabilities .

Transformational rules are significant in Chomsky's theory as they account for the deeper syntactic structures underlying surface sentence forms. These rules transform basic syntactic structures obtained through phase structure analysis into more complex forms, facilitating transformations like active-to-passive voice or question formations which are not evident at purely structural levels .

You might also like