


1.1 Symbolic Representation of Language 1.1.1 Symbolic Structures of Language



Category | English | Chinese |
Character | A letter (e.g., 'a', 'b', 'c') has no meaning by itself. | A character (e.g., '水', '火', '学') often has meaning by itself. |
Morpheme | The smallest meaningful unit (e.g., 'un-', 'run', '-ing'). | A character or a combination of characters that carries meaning (e.g., '学' in '学习', '化' in '现代化'). |
Word | A combination of morphemes that forms a complete meaning (e.g., 'running', 'unhappy'). | Usually a compound word combining multiple morphemes (e.g., '电脑' from '电' + '脑'). |

Category | Definition | English Examples | Chinese Examples |
Word | A combination of morphemes forming a meaningful unit. | 'computer', 'running' | '电脑' , '跑步' |
Chunk | A group of words forming a meaningful phrase but not a full sentence. | 'the big house', 'eating lunch' | '漂亮的房子', '吃午饭' |
Sentence | A complete grammatical structure expressing a full thought. | 'I am reading a book.' | '南京市长江大桥' |

Category | Definition | Note |
Sentence | A complete grammatical structure expressing a full thought. | |
Paragraph | A collection of related sentences forming a coherent unit. | Sentences in it are related and not independent. |
Document | A structured collection of paragraphs forming a complete text. | Paragraphs in it are related and not independent. |
Corpus | A large collection of documents used for linguistic or computational analysis. | The documents are generally considered independent. |


1.1 Symbolic Representation of Language 1.1.2 History of Symbolic Language Representation







Theory | View on Surface Expression | View on Underlying Meaning | Key Mechanism of Mapping | Example |
Structuralism (Saussure, 1916) | Words and grammar are part of a structured system of signs. | Meaning comes from differences between signs, not direct reference to reality. | Signifier (word form) ↔ Signified (concept) | The word “dog” means “dog” not because of an inherent property, but because it differs from “cat”. |
Generative Grammar (Chomsky, 1957) | Sentences have surface structure (what we see) and deep structure (abstract rules). | Deep structure captures core meaning, independent of syntax. | Transformational rules convert deep structure → surface structure. | “John saw Mary” vs. “Mary was seen by John” have different syntax but same deep meaning. |
Dependency Grammar (Tesnière, 1959) | Words are connected by dependency relations (head-modifier structure). | Meaning is derived from syntactic relations rather than linear order. | Dependency trees capture who does what to whom. | “The cat chased the mouse” → “chased” is the head, “cat” is subject, “mouse” is object. |
Abstract Meaning Representation (AMR, 2010s) | Surface syntax varies, but core meaning is a graph. | Meaning is a directed graph of concepts and relations. | Sentences are mapped into AMR graphs. | “She wants to buy a car” → (w / want-01 :arg0 (s / she) :arg1 (b / buy-01 :arg1 (c / car))) |
Open Information Annotation (OIA, 2020s) | Language can be expressed as Predicate/Function/Arguemnt structure; | Meaning is relationships among entities and facts. | Sentences are mapped into OIA Graphs; | “She buy a car” → (buy) –arg1->(She) -arg2->(a car) |

1.1 Symbolic Representation of Language 1.1.3 Case Studies













































Type | Description | Example |
Causal Relations (因果关系) | One sentence (cause) leads to another (effect). | “It rained heavily. The streets got flooded.” (Cause → Effect) |
- Result (结果关系) | The second sentence is a direct consequence of the first. | “She studied hard. She passed the exam.” |
- Reason/Explanation (原因关系) | The second sentence explains the first. | “He left early because he was feeling sick.” |
Temporal Relations (时间关系) | One event happens before, after, or at the same time as another. | “She woke up. Then she made coffee.” |
- Sequential (顺序关系) | One event follows another. | “He finished work. Then he went home.” |
- Simultaneous (同时关系) | Two events happen at the same time. | “She was cooking while he was reading.” |
Contrastive Relations (对比关系) | The two segments express opposite ideas. | “She likes tea. He prefers coffee.” |
- Contrast (对照关系) | Highlights a clear opposition. | “She loves winter, but I hate it.” |
- Concession (让步关系) | Acknowledges one idea but presents another contradicting it. | “It was raining, but they still went out.” |
Additive Relations (添加关系) | The second segment adds more information. | “She speaks English. She also knows French.” |
- Elaboration (详细说明关系) | The second sentence expands on the first. | “He bought a car. It’s a red Tesla.” |
- Parallel (并列关系) | The two segments describe similar ideas. | “She enjoys hiking. He likes running.” |
Attribution Relations (引述关系) | One sentence attributes an action or statement to someone. | “The professor said that the exam would be postponed.” |
- Statement (陈述关系) | Reporting an assertion. | “Experts claim that AI will change the world.” |
- Question (提问关系) | Reporting a question. | “She asked if I could help her.” |
Condition & Hypothetical Relations (条件关系) | Expresses a condition that affects an outcome. | “If you study hard, you will pass the exam.” |
- Conditional (条件关系) | Explicit “if-then” condition. | “If it rains, we will cancel the trip.” |
- Hypothetical (假设关系) | A condition that is unlikely or speculative. | “If I were rich, I would travel the world.” |
Purpose & Means Relations (目的与手段关系) | Expresses a goal and the method to achieve it. | “He left early to catch the train.” |
- Purpose (目的关系) | The second sentence explains the goal of the first. | “She trains daily to become a professional athlete.” |
- Means (手段关系) | The second sentence describes how something is achieved. | “He solved the problem by using an equation.” |


1.1 Symbolic Representation of Language 1.1.4 Obtaining Symbolic Representations













Feature | Penn Treebank (PTB) | Universal Dependencies (UD) | OntoNotes |
POS Tagging | ✅ Yes | ✅ Yes | ✅ Yes |
Constituency Trees | ✅ Yes | ❌ No | ✅ Yes |
Dependency Parsing | ❌ No | ✅ Yes | ❌ No |
Named Entities (NER) | ❌ No | ❌ No | ✅ Yes |
Coreference | ❌ No | ❌ No | ✅ Yes |
Semantic Role Labeling | ❌ No | ❌ No | ✅ Yes |
Word Sense Disambiguation (WSD) | ❌ No | ❌ No | ✅ Yes |
Multilingual | ❌ No | ✅ Yes | ✅ Yes (Eng, Chi, Ara) |



























1.1 Symbolic Representation of Language 1.1.5 Suggested Readings



