Climbing towards NLU:On Meaning, Form, and Understanding in the Age of Data

Discovered Dec 30, 2020: Climbing towards NLU:On Meaning, Form, and Understanding in the Age of Data <– “We argue that the language modeling task, because it only uses form as training data, cannot in principle lead to learning of meaning. We take the term language model to refer to any system trained only on the task of string prediction, whether it operates over characters, words or sentences, and sequentially or not. We take (linguistic) meaning to be the relation between a linguistic form and communicative intent.” <– my attempt at a summary: “natural language understanding” as implemented in GPT-3 and similar software is not AGI via Katherine Bailey on twitter