A Computational Theory of Prose Style for Natural Language Generation

By David D. McDonald, James Pustejovsky. 1985

In this paper we report on initial research we have conducted on a computational theory of prose style. Our theory speaks to the following major points:1. Where in the generation process style is taken into account.2. How a particular prose style is represented; what "stylistic rules" look like;3. What modifications to a generation algorithm are needed; what the decision is that evaluates stylistic alternatives;4. What elaborations to the normal description of surface structure are necessary to make it usable as a plan for the text and a reference for these decisions;5. What kinds of information decisions about style have access to.Our theory emerged out of design experiments we have made over the past year with our natural language generation system, the Zetalisp program MUMBLE. In the process we have extended MUMBLE through the addition of an additional process that now mediates between content planning and linguistic realization. This new process, which we call "attachment", provides the further significant benefit that text structure is no longer dictated by the structure of the message: the sequential order and dominance relationships of concepts in the message no longer force one form onto the words and phrases in the text. Instead, rhetorical and intentional directives can be interpreted flexibly in the context of the ongoing discourse and stylistic preferences. The text is built up through composition under the direction of linguistic organizing principles, rather than having to follow conceptual principles in lockstep.We will begin by describing what we mean by prose style and then introducing the generation task that lead us to this theory, the reproduction of short encyclopedia articles on African tribes. We will then use that task to outline the parts of our theory and the operations of the attachment process. Finally we will compare our techniques to the related work of Davey, McKeown and Derr, and Gabriel, and consider some of the possible psycholinguistic hypotheses that it may lead to.

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

Citations in the corpus

Generative Adversarial Networks (2021, neutral): “That style is the way some semantics is delivered [11].”
Controlling Linguistic Style Aspects in Neural Language Generation (2017, background): “In Pre-neural Text Generation The incorporation of stylistic aspects was discussed from very early on (McDonald and Pustejovsky, 1985).”
Survey of the State of the Art in Natural Language Generation: Core tasks, applications and evaluation (2017, background): “For example, McDonald and Pustejovsky (1985) argued that ‘prose style Is a consequence of what decisions are made during the transition from the conceptual representation level to the linguistic level’ (p. 61), thereby placing the problem within the domain of sentence planning and realisation.”
StylePTB: A Compositional Benchmark for Fine-grained Controllable Text Style Transfer (2021, methodology): “To fill this gap, we leverage research in linguistics to study formulations of styles across 4 representational categories: lexical, syntax, semantics, and thematics, that span the fundamental atomic transfers that text can undergo (McDonald and Pustejovsky, 1985; DiMarco and Hirst, 1993).”