[2024-08-22] Prof. Nanyun (Violet) Peng,UCLA,” Controllable and Creativity Natural Language Generation”
Titile: Controllable and Creativity Natural Language Generation
Date: 2024-08-22 14:30-15:30
Location: CSIE R104
Speaker: Prof. Nanyun (Violet) Peng,UCLA
Host: Prof. SD Lin
Abstract:
Recent advances of large language models (LLMs) have demonstrated strong results in natural language processing (NLP) applications such as dialogue systems, text classification, machine translation, and document summarization. With the improving capability of LLMs, there is a growing need for controllable generation to produce reliable and tailored outputs, especially in applications requiring adherence to specific guidelines or creativity within defined boundaries. However, the prevalent auto-regressive paradigm that trains models to predict the next word given the left-hand-side context makes it challenging to impose structural or content control/constraints on the model.
In this talk, I will present our recent work on controllable natural language generation (NLG) that transcends the conventional auto-regressive formulation, aiming to improve both reliability and creativity of generative models. We introduce controllable decoding-time algorithms that steer auto-regressive models to better conform to specified constraints. We also introduce novel insertion-based generation paradigm that goes beyond auto-regressive models. Our approach enables more reliable and creative outputs, with applications to creative generation, formality-controlled machine translation, and commonsense-compliant generation.
Biography:
Nanyun (Violet) Peng is an Associate Professor of Computer Science at the University of California, Los Angeles. She received her Ph.D. in Computer Science from Johns Hopkins University, Center for Language and Speech Processing. Her research focuses on robust and generalizable NLP techniques, with applications to creative language generation, multi-modal cross-lingual understanding, and low-resource information extraction. Dr. Peng is a recipient of the NSF CAREER Award, an NIH R01 grant, Google Research Scholar Award, Okawa Foundation Research Grant, and various federal and industrial grants. Her works have won the Outstanding Paper Award at NAACL 2022 and several Best Paper Awards at workshops, and IJCAI early career spotlight.