Blog

Notes and reviews on NLP, conversational AI, optimization, summarization, and generative models.

June 29, 2018

Generative Adversarial Network (GAN) Overview

Generative Adversarial Network (GAN) is a class of generative models. Basically generative models aim to model the underlying distribution of some data. Some models have the specific density function for the data dist...

gan review

May 30, 2018

Task-Oriented Dialog Agents Review

Task-oriented dialog agents are designed for a particular task and set up to have short conversations to get information from the user to help complete the task. Apple Siri and Google Assistant are common examples. Th...

chatbot review

May 28, 2018

Text Summarization Overview

Automatic text summarization is the task of producing a concise and fluent summary while preserving key information content and overall meaning. With the explosion of Internet, people are overwhelmed by the amount of ...

summarization review

May 08, 2018

On the Convergence of Adam and Beyond

The paper On the Convergence of Adam and Beyond was awarded as the best paper on ICLR 2018. The authors empirically observed that several popular gradient based stochastic optimization algorithms such as Adam (Kingma ...

optimization