Sentence Generation and Classification with Variational Autoencoder and BERT

Geeling Chau, Anshuman Dewangan, Jin-Long Huang, Keshav Rungta, Margot Wagner

GitHub Repo


  • Natural-language generation: transformation of structured data into natural language, in this case using AI techniques
  • Current SOTA: GPT-3 by OpenAI – 175 billion parameters (May 2020)
  • Problem: text generation can tend to be contradictory
  • Goal: generate text responses with different levels of contradictoriness