Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

What is the difference between SeqGAN and LM for text generation? #57

Open
guotong1988 opened this issue Mar 11, 2019 · 1 comment
Open

Comments

@guotong1988
Copy link

I'm new to LeakGAN or SeqGAN or TextGAN. I know GAN is to generate text and let discriminator un-judge-able to real text and gen-text.
LM(language model) is the task of predicting the next word and can also be used to generate text.

@guotong1988 guotong1988 changed the title What is the difference between SeqGAN and LM except GAN? What is the difference between SeqGAN and LM for text generation? Mar 18, 2019
@mathav95raj
Copy link

It is addressed in the paper in the introduction . Language models learnt in traditional maximum likelihood approach suffer exposure bias. Though there are techniques like scheduled sampling to overcome it, they do not address the problem at its roots. here an adversarial training beats that problems

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants