README.md

Lyrics Generation using Transformer

Introduction

The project aims to generate lyrics when provided a prompt to it. Transformer is used to train the model. The paper Attention Is All You Need is implemented from scratch using PyTorch.

Dataset

Dataset Link

Training

python3 main.py

Demo

For demo you can use the Demo.ipynb notebook

References

Attention Is All You Need

Karpathy Zero to Hero