ColossalAI-Examples中webtextdataset #2838
Unanswered
weiwei0519
asked this question in
Community | Q&A
Replies: 1 comment
-
|
https://github.com/hpcaitech/ColossalAI/blob/main/examples/language/gpt/titans/dataset/webtext.py |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
ColossalAI-Examples中from datasets.webtext import WebtextDataset，这个数据集在哪个package，我尝试安装了openai的dataset，和huggingface的datasets，都没有找到
Beta Was this translation helpful? Give feedback.
All reactions