Skip to content
@bigscience-workshop

BigScience Workshop

Research workshop on large language models - The Summer of Language Models 21

Popular repositories Loading

  1. petals petals Public

    🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

    Python 9.2k 524

  2. promptsource promptsource Public

    Toolkit for creating, sharing and using natural language prompts.

    Python 2.7k 352

  3. Megatron-DeepSpeed Megatron-DeepSpeed Public

    Ongoing research training transformer language models at scale, including: BERT & GPT-2

    Python 1.3k 215

  4. bigscience bigscience Public

    Central place for the engineering/scaling WG: documentation, SLURM scripts and logs, compute environment and data.

    Shell 980 103

  5. xmtf xmtf Public

    Crosslingual Generalization through Multitask Finetuning

    Jupyter Notebook 516 37

  6. biomedical biomedical Public

    Tools for curating biomedical training data for large-scale language modeling

    Python 459 116

Repositories

Showing 10 of 36 repositories