v2.6.0
PaddleNLP 2.6 正式版本：全新升级，迈进大模型时代！
我们很高兴宣布，PaddleNLP 2.6版本现已全新升级并正式发布！此次升级标志着我们正式迈入了大模型时代。在PaddleNLP 2.6版本中，我们推出了全新的飞桨大语言模型全流程工具链。这套工具链涵盖了预训练、精调、压缩、推理以及部署等环节，为用户提供了一个完整的端到端大模型解决方案。
我们的工具链全面支持LLaMA 1/2, BLOOM, ChatGLM 1/2, GLM, OPT等主流大模型。这使得用户可以在使用同一套工具的前提下，以低成本的方式尝试各种不同的大模型。
为了支持这套大模型工具链，我们进行了大量的底层和基础框架侧的升级：
- 我们将Trainer API升级成为了4D并行分布式Trainer，这让模型的训练过程变得更加高效。
- 我们实现了高效微调算法LoRA/Prefix Tuning，使得单机可以精调千亿级别的模型。
- 同时，我们还依托PaddleSlim的自研量化算法，在所有支持的大模型上全面实现了无损量化。
这些升级都是为了让我们的用户能在大模型时代中更加轻松地进行模型的训练、优化和部署。我们期待你的试用，并期待你的反馈，让我们一起推进PaddleNLP的发展。在2.5版本到2.6版本中PaddleNLP有 40 位新增Contributors，感谢大家对PaddleNLP开源工作的支持！
New Contributors
- @zws-2019 made their first contribution in #5167
- @qiuwenbogdut made their first contribution in #5098
- @kuizhiqing made their first contribution in #5347
- @46319943 made their first contribution in #5419
- @jiaohuix made their first contribution in #5465
- @kangguangli made their first contribution in #5438
- @vivienfanghuagood made their first contribution in #5563
- @zhiboniu made their first contribution in #5470
- @cyber-pioneer made their first contribution in #5598
- @invokerbyxv made their first contribution in #5622
- @megemini made their first contribution in #5658
- @zhenyun-li made their first contribution in #5683
- @solrex made their first contribution in #5736
- @nemonameless made their first contribution in #5487
- @Yulv-git made their first contribution in #5709
- @wangxinxin08 made their first contribution in #5773
- @AlphaHinex made their first contribution in #5815
- @houj04 made their first contribution in #5820
- @Joker1718 made their first contribution in #5816
- @pkuzyc made their first contribution in #5538
- @jadepeng made their first contribution in #5841
- @KB-Ding made their first contribution in #5886
- @parap1uie-s made their first contribution in #5775
- @zirui made their first contribution in #5866
- @GOH-Gu made their first contribution in #5951
- @yangjianfengo1 made their first contribution in #6069
- @zhangting2020 made their first contribution in #5922
- @rogerserper made their first contribution in #6192
- @wtmlon made their first contribution in #6258
- @qingzhong1 made their first contribution in #6251
- @BeingGod made their first contribution in #6307
- @zhiqiu made their first contribution in #6347
- @DesmonDay made their first contribution in #6435
- @cyk1337 made their first contribution in #6447
- @lxp521125 made their first contribution in #6491
- @littsk made their first contribution in #6425
- @RachelXu7 made their first contribution in #6572
- @wanghuancoder made their first contribution in #6539
- @DrownFish19 made their first contribution in #6570
- @GhostScreaming made their first contribution in #6673
Full Changelog: v2.5.2...v2.6.0
Contributors
AlphaHinex, solrex, and 38 other contributors