Skip to content

v0.1.7: Script Preview and RoPE Scaling

Compare
Choose a tag to compare
@hiyouga hiyouga released this 18 Aug 09:39
· 2081 commits to main since this release

New features

  • Preview training script in Web UI by @codemayq in #479 #511
  • Support resuming from checkpoints by @niuba in #434 (transformers>=4.31.0 required)
  • Two RoPE scaling methods: linear and NTK-aware scaling for LLaMA models (transformers>=4.31.0 required)
  • Support training the ChatGLM2-6B model
  • Support PPO training in bfloat16 data type #551

Bug fix