v0.1.7: Script Preview and RoPE Scaling
New features
- Preview training script in Web UI by @codemayq in #479 #511
- Support resuming from checkpoints by @niuba in #434 (
transformers>=4.31.0
required) - Two RoPE scaling methods: linear and NTK-aware scaling for LLaMA models (
transformers>=4.31.0
required) - Support training the ChatGLM2-6B model
- Support PPO training in bfloat16 data type #551