From d67bbb34aeb01bff68a02aecb9721d992555dcea Mon Sep 17 00:00:00 2001 From: PENG Bo <33809201+BlinkDL@users.noreply.github.com> Date: Thu, 11 Jul 2024 13:19:11 +0800 Subject: [PATCH] Update README.md --- README.md | 16 ++++++---------- 1 file changed, 6 insertions(+), 10 deletions(-) diff --git a/README.md b/README.md index 0778cb2..795818a 100644 --- a/README.md +++ b/README.md @@ -2,6 +2,8 @@ RWKV homepage: https://www.rwkv.com +## Please check https://github.com/BlinkDL/ChatRWKV/blob/main/API_DEMO_CHAT.py first + ChatRWKV is like ChatGPT but powered by my RWKV (100% RNN) language model, which is the only RNN (as of now) that can match transformers in quality and scaling, while being faster and saves VRAM. Training sponsored by Stability EleutherAI :) Our latest version is **RWKV-6** https://arxiv.org/abs/2404.05892 (Preview models: https://huggingface.co/BlinkDL/temp ) @@ -38,22 +40,16 @@ Install VS2022 build tools (https://aka.ms/vs/17/release/vs_BuildTools.exe selec ``` **RWKV pip package**: https://pypi.org/project/rwkv/ **(please always check for latest version and upgrade)** -**nanoRWKV**: https://github.com/BlinkDL/nanoRWKV (does not require custom CUDA kernel to train, works for any GPU/CPU) - -https://github.com/cgisky1980/ai00_rwkv_server Fastest GPU inference API with vulkan (good for nvidia/amd/intel), supports rwkv5 +https://github.com/cgisky1980/ai00_rwkv_server Fastest GPU inference API with vulkan (good for nvidia/amd/intel) -https://github.com/cryscan/web-rwkv backend for ai00_rwkv_server, supports rwkv5 +https://github.com/cryscan/web-rwkv backend for ai00_rwkv_server -https://github.com/saharNooby/rwkv.cpp Fast CPU/cuBLAS/CLBlast inference: int4/int8/fp16/fp32, supports rwkv5 +https://github.com/saharNooby/rwkv.cpp Fast CPU/cuBLAS/CLBlast inference: int4/int8/fp16/fp32 -https://github.com/daquexian/faster-rwkv supports rwkv5 - -https://github.com/mlc-ai/mlc-llm/pull/1275 supports rwkv5 +https://github.com/JL-er/RWKV-PEFT lora/pissa/Qlora/Qpissa/state tuning https://github.com/RWKV/RWKV-infctx-trainer Infctx trainer -https://github.com/Blealtan/RWKV-LM-LoRA LoRA finetuning - **World demo script:** https://github.com/BlinkDL/ChatRWKV/blob/main/API_DEMO_WORLD.py **Raven Q&A demo script:** https://github.com/BlinkDL/ChatRWKV/blob/main/v2/benchmark_more.py