Merge pull request #6 from ai16z/main

merge from main
elizaOS · Oct 28, 2024 · 90f8574 · 90f8574
2 parents e96764a + 9a456bb
commit 90f8574
Showing 1 changed file with 5 additions and 0 deletions.
diff --git a/README.md b/README.md
@@ -80,6 +80,11 @@ npx --no node-llama-cpp source download --gpu cuda
 
 Make sure that you've installed the CUDA Toolkit, including cuDNN and cuBLAS.
 
+## Running locally
+Add XAI_MODEL and set it to one of the above options from [Run with
+Llama](#run-with-llama) - you can leave X_SERVER_URL and XAI_API_KEY blank, it
+downloads the model from huggingface and queries it locally
+
 # Cloud Setup (with OpenAI)
 
 In addition to the environment variables above, you will need to add the following: