Skip to content

hrushik98/llama-2-finetune

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

18 Commits
 
 
 
 
 
 
 
 

Repository files navigation

llama-2-finetune: Finetune Llama 2 7b Model

Step-by-step Guide

  1. Prepare Your Dataset

    Make sure your dataset has ONLY two columns: 'Human' and 'Assistant'.

  2. Upload the Dataset to Google Drive

    • Upload the dataset to your Google Drive.
    • Click on the "Share" button for the uploaded file and change the access to "edit" for "Anyone with the link."
    • Copy the link to the file.

    Screen Shot 2023-07-25 at 10 01 31 AM

  3. Clone the Repository

    Run the following command to clone the llama-2-finetune repository:

    !git clone https://github.com/hrushik98/llama-2-finetune.git 
  4. Install Dependencies

Change the current directory to llama-2-finetune and install the required dependencies with the following commands:

    %cd llama-2-finetune/
    !pip install -r requirements.txt    
  1. Start Finetuning

Run the finetune.py script with your dataset link as an argument:

!python3 finetune.py "<dataset_link>"  

Infererence of the finetuned model

  1. !python3 infer.py "<prompt>"

Time to Download the weights

  1. Download the weights from the "outputs" folder

    Screen Shot 2023-07-25 at 3 13 24 PM

About

Finetune llama 2 7b

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages