Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Implement a Colab to use Gemma models with llama.cpp #51

Merged
merged 8 commits into from
Sep 27, 2024
Merged

Implement a Colab to use Gemma models with llama.cpp #51

merged 8 commits into from
Sep 27, 2024

Conversation

kinarr
Copy link
Contributor

@kinarr kinarr commented Sep 25, 2024

  • Adds a Colab notebook to demonstrate using Gemma models with the llama.cpp python bindings library
  • Fixes a typo and renames the Llamafile Colab (Using_Gemma_with_Lllamafile.ipynb → Gemma/Using_Gemma_with_Llamafile.ipynb)

@kinarr
Added LlamaCpp Colab and fix filename for the Llamafile Colab
4d496ce 
- Adds a demo notebook to demonstrate  Gemma 2 models using the llama-cpp-python library
- Fixes the filename for the Llamafile notebook
@kinarr
Add entry to README and remove it from the WISHLIST
0a51860
@kinarr
Tidy up notebook using nbfmt and nblint
e9a728a
@review-notebook-app Review Notebook App
Copy link

Check out this pull request on  ReviewNB

See visual diffs & provide feedback on Jupyter Notebooks.

Powered by ReviewNB

@kinarr
Fix GPU support for llama-cpp-python
d905fda 
A version needs to be specified explicitly so that the right .whl file is used for installation
@windmaple windmaple merged commit 0259d0a into google-gemini:main Sep 27, 2024
2 of 3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@windmaple windmaple windmaple left review comments

Assignees
No one assigned
Labels
status:awaiting review
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@kinarr @windmaple