OpenVino GPT-Neo

This is a port of GPT-Neo that uses OpenVino - and hopefully the Intel Neural Compressor - to run on CPU.

Installation

1. venv
2. pip install -r requirements.txt
3. python ovify.py

Run

pythong main.py

Links

For Embeddings:

• https://huggingface.co/sentence-transformers/all-mpnet-base-v2?fbclid=IwAR3yYkBren6LGyPN9ZeCa2c7l7PWlVEon2J31O5MiA8BqaZfIjncpvsM6XU

Chatbot:

• https://github.com/bborn/howdoi.ai
• https://github.com/hwchase17/chat-langchain