RuntimeError: Internal: could not parse ModelProto from

[tibor]

Hi,

I’m using the 3.1 version from here: https://huggingface.co/meta-llama/Llama-3.1-8B/tree/main/original

However, in the app, I get this error:

> python3 -u /var/folders/tt/clc42zd11xqcv2s_bfm_mgrh0000gn/T/E31A93E4-7B56-4389-BB8E-CF728F89C11E/convert-pth-to-ggml.py /Library/Application Support/com.alexrozanski.LlamaChat/models/29BB74A1-0D4E-4BF6-85E4-130A28E81EE1/7B 1
Loading model file /Library/Application Support/com.alexrozanski.LlamaChat/models/29BB74A1-0D4E-4BF6-85E4-130A28E81EE1/7B/consolidated.00.pth
Loading vocab file /Library/Application Support/com.alexrozanski.LlamaChat/models/29BB74A1-0D4E-4BF6-85E4-130A28E81EE1/tokenizer.model

Traceback (most recent call last):
  File "/var/folders/tt/clc42zd11xqcv2s_bfm_mgrh0000gn/T/E31A93E4-7B56-4389-BB8E-CF728F89C11E/convert-pth-to-ggml.py", line 11, in <module>
    convert.main(['--outtype', 'f16' if args.ftype == 1 else 'f32', '--', args.dir_model])
  File "/private/var/folders/tt/clc42zd11xqcv2s_bfm_mgrh0000gn/T/E31A93E4-7B56-4389-BB8E-CF728F89C11E/convert.py", line 1137, in main
    vocab = load_vocab(vocab_dir)
  File "/private/var/folders/tt/clc42zd11xqcv2s_bfm_mgrh0000gn/T/E31A93E4-7B56-4389-BB8E-CF728F89C11E/convert.py", line 1081, in load_vocab
    return SentencePieceVocab(path, added_tokens_path if added_tokens_path.exists() else None)
  File "/private/var/folders/tt/clc42zd11xqcv2s_bfm_mgrh0000gn/T/E31A93E4-7B56-4389-BB8E-CF728F89C11E/convert.py", line 158, in __init__
    self.sentencepiece_tokenizer = SentencePieceProcessor(str(fname_tokenizer))
  File "/Library/Python/3.9/lib/python/site-packages/sentencepiece/__init__.py", line 468, in Init
    self.Load(model_file=model_file, model_proto=model_proto)
  File "/Library/Python/3.9/lib/python/site-packages/sentencepiece/__init__.py", line 961, in Load
    return self.LoadFromFile(model_file)
  File "/Library/Python/3.9/lib/python/site-packages/sentencepiece/__init__.py", line 316, in LoadFromFile
    return _sentencepiece.SentencePieceProcessor_LoadFromFile(self, arg)
RuntimeError: Internal: could not parse ModelProto from /Library/Application Support/com.alexrozanski.LlamaChat/models/29BB74A1-0D4E-4BF6-85E4-130A28E81EE1/tokenizer.model
/

Any idea how I could use the app?

Many thanks!