-
Notifications
You must be signed in to change notification settings - Fork 2.6k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Multiple evals not found #1379
Comments
Hello, you need to specify 2 completion functions to make this eval work: It works for me at least. |
Unfortunately that still doesn't work for me. Did you change anything else too? |
Did you pull the git lfs files? Is your main branch up to date? |
I now get this issue after it starts running: UnicodeEncodeError: 'latin-1' codec can't encode character '\u2019' in position 7: ordinal not in range(256) |
That I have no clue about, I'd say reinstall, repull the files, etc |
Describe the bug
When running evals such as the steganography eval, I get: AssertionError: Eval steganography.yaml not found
To Reproduce
Install and set up everything according to the documentation
oaieval gpt-3.5-turbo steganography
Code snippets
No response
OS
macOS
Python version
Python 3.9
Library version
main
The text was updated successfully, but these errors were encountered: