Skip to content

0.10.7
Compare
Choose a tag to compare
@wenzhe-log10 wenzhe-log10 released this 08 Aug 17:32
· 61 commits to main since this release
0.10.7
0002a75
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

What's Changed

Log19 CLI

  • allow benchmark_models --id to take a json file of completion ids by @wenzhe-log10 in #250
    Example:
log10 completions benchmark_models --ids list_comp_ids.json --models=gpt-4o-mini -f benchmark_summ_test_gpt4o_mini.jsonl

JSON file examples:

[
    "545ab06c-07b0-4720-bce8-68df8201dbcc",
    "c01e663f-cd8a-4cd8-8aa8-6b6ef8966b4d",
    "c450eb50-5e0f-4bcc-9faf-3a1d4183f41a"
]

Full Changelog: 0.10.6...0.10.7

Contributors

wenzhe-log10
Assets 2
Loading