Skip to content

Commit

Permalink
Merge pull request #38 from eltociear/patch-2
Browse files Browse the repository at this point in the history
chore: update test_t5.ipynb
  • Loading branch information
bclavie authored Nov 4, 2024
2 parents c5b2c19 + 4632b2c commit ef30e19
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion tests/consistency_notebooks/test_t5.ipynb
Original file line number Diff line number Diff line change
Expand Up @@ -164,7 +164,7 @@
"evaluation_score = evaluate(qrels, run, 'ndcg@10')\n",
"litterature_result = 0.734 # From RankGPT Paper https://arxiv.org/pdf/2304.09542.pdf\n",
"if abs(evaluation_score - litterature_result) > 0.01:\n",
" print(f\"Score {evaluation_score:0.3f} differs by more than 0.01 from the the reported score.\")\n",
" print(f\"Score {evaluation_score:0.3f} differs by more than 0.01 from the reported score.\")\n",
"else:\n",
" print(f\"Score is within 0.01 NDCG@10 of the reported score!\")\n"
]
Expand Down

0 comments on commit ef30e19

Please sign in to comment.