Skip to content

Issues: confident-ai/deepeval

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

127 Open 213 Closed
127 Open 213 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Verbose printing goes into infinite loop in notebook help wanted Extra attention is needed
#1363 opened Feb 14, 2025 by penguine-ip
Regression in faithfulness metric (invalid key)
#1362 opened Feb 14, 2025 by LudoBar
o3-mini is not working with G-Eval due to wrong temperature and logprobs parameter
#1358 opened Feb 12, 2025 by RicardoBochnia
Feature Request: Return both score and reason from metric.measure()
#1350 opened Feb 8, 2025 by Mujae
2
Change to a version of gRPC >= 1.70.0 as the current verison (1.67.1) has a known vulnerability.
#1343 opened Feb 4, 2025 by harshapraneeth
New Relic License key and endpoint are exposed in source
#1340 opened Feb 3, 2025 by paul-abb
1
query about trying to add test cases from csv file
#1333 opened Feb 2, 2025 by Sara-Hossny
4
OpenAI Batch API
#1286 opened Jan 19, 2025 by luarss
1
Benchmarks introduction does setup wrong
#1284 opened Jan 18, 2025 by AMindToThink
3
Add base attack in the returned results in redteam scan
#1281 opened Jan 17, 2025 by AmineDjeghri
3
Synthesizer cost tracker breaks golden generation pipeline for custom llms
#1266 opened Jan 13, 2025 by pazevedo-hyland
4
metric.evaluate() raise TypeError: unsupported operand type(s) for +=: 'NoneType' and 'float'
#1262 opened Jan 10, 2025 by rawheel
Text to Image metric incorrect evaluation
#1251 opened Jan 7, 2025 by shanmukh-sai2003
3
Issue while running scan
#1249 opened Jan 6, 2025 by jayjpjays
2
DeepEval, G-Eval logging issues.
#1244 opened Jan 1, 2025 by j0ntendo
When I set local ollama , but still need the Open api key
#1243 opened Dec 31, 2024 by lijinxinKing
2
CLI improvement: option to display only failed tests
#1235 opened Dec 18, 2024 by yuriykuzin
1
ToolCorrectnessMetric raises ZeroDivisionError when expected_tools is empty
#1234 opened Dec 18, 2024 by j-mesnil
Doc Improvement
#1225 opened Dec 13, 2024 by SamyAteia
4
Stop deepeval from storing sensitive information in dotenv files.
#1221 opened Dec 11, 2024 by thomend
3
Can't pass trust_remote_code to hallucination_score
#1220 opened Dec 10, 2024 by mausch
2
Generate Your First Golden - Using Custom model
#1216 opened Dec 8, 2024 by pratikchhapolika
7
Documentation for ContextualPrecision
#1212 opened Dec 6, 2024 by enrico-stauss
1
Commented piece of code for Golden creation
#1211 opened Dec 5, 2024 by jaroslaw-pawluszka
1
Add image support to LLMTestCase
#1210 opened Dec 5, 2024 by ethanelasky
11
ProTip! Exclude everything labeled bug with -label:bug.