-
Notifications
You must be signed in to change notification settings - Fork 467
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
When use tool set to True every time it response "I apologize, I was unable to find the answer to your question. Is there anything else I can help with?" #26
Comments
@shrimad-mishra-cognoai what LLM are you using? Did you change the system prompt from the example? This is the response from the parser when the LLM does not return the correct format. This is a known issue, see here: There is outstanding TODO to make the parser more robust, which means some API changes, logic changes, LLM changes and prompt changes, or all of the above. Anyone would like to help? |
@shrimad-mishra-cognoai when you run |
@shrimad-mishra-cognoai can you confirm the bug still happens? We changed the type of the |
I have same issue when attempting to customize the stages and the prompt for my specific use case. Additionally, the parser doesn't seem to parse correctly as it consistently outputs the message 'I apologize, I was unable to find the answer to your question. Is there anything else I can assist you with? |
@RizkiNoor16 thanks for the feedback, we will prioritize this on the roadmap as it will definitely make SalesGPT more usable. Few observations for myself or anyone who wants to help via a PR:
People are actively working on this and I am sure there are people who make their parsers for Agents more reliable now. I find this super interesting and will look into it as soon as I can. I believe OpenAI functions which output JSON 100% of the time should be able to improve this significantly. |
hey @RizkiNoor16 so one thing you can also do for agent parser is use pydantic here to define your exact output this works quite well |
thank for your feedback @ranjandsingh ,Mind if I ask which model you're using? I've tried the code provided in the documentation, and it doesn't perform very well with the GPT-3.5 Turbo model. |
Works great with 3.5-turbo-313 |
In my case, I have use the new GPT-3.5 instruct, and this has resolved my issue." |
@filip-michalsky
But I still have a problem when a truncated command gets into the parser, for example like this http://joxi.ru/Vm6LqXPHKpO7zA Just a 'thought' without 'action' and 'action_input' how can this happen? Any ideas? P.S Im not english speaker. |
When use tool set to True every time it response "I apologize, I was unable to find the answer to your question. Is there anything else I can help with?"
The text was updated successfully, but these errors were encountered: