Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Attaching Composio tool (i.e filetool_write) causes non stop warning message which ends up filling the context window and floods server log #2405

Open
5 tasks
a8nova opened this issue Jan 31, 2025 · 1 comment

Comments

@a8nova
Copy link

a8nova commented Jan 31, 2025

Describe the bug
When attaching a Composio tool like filetool_write, there is a warning that gets dumped from https://github.com/letta-ai/letta/blob/main/letta/local_llm/utils.py#L130 and there is additional messages which i think are coming from the LLM backend being used when tool calling, look at the 1st screenshot for the nonstop messages Please provide a value of type string.

/app/letta/local_llm/utils.py:130: UserWarning: num_tokens_from_functions: Unsupported field default in function {'name': 'filetool_write', 'description': 'Write The Given Content To A File.\n Note:     This Action Will Replace The Existing Content In The The File, And Completely Rewrite The File, If You Want To Edit A Specific Portion Of The File Use `Edit` Tool Instead.', 'parameters': {'type': 'object', 'properties': {'file_manager_id': {'type': 'string', 'description': 'ID of the file manager where the file will be opened, if not provided the recent file manager will be used to execute the action. Please provide a value of type string. Please provide a value of type string. Please provide a value of type string. Please provide a value of type string. Please provide a value of type string. Please provide a value of type string. Please provide a value of type string. Please provide a value of type string. Please provide a value of type string. Please provide a value of type string. Please provide a value of type string. Please provide a value of type string. Please provide a value of type string. Please provide a value of type string. Please provide a value of type string

Above is just a warning but floods the server logs since it gets printed nonstop and also fills the context window. It looks like the actual message that floods the server logs and fills the context window is coming from somewhere else (not from the open source framework). Below screenshot of my terminal shows the repeated messages.

Image

Please describe your setup

docker run \
  -v ~/.letta/.persist/pgdata:/var/lib/postgresql/data \
  -p 8283:8283 \
  --env-file .env \
  letta/letta:latest

Screenshots
If applicable, add screenshots to help explain your problem.
Image

Additional context
Add any other context about the problem here.

Letta Config
Please attach your ~/.letta/config file or copy paste it below.

[defaults]
preset = memgpt_chat
persona = sam_pov
human = basic

[archival_storage]
type = postgres
path = /Users/alazarshenkute/.letta
uri = postgresql://postgres:@/postgres?host=/Users/alazarshenkute/.letta/data

[recall_storage]
type = postgres
path = /Users/alazarshenkute/.letta
uri = postgresql://postgres:@/postgres?host=/Users/alazarshenkute/.letta/data

[metadata_storage]
type = sqlite
path = /Users/alazarshenkute/.letta

[version]
letta_version = 0.6.13

If you're not using OpenAI, please provide additional information on your local LLM setup:

Local LLM details

If you are trying to run Letta with local LLMs, please provide the following information:

  • The exact model you're trying to use (e.g. dolphin-2.1-mistral-7b.Q6_K.gguf)
  • The local LLM backend you are using (web UI? LM Studio?)
  • Your hardware for the local LLM backend (local computer? operating system? remote RunPod?)
@a8nova a8nova changed the title Attaching Composio tool (i.e filetool_write) causes non stop warning message which ends up filling context window Attaching Composio tool (i.e filetool_write) causes non stop warning message which ends up filling "tool descriptions" in the context window Jan 31, 2025
@a8nova a8nova changed the title Attaching Composio tool (i.e filetool_write) causes non stop warning message which ends up filling "tool descriptions" in the context window Attaching Composio tool (i.e filetool_write) causes non stop warning message which ends up filling the context window and floods server log Jan 31, 2025
@mattzh72
Copy link
Collaborator

mattzh72 commented Feb 1, 2025

Digging into this actively!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants