Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix: refactor send_message API #1633

Merged
merged 6 commits into from
Aug 12, 2024
Merged

Conversation

cpacker
Copy link
Collaborator

@cpacker cpacker commented Aug 12, 2024

  • fix hanging send_message by wrapping server.step in try/catch + add a timeout to the generator

message: str,
stream_steps: bool,
stream_tokens: bool,
chat_completion_mode: Optional[bool] = False,
timestamp: Optional[datetime] = None,
# related to whether or not we return `MemGPTMessage`s or `Message`s
return_message_object: bool = True, # Should be True for Python Client, False for REST API
Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@sarahwooders this isn't properly connected anywhere yet - probably this should be set to False by default, and the Python + REST clients should set it to True manually

@cpacker cpacker requested a review from sarahwooders August 12, 2024 03:27
@cpacker cpacker merged commit 416e919 into refactor-api Aug 12, 2024
5 checks passed
@cpacker cpacker deleted the update-streaming-interface branch August 12, 2024 04:06
sarahwooders pushed a commit that referenced this pull request Aug 17, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant