Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Langfuse tags and user_id on Haystack #1279

Open
luiscastejon-aily opened this issue Jan 8, 2025 · 0 comments
Open

Langfuse tags and user_id on Haystack #1279

luiscastejon-aily opened this issue Jan 8, 2025 · 0 comments
Labels
contributions wanted! Looking for external contributions feature request Ideas to improve an integration integration:langfuse P3

Comments

@luiscastejon-aily
Copy link

luiscastejon-aily commented Jan 8, 2025

Is your feature request related to a problem? Please describe.
We’ve started using Haystack to create LLM pipelines and want to track their usage with Langfuse. We use a function that returns a Haystack pipeline with the LLM and Langfuse tracer.

Currently, we rely heavily on tags in Langfuse (as we do with LangChain) to monitor usage across teams, projects, and other contexts, but there doesn’t seem to be a way to implement this functionality in Haystack. Additionally, assigning a user to a trace is a key feature we use, and we haven’t found a way to do this in Haystack either. This lack of integration limits our ability to track and manage usage effectively.

Describe the solution you’d like
We’d like the ability to use langfuse tags and user_id associated to a trace in Haystack pipelines to track usage for various teams and projects. Seamless integration of these features would improve our workflow significantly.

Describe alternatives you’ve considered
We’ve looked into potential workarounds, such as using the trace URL after getting the response and setting up this parameters, but this approach is cumbersome and would require to change the way we usually work with LLMs.

@luiscastejon-aily luiscastejon-aily added the feature request Ideas to improve an integration label Jan 8, 2025
@luiscastejon-aily luiscastejon-aily changed the title Langfuse tags and user_id in Haystack Langfuse tags and user_id on Haystack Jan 8, 2025
@julian-risch julian-risch added P3 contributions wanted! Looking for external contributions labels Jan 17, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
contributions wanted! Looking for external contributions feature request Ideas to improve an integration integration:langfuse P3
Projects
Development

No branches or pull requests

3 participants