Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(ingest/dagster): Dagster asset dep capture #2

Open
wants to merge 72 commits into
base: master
Choose a base branch
from

Conversation

likawind
Copy link

Checklist

  • The PR conforms to DataHub's Contributing Guideline (particularly Commit Message Format)
  • Links to related issues (if applicable)
  • Tests for the changes have been added/updated (if applicable)
  • Docs related to the changes have been added/updated (if applicable). If a new feature has been added a Usage Guide has been added for the same.
  • For any breaking change/potential downtime/deprecation/big changes an entry has been made in Updating DataHub

Summary by Code Rabbit

  • New Features

    • Enhanced documentation for the DataHub integration with Dagster, improving readability and clarity.
    • New parameters and methods added to the datahub sensors for improved job monitoring and asset metadata handling.
    • Introduction of a new Lineage class to track asset relationships more effectively.
  • Improvements

    • Streamlined installation instructions and prerequisites for the DataHub Dagster plugin.
    • Expanded configuration options for asset management with detailed descriptions.
  • Bug Fixes

    • Refactored asset materialization processing to include enhanced logging and metadata handling.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants