Add looker metadata ingestion examples #2315
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
grantatspothero
force-pushed
the
spothero-looker-ingestion-examples
branch
from
7eceaca to
09449d8
Compare
|
Thanks a ton for pushing this over the line, @grantatspothero! |
…tahub Intended as examples for building out more robust support for Looker integrations and not a fully featured and reliable metadata ingestion
grantatspothero
force-pushed
the
spothero-looker-ingestion-examples
branch
from
96a0728 to
773cbfa
Compare
|
@shirshanka done, I also squashed all the commits on this branch and tried to follow the contrib guidelines for commit messages. Let me know if I missed a step! |
shirshanka
approved these changes
Apr 2, 2021
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Adds (very experimental) support for ingesting Looker metadata (views, charts, dashboards) into datahub through scraping LookML and scraping the Looker API.
SpotHero built this POC a few months ago before datahub officially supported ingesting dashboards into datahub. As a workaround, we created "virtual" datasets corresponding to Looker dashboards/charts so we could test out lineage between dashboards.
We are sharing these scripts since there is some interest around ingesting Looker metadata into datahub, but SpotHero does not have the time to robustly build this support out. If others are curious and want to try ingesting Looker metadata, this would be a good place to start!