[!] DataHub v0.8.38

Notice: There is a known issue in this release. Listing access tokens for a user may not return the correct results to the UI due to an unreliable query to DataHub's search backend. This will be resolved in v0.8.39. Note that this does not mean that access tokens will not work or are in any way compromised - the functionality of generating and using access tokens is not impacted.

The below release notes are copied from v0.8.37 release notes.

Highlights

User Experience

This release comes packed full of new features and updates.

• NEW – Create & Revoke Access Tokens via the UI - Find this under Settings > Developer. This replaces the previous stateless tokens UI.
• NEW – Create and Invite Users to DataHub via the UI - Find this under Users & Groups > Invite DataHub users. Admins can also now generate password reset links for their users.
• NEW - Manage Related Glossary Terms via the UI - Add and remove Glossary Terms Contained By and Inherited From a parent via the UI. Find this under Glossary
• UPDATE - Rename “Manage” navigation item to “Govern”
• [IMPORTANT] UPDATE - Move “Users & Groups” navigation item into Settings > Access
• [IMPORTANT] UPDATE - Move “Policies” navigation item into Settings > Access (Privileges)
• FIX - You no longer need to run a reindexing job to start using the new Business Glossary UI. This process is handled for you at boot time.
• Minor fixes & improvements to UI for adding policy users + groups.

Metadata Ingestion

• Support Snowflake ingest via Oauth
• Misc fixes and improvements to existing ingestion sources

Disclaimers:

With this upgrade, we've added a new mechanism for authenticating users: native authentication. By default, this is enabled, which will allow new users to be created by Admin and for the user to login.

If you were previously disabling BOTH JaaS (via AUTH_JAAS_ENABLED = false) AND OIDC, and you still do not want to require a username + password to login, you'll need to add a new environment variable to datahub-frontend-react container: AUTH_NATIVE_ENABLED=false.

What's Changed

• feat(docs): auto-open config section for ingestion sources by @shirshanka in #5075
• feat(spark-lineage): coalesce spark jobs by @MugdhaHardikar-GSLab in #5077
• refactor(ui): UI Navigation Refactoring by @jjoyce0510 in #5076
• Update docs to alert users to restore indices for their Glossary by @chriscollins3456 in #5082
• fix(restore-indices): Do not fail while working with each row by @dexter-mh-lee in #5084
• fix(ingestion): looker - Handling gracefully invalid json in query dynamic field by @treff7es in #5083
• feat(docs): ingest - add tab for config json schema by @shirshanka in #5086
• chore(dep): upgrade json-smart by @RyanHolstien in #5081
• feat(ingest): rest_emitter - Adding option to rest emitter to disable ssl verification by @treff7es in #5042
• feat(cli): suggest upgrades when appropriate by @shirshanka in #5091
• feat(doc): Generating json schema for ingestion recipes by @treff7es in #5092
• feat(ingest): snowflake using oauth by @saxo-lalrishav in #4647
• fix(ui): do not show copy URN buttons when Clipboard API is not available by @Masterchen09 in #5087
• feat(kafka): use a thread pool executor for kafka for thread reuse by @RyanHolstien in #5079
• Manage Access Tokens by @Ankit-Keshari-Vituity in #5067
• tests(lookml): adding tests for model deny patterns by @gabe-lyons in #4934
• feat(model): Add optional context field to tag/term association by @dexter-mh-lee in #5085
• fix(glossary) Two quick followup fixes around the new Glossary updates by @chriscollins3456 in #5065
• chore(deps): bump eventsource from 1.1.0 to 1.1.1 in /docs-website by @dependabot in #5057
• feat(oidc): add configurable read timeout by @RyanHolstien in #5088
• feat(glossary) Display Incoming 'IsA' Glossary related entities by @chriscollins3456 in #5063
• fix(profiling): don't stop if some steps fail by @anshbansal in #5095
• feat(upgrades) Create new DataHubUpgrade + Restore Glossary Entities Bootstrap step by @chriscollins3456 in #5099
• fix(deps): ingest - moving packaging to framework_common by @shirshanka in #5096
• feat(frontend) Allow overriding akka-max-header-value-length by @karoliskascenas in #5094
• refactor(graphql): Migrate Visual Config into the Configuration Provider by @jjoyce0510 in #4780
• chore(akka): upgrade akka http for vuln by @RyanHolstien in #5100
• fix(build): reduce time taken for resolution by @anshbansal in #5106
• fix(build): remove dependencies added for compatibility by @anshbansal in #5108
• fix(ci): pin google-cloud-logging to avoid pip backtracking by @shirshanka in #5109
• Policies page issue by @Ankit-Keshari-Vituity in #5107
• chore(deps): Bump spring to 5.3.20 for vuln fix by @pedro93 in #5110
• fix(cli): Bumping avro-gen3 to 0.7.4 by @jjoyce0510 in #5098
• feat(docs): Updating example files with the new ingestion recipe suffix by @treff7es in #5103
• feat(graphql): add graphql endpoint to check whether an entity exists by @aditya-radhakrishnan in #5102
• feat(looker): ensure explore name matches looker's display name by @shirshanka in #5111
• fix(ui): Fixing missing homescreen logo by @jjoyce0510 in #5112
• fix(dbt): final fix of dbt platform instance issues by @gabe-lyons in #5115
• feat(ingestion): bigquery-usage - Collect stats from read event reasons by @treff7es in #5118
• feat(terms) Add ability to Add and Remove Related Terms to Glossary Terms by @chriscollins3456 in #5120
• Fixed Issue : Add Members Modal by @Ankit-Keshari-Vituity in #5117
• fix(bigquery): handling of empty partitioned tables, improve report message by @anshbansal in #5122
• feat(glossary) Hide self and children from select when moving a GlossaryNode by @chriscollins3456 in #5123
• fix(ingestion): bigquery-usage - Removing filtering at queryevents by @treff7es in #5124
• feat(users): add ability to add native users from the UI by @aditya-radhakrishnan in #5097
• fix(ingestion): Looker original view name should be used for explore_joins by @sebkim in #4928
• fix(iceberg): Change how MapType are mapped to Avro to support complex Map key type by @cccs-eric in #5060
• fix(ingestion): bigquery-usage - Only send operational metadata for allowed tables by @treff7es in #5127
• fix(dbt): Validator error fix by @BoyuanZhangDE in #5125
• feat(settings): skip calling graphql hooks if user does not have the right permissions by @aditya-radhakrishnan in #5136
• fix(ingest): fix table urn for athena connectionType by @mayurinehate in #5135
• Fixed the UI issue on Deprecated Pop-Up issue by @Ankit-Keshari-Vituity in #5130
• fix(ui-ingestion): show warning banner when configuring looker ui-ingestion for the first time by @aditya-radhakrishnan in #5139
• fix(tokens): Fix stale cache problem, reduce cache timeout for access tokens + fix listing owner tokens by @jjoyce0510 in #5140

Full Changelog: v0.8.37...v0.8.38