[!] DataHub v0.8.35

Notice: Deploying this release will result in an incorrectly named aspect entry existing in the database. The impact is that some upgrade jobs may fail to perform full scans of the database. This will be fixed by upgrading to > v0.8.38 OR by pulling the latest DataHub Upgrade docker image and executing the following upgrade: ./datahub-upgrade.sh -u RemoveUnknownAspects

v0.8.35

Highlights

Reduced vulnerability counts in project
Various bug fixes
New streamlined docker workflow

Full Commit Log

• #4937 @RyanHolstien fix(env): provide default for unset telemetry variable
• #4926 @gabe-lyons feat(dbt): enable data platform instance on dbt
• #4933 @anshbansal fix(lint): lint failure due to mypy upgrade
• #4925 @RyanHolstien feat(telemetry): add server side telemetry
• #4917 @jjoyce0510 feat(graphql): Adding resolvers for adding multiple tags, terms, and owners
• #4924 @chen4119 fix(kafka-setup): Check if keystore/truststore location env variables are set
• #4919 @jjoyce0510 feat(ui): Adding Search Bar to all List Views (groups, users, domains, policies, ingestion)
• #4923 @chen4119 fix(kafka-setup): Add ssl.keystore.type and ssl.truststore.type
• #4882 @maggie-zhu feat(spark-lineage): add support for iceberg and cache based plans
• #4918 @RyanHolstien fix(idea): change location of coercer to make intellij not complain about classes
• #4916 @chriscollins3456 fix(ui) Fix some spacing issues on the search card
• #4914 @anshbansal docs(ingest): remove incorrectly annotated lineage capability
• #4912 @mayurinehate docs(transformer): update custom transform example to add missing super init
• #4903 @jjoyce0510 refactor(actions): Migrate to use new datahub-actions container
• #4869 @jjoyce0510 refactor(API): Add "Filter" support for Assertion Run Events, Dataset Profiles, Dataset Operations
• #4860 @anshbansal fix(doc): update doc url to generated docs
• #4910 @chriscollins3456 feat(containers) Get and display all parent containers in header and search
• #4791 @pedro93 feat(gms): Add support for deleting reference pointers when deleting by urn
• #4911 @RyanHolstien docs(frontend): update build command for partial build
• #4839 @BoyuanZhangDE feat(ingestion): For all usage connectors, allow exclusion of top_n_queries from ingestion via a config param.
• #4908 @jeffmerrick fix(docs): Metadata day 2022: Fix year
• #4859 @anshbansal doc(biqquery): add caveat for materialized view
• #4906 @jeffmerrick docs(website): add banner and nav item for metadata day 2022
• #4905 @anshbansal fix(build): Fix breaking changes from GE 0.15.3
• #4884 @shirshanka fix(deps): reduce frontend dependency
• #4902 @anshbansal doc(ingestion): add note for UI ingestion & custom sources
• #4901 @anshbansal revert(bigquery-usage): dataset allow filter impl
• #4824 @gabe-lyons fix(usage): pull usage from environment source rather than args
• #4899 @SagarTiwari24 fix(docs): Update developing.md to mention directory context
• #4892 @gabe-lyons fix(ui): fix side panel resize css
• #4890 @justinas-marozas fix(mxe-consumer): exclude CassandraAutoConfiguration from consumer boot
• #4853 @sebkim fix(ingestion): ElasticSearch when no properties from elastic_mappings, gracefully continue
• #4865 @dependabot chore(deps): bump axios from 0.21.1 to 0.21.4 in /datahub-web-react
• #4898 @treff7es fix(ingestion): bigquery-usage: Fix biquery usage table deny pattern template
• #4893 @shirshanka fix(ci): remove logging statement
• #4891 @RyanHolstien chore(deps): play - upgrade for CVEs
• #4889 @shirshanka fix(ci): clean up docker workflow for multi-tags
• #4875 @shirshanka fix(ingest): lookml - add view definitions for all views
• #4887 @shirshanka fix(ci): docker - either load or push, don't do both
• #4885 @shirshanka fix(ci): remove buildx and qemu for non multi-platform images
• #4862 @anshbansal fix(sql-parsing): improve error handling
• #4883 @shirshanka fix(ci): remove multiplatform builds from containers that don't support it
• #4881 @shirshanka feat(ci): docker actions simplify, add vulnerability scanner, simplify smoke-tests
• #4867 @chriscollins3456 feat(dataPlatformInstance) - Resolve and display dataPlatformInstance on entities
• #4880 @shirshanka fix(docs): ingest - sort modules, fix small typos
• #4866 @ShubhamThakre fix(ui): search filter entity ui update
• #4855 @treff7es fix(ingestion): dependencies - Downgrading typing-extension dependency to work with Airflow 2.0.2
• #4600 @pedro93 Use ingest proposal to submit status updates
• #4868 @RyanHolstien Revert "chore(deps): upgrade play to remove CVEs (#4864)"
• #4857 @RyanHolstien chore(jetty): upgrade jetty to 9.4.46 for CVE
• #4776 @tha23rd fix(bigquery-usage): dataset allow filter impl
• #4864 @RyanHolstien chore(deps): upgrade play to remove CVEs
• #4843 @cristiancalugaru ssl configuration support for elasticsearch source
• #4861 @RyanHolstien Revert "chore(deps): upgrade play dependencies to remove CVE vulnerabilities (#4820)"
• #4846 @dependabot chore(deps): bump async from 2.6.3 to 2.6.4 in /docs-website
• #4847 @dependabot chore(deps): bump minimist from 1.2.5 to 1.2.6 in /docs-website
• #4820 @RyanHolstien chore(deps): upgrade play dependencies to remove CVE vulnerabilities
• #4842 @rslanka fix(ingestion): Allow profiling of only those tables that are allowed by the table_pattern.
• #4844 @RyanHolstien Revert "fix(jetty): upgrade jetty dependency for CVE (#4838)"
• #4838 @RyanHolstien fix(jetty): upgrade jetty dependency for CVE
• #4840 @rslanka chore(deps): upgrade dependency io.netty:netty-all to address vulnerability
• #4841 @RyanHolstien fix(policies): change order of operations for policies bootstrap step to update index after database
• #4837 @RyanHolstien chore(deps): move from velocity 1.7 to 2.3
• #4821 @ShubhamThakre feat(ui): entity profile add copy url option update
• #4817 @aditya-radhakrishnan docs(schema-history): add usage guide for schema history
• #4835 @gabe-lyons hide soft deleted entities in lineage
• #4836 @shirshanka refactor(metadata-service): remove redundant file
• #4826 @jjoyce0510 chore(deps): pinning jackson dataformat cbor
• #4777 @treff7es feat(ingest): s3 - add support for multiple pathspecs in one recipe
• #4807 @eclaassen-pb chore(deps): upgrade spring and parquet dependencies
• #4813 @pedro93 fix(docs): Adds access policy documentation
• #4832 @mayurinehate feat(ingest): great-expectations - add more logs