Skip to content

feat(ingest/snowflake): allow option for incremental properties (#12080) #27366

feat(ingest/snowflake): allow option for incremental properties (#12080)

feat(ingest/snowflake): allow option for incremental properties (#12080) #27366

Triggered via push December 11, 2024 10:38
Status Success
Total duration 55m 32s
Artifacts 10
Build and Push DataHub Ingestion (Base) Docker Image
1m 10s
Build and Push DataHub Ingestion (Base) Docker Image
Build and Push DataHub Upgrade Docker Image
4m 4s
Build and Push DataHub Upgrade Docker Image
Build and Push DataHub Elasticsearch Setup Docker Image
46s
Build and Push DataHub Elasticsearch Setup Docker Image
Build and Push DataHub Frontend Docker Image
7m 24s
Build and Push DataHub Frontend Docker Image
Build and Push DataHub GMS Docker Image
4m 25s
Build and Push DataHub GMS Docker Image
Build and Push DataHub Kafka Setup Docker Image
1m 4s
Build and Push DataHub Kafka Setup Docker Image
Build and Push DataHub MAE Consumer Docker Image
4m 7s
Build and Push DataHub MAE Consumer Docker Image
Build and Push DataHub MCE Consumer Docker Image
3m 41s
Build and Push DataHub MCE Consumer Docker Image
Build and Push DataHub MySQL Setup Docker Image
50s
Build and Push DataHub MySQL Setup Docker Image
smoke_test_matrix
1s
smoke_test_matrix
Build and Push DataHub Ingestion (Base-Full) Docker Image
31s
Build and Push DataHub Ingestion (Base-Full) Docker Image
Build and Push DataHub Ingestion (Base-Slim) Docker Image
29s
Build and Push DataHub Ingestion (Base-Slim) Docker Image
[Monitoring] Scan DataHub Upgrade images for vulnerabilities
39s
[Monitoring] Scan DataHub Upgrade images for vulnerabilities
[Monitoring] Scan ElasticSearch setup images for vulnerabilities
26s
[Monitoring] Scan ElasticSearch setup images for vulnerabilities
[Monitoring] Scan Frontend images for vulnerabilities
37s
[Monitoring] Scan Frontend images for vulnerabilities
[Monitoring] Scan GMS images for vulnerabilities
41s
[Monitoring] Scan GMS images for vulnerabilities
[Monitoring] Scan Kafka Setup images for vulnerabilities
36s
[Monitoring] Scan Kafka Setup images for vulnerabilities
[Monitoring] Scan MAE consumer images for vulnerabilities
53s
[Monitoring] Scan MAE consumer images for vulnerabilities
[Monitoring] Scan MCE consumer images for vulnerabilities
49s
[Monitoring] Scan MCE consumer images for vulnerabilities
[Monitoring] Scan MySQL Setup images for vulnerabilities
26s
[Monitoring] Scan MySQL Setup images for vulnerabilities
Build and Push DataHub Ingestion (Full) Docker Images
5m 25s
Build and Push DataHub Ingestion (Full) Docker Images
Build and Push DataHub Ingestion Docker Images
3m 39s
Build and Push DataHub Ingestion Docker Images
[Monitoring] Scan Datahub Ingestion images for vulnerabilities
2m 47s
[Monitoring] Scan Datahub Ingestion images for vulnerabilities
Matrix: Run Smoke Tests
[Monitoring] Scan Datahub Ingestion Slim images for vulnerabilities
1m 51s
[Monitoring] Scan Datahub Ingestion Slim images for vulnerabilities
Deploy to Datahub HEAD
4s
Deploy to Datahub HEAD
Fit to window
Zoom out
Zoom in

Annotations

53 warnings
setup
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
JSON arguments recommended for ENTRYPOINT/CMD to prevent unintended behavior related to OS signals: docker/elasticsearch-setup/Dockerfile#L48
JSONArgsRecommended: JSON arguments recommended for CMD to prevent unintended behavior related to OS signals More info: https://docs.docker.com/go/dockerfile/rule/json-args-recommended/
Build and Push DataHub Ingestion (Base) Docker Image
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
JSON arguments recommended for ENTRYPOINT/CMD to prevent unintended behavior related to OS signals: docker/datahub-mae-consumer/Dockerfile#L73
JSONArgsRecommended: JSON arguments recommended for CMD to prevent unintended behavior related to OS signals More info: https://docs.docker.com/go/dockerfile/rule/json-args-recommended/
JSON arguments recommended for ENTRYPOINT/CMD to prevent unintended behavior related to OS signals: docker/datahub-gms/Dockerfile#L83
JSONArgsRecommended: JSON arguments recommended for CMD to prevent unintended behavior related to OS signals More info: https://docs.docker.com/go/dockerfile/rule/json-args-recommended/
Build and Push DataHub Upgrade Docker Image
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
smoke_test_matrix
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
JSON arguments recommended for ENTRYPOINT/CMD to prevent unintended behavior related to OS signals: docker/mysql-setup/Dockerfile#L37
JSONArgsRecommended: JSON arguments recommended for CMD to prevent unintended behavior related to OS signals More info: https://docs.docker.com/go/dockerfile/rule/json-args-recommended/
JSON arguments recommended for ENTRYPOINT/CMD to prevent unintended behavior related to OS signals: docker/kafka-setup/Dockerfile#L78
JSONArgsRecommended: JSON arguments recommended for CMD to prevent unintended behavior related to OS signals More info: https://docs.docker.com/go/dockerfile/rule/json-args-recommended/
JSON arguments recommended for ENTRYPOINT/CMD to prevent unintended behavior related to OS signals: docker/datahub-mce-consumer/Dockerfile#L74
JSONArgsRecommended: JSON arguments recommended for CMD to prevent unintended behavior related to OS signals More info: https://docs.docker.com/go/dockerfile/rule/json-args-recommended/
Build and Push DataHub MCE Consumer Docker Image
Unhandled error in Gradle post-action - job will continue: Error: Cache upload failed because file read failed with EBADF: bad file descriptor, read
Build and Push DataHub MCE Consumer Docker Image
Failed to save cache entry with path '/home/runner/.gradle/caches/jars-*/*/' and key: gradle-instrumented-jars-v1-5ef9de841183660dce0c70a1b491ec63: Error: Cache service responded with 429 during upload chunk.
Build and Push DataHub MCE Consumer Docker Image
Unhandled error in Gradle post-action - job will continue: Error: Cache upload failed because file read failed with EBADF: bad file descriptor, read
Build and Push DataHub MCE Consumer Docker Image
Unhandled error in Gradle post-action - job will continue: Error: Cache upload failed because file read failed with EBADF: bad file descriptor, read
Build and Push DataHub MCE Consumer Docker Image
Unhandled error in Gradle post-action - job will continue: Error: Cache upload failed because file read failed with EBADF: bad file descriptor, read
Build and Push DataHub MCE Consumer Docker Image
Failed to save cache entry with path '/home/runner/.gradle/caches,/home/runner/.gradle/notifications,/home/runner/.gradle/.setup-gradle' and key: gradle-home-v1|Linux|mce_consumer_build[af3ba857d1aca0645b0e3cf4a2d3906e]-355a7e69aa1a444e497121f2c3f6b4dffa5beb36: Error: Cache service responded with 429 during upload chunk.
[Monitoring] Scan ElasticSearch setup images for vulnerabilities
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
[Monitoring] Scan ElasticSearch setup images for vulnerabilities
CodeQL Action v2 will be deprecated on December 5th, 2024. Please update all occurrences of the CodeQL Action in your workflow files to v3. For more information, see https://github.blog/changelog/2024-01-12-code-scanning-deprecation-of-codeql-action-v2/
Build and Push DataHub Ingestion (Base-Slim) Docker Image
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Build and Push DataHub Ingestion (Base-Full) Docker Image
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
[Monitoring] Scan GMS images for vulnerabilities
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
[Monitoring] Scan GMS images for vulnerabilities
CodeQL Action v2 will be deprecated on December 5th, 2024. Please update all occurrences of the CodeQL Action in your workflow files to v3. For more information, see https://github.blog/changelog/2024-01-12-code-scanning-deprecation-of-codeql-action-v2/
[Monitoring] Scan DataHub Upgrade images for vulnerabilities
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
[Monitoring] Scan DataHub Upgrade images for vulnerabilities
CodeQL Action v2 will be deprecated on December 5th, 2024. Please update all occurrences of the CodeQL Action in your workflow files to v3. For more information, see https://github.blog/changelog/2024-01-12-code-scanning-deprecation-of-codeql-action-v2/
[Monitoring] Scan MAE consumer images for vulnerabilities
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
[Monitoring] Scan MAE consumer images for vulnerabilities
CodeQL Action v2 will be deprecated on December 5th, 2024. Please update all occurrences of the CodeQL Action in your workflow files to v3. For more information, see https://github.blog/changelog/2024-01-12-code-scanning-deprecation-of-codeql-action-v2/
[Monitoring] Scan MySQL Setup images for vulnerabilities
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
[Monitoring] Scan MySQL Setup images for vulnerabilities
CodeQL Action v2 will be deprecated on December 5th, 2024. Please update all occurrences of the CodeQL Action in your workflow files to v3. For more information, see https://github.blog/changelog/2024-01-12-code-scanning-deprecation-of-codeql-action-v2/
[Monitoring] Scan Kafka Setup images for vulnerabilities
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
[Monitoring] Scan Kafka Setup images for vulnerabilities
CodeQL Action v2 will be deprecated on December 5th, 2024. Please update all occurrences of the CodeQL Action in your workflow files to v3. For more information, see https://github.blog/changelog/2024-01-12-code-scanning-deprecation-of-codeql-action-v2/
[Monitoring] Scan MCE consumer images for vulnerabilities
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
[Monitoring] Scan MCE consumer images for vulnerabilities
CodeQL Action v2 will be deprecated on December 5th, 2024. Please update all occurrences of the CodeQL Action in your workflow files to v3. For more information, see https://github.blog/changelog/2024-01-12-code-scanning-deprecation-of-codeql-action-v2/
JSON arguments recommended for ENTRYPOINT/CMD to prevent unintended behavior related to OS signals: docker/datahub-frontend/Dockerfile#L55
JSONArgsRecommended: JSON arguments recommended for CMD to prevent unintended behavior related to OS signals More info: https://docs.docker.com/go/dockerfile/rule/json-args-recommended/
Build and Push DataHub Ingestion Docker Images
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Build and Push DataHub Ingestion Docker Images
Unhandled error in Gradle post-action - job will continue: Error: Cache upload failed because file read failed with EBADF: bad file descriptor, read
Build and Push DataHub Ingestion Docker Images
Unhandled error in Gradle post-action - job will continue: Error: Cache upload failed because file read failed with EBADF: bad file descriptor, read
Build and Push DataHub Ingestion Docker Images
Unhandled error in Gradle post-action - job will continue: Error: Cache upload failed because file read failed with EBADF: bad file descriptor, read
Build and Push DataHub Ingestion Docker Images
Failed to save cache entry with path '/home/runner/.gradle/caches,/home/runner/.gradle/notifications,/home/runner/.gradle/.setup-gradle' and key: gradle-home-v1|Linux|datahub_ingestion_slim_build[af3ba857d1aca0645b0e3cf4a2d3906e]-355a7e69aa1a444e497121f2c3f6b4dffa5beb36: Error: Cache service responded with 429 during upload chunk.
[Monitoring] Scan Frontend images for vulnerabilities
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
[Monitoring] Scan Frontend images for vulnerabilities
CodeQL Action v2 will be deprecated on December 5th, 2024. Please update all occurrences of the CodeQL Action in your workflow files to v3. For more information, see https://github.blog/changelog/2024-01-12-code-scanning-deprecation-of-codeql-action-v2/
Build and Push DataHub Ingestion (Full) Docker Images
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Build and Push DataHub Ingestion (Full) Docker Images
Unhandled error in Gradle post-action - job will continue: Error: Cache upload failed because file read failed with EBADF: bad file descriptor, read
Build and Push DataHub Ingestion (Full) Docker Images
Unhandled error in Gradle post-action - job will continue: Error: Cache upload failed because file read failed with ESPIPE: invalid seek, read
Build and Push DataHub Ingestion (Full) Docker Images
Unhandled error in Gradle post-action - job will continue: Error: Cache upload failed because file read failed with ESPIPE: invalid seek, read
Build and Push DataHub Ingestion (Full) Docker Images
Failed to save cache entry with path '/home/runner/.gradle/caches,/home/runner/.gradle/notifications,/home/runner/.gradle/.setup-gradle' and key: gradle-home-v1|Linux|datahub_ingestion_full_build[af3ba857d1aca0645b0e3cf4a2d3906e]-355a7e69aa1a444e497121f2c3f6b4dffa5beb36: Error: Cache service responded with 429 during upload chunk.
[Monitoring] Scan Datahub Ingestion Slim images for vulnerabilities
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
[Monitoring] Scan Datahub Ingestion Slim images for vulnerabilities
CodeQL Action v2 will be deprecated on December 5th, 2024. Please update all occurrences of the CodeQL Action in your workflow files to v3. For more information, see https://github.blog/changelog/2024-01-12-code-scanning-deprecation-of-codeql-action-v2/
[Monitoring] Scan Datahub Ingestion images for vulnerabilities
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
[Monitoring] Scan Datahub Ingestion images for vulnerabilities
CodeQL Action v2 will be deprecated on December 5th, 2024. Please update all occurrences of the CodeQL Action in your workflow files to v3. For more information, see https://github.blog/changelog/2024-01-12-code-scanning-deprecation-of-codeql-action-v2/
Run Smoke Tests (no_cypress_suite1)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Run Smoke Tests (no_cypress_suite0)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Deploy to Datahub HEAD
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Deprecation notice: v1, v2, and v3 of the artifact actions
The following artifacts were uploaded using a version of actions/upload-artifact that is scheduled for deprecation: "Test Results (smoke tests) no_cypress_suite0", "Test Results (smoke tests) no_cypress_suite1". Please update your workflow to use v4 of the artifact actions. Learn more: https://github.blog/changelog/2024-04-16-deprecation-notice-v3-of-the-artifact-actions/

Artifacts

Produced during runtime
Name Size
Test Results (smoke tests) no_cypress_suite0
13.8 KB
Test Results (smoke tests) no_cypress_suite1
5.34 KB
datahub-project~datahub~0CGISG.dockerbuild
75.3 KB
datahub-project~datahub~1IC308.dockerbuild
53.6 KB
datahub-project~datahub~6T4DTT.dockerbuild
83.4 KB
datahub-project~datahub~AVCF6T.dockerbuild
100 KB
datahub-project~datahub~I2GKGP.dockerbuild
91.4 KB
datahub-project~datahub~S59S22.dockerbuild
56.8 KB
datahub-project~datahub~TP35TZ.dockerbuild
77.9 KB
datahub-project~datahub~USQROP.dockerbuild
80.9 KB