Update Flyte components (#3675)

* Update Flyte Components Signed-off-by: Flyte-Bot <[email protected]> * Add changelog and bump version in conf.py Signed-off-by: eduardo apolinario <[email protected]> --------- Signed-off-by: Flyte-Bot <[email protected]> Signed-off-by: eduardo apolinario <[email protected]> Co-authored-by: eapolinario <[email protected]>
flyteorg · May 12, 2023 · 88f6d15 · 88f6d15
1 parent 41e2ef4
commit 88f6d15
Show file tree

Hide file tree

Showing 26 changed files with 231 additions and 159 deletions.
diff --git a/CHANGELOG/CHANGELOG-v1.6.0.md b/CHANGELOG/CHANGELOG-v1.6.0.md
@@ -0,0 +1,72 @@
+# Flyte v1.6.0 release
+
+In this release we're announcing support for writing backend plugins in python. This is in experimental state, feedback
+and bug reports are welcome!
+
+## Database migrations
+
+This release contains a database migration that remediates an issue that we discovered with very old installations of Flyte.
+For more details, please read the Flyte [https://github.com/flyteorg/flyte/releases/tag/v1.5.1](1.5.1 release notes). 
+
+
+## Platform
+
+As mentioned in the previous release, we are working to improve performance investigations. In this release we're announcing:
+1. Runtime metrics UI 
+2. [Profile time spent in a task](https://github.com/flyteorg/flytekit/pull/1581) via @timeit decorator
+3. [Lazy loading of flytekit dependencies](https://github.com/flyteorg/flytekit/pull/1590)
+
+## flytekit
+
+Lots of features shipped in 1.6, including:
+1. [Prettified pyflyte run logs](https://github.com/flyteorg/flytekit/pull/1602)
+2. [Simplified image builds via ImageSpec](https://github.com/flyteorg/flytekit/pull/1555)
+3. [External backed plugins](https://github.com/flyteorg/flytekit/pull/1524)
+
+For a full changelog, go to https://github.com/flyteorg/flytekit/releases/tag/v1.6.0.
+
+## Console
+* feat: show launchplan in execution table by @pradithya in https://github.com/flyteorg/flyteconsole/pull/738
+* feat: show launch plan information in workflow's schedules by @pradithya in https://github.com/flyteorg/flyteconsole/pull/739
+* fix: passthrough runtime env vars by @ursucarina in https://github.com/flyteorg/flyteconsole/pull/741
+* chore: add fallback to task execution link  by @ursucarina in https://github.com/flyteorg/flyteconsole/pull/743
+* chore: allow custom subnav by @ursucarina in https://github.com/flyteorg/flyteconsole/pull/734
+* fix: force node executions to pull their status  by @ursucarina in https://github.com/flyteorg/flyteconsole/pull/737
+* chore: fix details panel card padding by @ursucarina in https://github.com/flyteorg/flyteconsole/pull/745
+* chore: fix crash by @ursucarina in https://github.com/flyteorg/flyteconsole/pull/746
+* [UI Feature] Add full-list log output to execution detail panel by @james-union in https://github.com/flyteorg/flyteconsole/pull/744
+* TLM add log-message window to left panel by @james-union in https://github.com/flyteorg/flyteconsole/pull/748
+* [Snyk] Upgrade eslint from 8.31.0 to 8.33.0 by @EngHabu in https://github.com/flyteorg/flyteconsole/pull/695
+* chore: [tlm] comprehensive node execution query by @ursucarina in https://github.com/flyteorg/flyteconsole/pull/749
+* chore: guard against /tasks failing by @ursucarina in https://github.com/flyteorg/flyteconsole/pull/750
+* chore: propagate dynamic parent id  by @ursucarina in https://github.com/flyteorg/flyteconsole/pull/751
+* Add support fetching description entity by @pingsutw in https://github.com/flyteorg/flyteconsole/pull/735
+
+## Admin
+* Infer GOOS and GOARCH from environment by @jeevb in https://github.com/flyteorg/flyteadmin/pull/550
+* Enrich TerminateExecution error to tell propeller the execution already terminated by @EngHabu in https://github.com/flyteorg/flyteadmin/pull/551
+* Address resolution by @wild-endeavor in https://github.com/flyteorg/flyteadmin/pull/546
+* Add migration to turn `parent_id` column into `bigint` only if necessary by @eapolinario in https://github.com/flyteorg/flyteadmin/pull/554
+
+## Propeller
+* Moved controller-runtime start out of webhook Run function by @hamersaw in https://github.com/flyteorg/flytepropeller/pull/546
+* Fixing recovering of SKIPPED nodes by @hamersaw in https://github.com/flyteorg/flytepropeller/pull/551
+* Remove resource injection on the node for container task by @ByronHsu in https://github.com/flyteorg/flytepropeller/pull/544
+* Infer GOOS and GOARCH from environment by @jeevb in https://github.com/flyteorg/flytepropeller/pull/552
+* fix makefile to read variables from environment and overrides by @jeevb in https://github.com/flyteorg/flytepropeller/pull/554
+* Remove BarrierTick by @hamersaw in https://github.com/flyteorg/flytepropeller/pull/545
+* Check for TerminateExecution error and eat Precondition status by @EngHabu in https://github.com/flyteorg/flytepropeller/pull/553
+* Setting primaryContainerName by default on Pod plugin by @hamersaw in https://github.com/flyteorg/flytepropeller/pull/555
+* Implement ability to specify additional/override annotations when using Vault Secret Manager by @pradithya in https://github.com/flyteorg/flytepropeller/pull/556
+* Maintaining Interruptible and OverwriteCache for reference launchplans by @hamersaw in https://github.com/flyteorg/flytepropeller/pull/557
+* Added support for aborting task nodes reported as failures by @hamersaw in https://github.com/flyteorg/flytepropeller/pull/541
+* Added support for EnvironmentVariables on ExecutionConfig by @hamersaw in https://github.com/flyteorg/flytepropeller/pull/558
+* Fast fail if task resource requests exceed k8s resource limits by @hamersaw in https://github.com/flyteorg/flytepropeller/pull/488
+
+## New Contributors
+* @wckdman made their first contribution in https://github.com/flyteorg/flytekit/pull/1588
+* @peridotml made their first contribution in https://github.com/flyteorg/flytekit/pull/1599
+* @ringohoffman made their first contribution in https://github.com/flyteorg/flytekit/pull/1631
+* @elibixby made their first contribution in https://github.com/flyteorg/flytekit/pull/1615
+* @ByronHsu made their first contribution in https://github.com/flyteorg/flytepropeller/pull/544
+
diff --git a/charts/flyte-core/README.md b/charts/flyte-core/README.md
@@ -151,7 +151,7 @@ helm install gateway bitnami/contour -n flyte
 | flyteadmin.extraArgs | object | `{}` | Appends extra command line arguments to the serve command |
 | flyteadmin.image.pullPolicy | string | `"IfNotPresent"` |  |
 | flyteadmin.image.repository | string | `"cr.flyte.org/flyteorg/flyteadmin"` | Docker image for Flyteadmin deployment |
-| flyteadmin.image.tag | string | `"v1.1.92"` |  |
+| flyteadmin.image.tag | string | `"v1.1.94"` |  |
 | flyteadmin.initialProjects | list | `["flytesnacks","flytetester","flyteexamples"]` | Initial projects to create |
 | flyteadmin.nodeSelector | object | `{}` | nodeSelector for Flyteadmin deployment |
 | flyteadmin.podAnnotations | object | `{}` | Annotations for Flyteadmin pods |
@@ -173,7 +173,7 @@ helm install gateway bitnami/contour -n flyte
 | flyteconsole.ga.tracking_id | string | `"G-0QW4DJWJ20"` |  |
 | flyteconsole.image.pullPolicy | string | `"IfNotPresent"` |  |
 | flyteconsole.image.repository | string | `"cr.flyte.org/flyteorg/flyteconsole"` | Docker image for Flyteconsole deployment |
-| flyteconsole.image.tag | string | `"v1.6.2"` |  |
+| flyteconsole.image.tag | string | `"v1.8.0"` |  |
 | flyteconsole.nodeSelector | object | `{}` | nodeSelector for Flyteconsole deployment |
 | flyteconsole.podAnnotations | object | `{}` | Annotations for Flyteconsole pods |
 | flyteconsole.priorityClassName | string | `""` | Sets priorityClassName for flyte console pod(s). |
@@ -193,7 +193,7 @@ helm install gateway bitnami/contour -n flyte
 | flytepropeller.extraArgs | object | `{}` | Appends extra command line arguments to the main command |
 | flytepropeller.image.pullPolicy | string | `"IfNotPresent"` |  |
 | flytepropeller.image.repository | string | `"cr.flyte.org/flyteorg/flytepropeller"` | Docker image for Flytepropeller deployment |
-| flytepropeller.image.tag | string | `"v1.1.88"` |  |
+| flytepropeller.image.tag | string | `"v1.1.89"` |  |
 | flytepropeller.manager | bool | `false` |  |
 | flytepropeller.nodeSelector | object | `{}` | nodeSelector for Flytepropeller deployment |
 | flytepropeller.podAnnotations | object | `{}` | Annotations for Flytepropeller pods |
@@ -213,7 +213,7 @@ helm install gateway bitnami/contour -n flyte
 | flytescheduler.configPath | string | `"/etc/flyte/config/*.yaml"` | Default regex string for searching configuration files |
 | flytescheduler.image.pullPolicy | string | `"IfNotPresent"` | Docker image pull policy |
 | flytescheduler.image.repository | string | `"cr.flyte.org/flyteorg/flytescheduler"` | Docker image for Flytescheduler deployment |
-| flytescheduler.image.tag | string | `"v1.1.92"` | Docker image tag |
+| flytescheduler.image.tag | string | `"v1.1.94"` | Docker image tag |
 | flytescheduler.nodeSelector | object | `{}` | nodeSelector for Flytescheduler deployment |
 | flytescheduler.podAnnotations | object | `{}` | Annotations for Flytescheduler pods |
 | flytescheduler.priorityClassName | string | `""` | Sets priorityClassName for flyte scheduler pod(s). |

diff --git a/charts/flyte-core/values.yaml b/charts/flyte-core/values.yaml
@@ -16,7 +16,7 @@ flyteadmin:
   image:
     # -- Docker image for Flyteadmin deployment
     repository: cr.flyte.org/flyteorg/flyteadmin # FLYTEADMIN_IMAGE
-    tag: v1.1.92 # FLYTEADMIN_TAG
+    tag: v1.1.94 # FLYTEADMIN_TAG
     pullPolicy: IfNotPresent
   # -- Additional flyteadmin container environment variables
   #
@@ -97,7 +97,7 @@ flytescheduler:
     # -- Docker image for Flytescheduler deployment
     repository: cr.flyte.org/flyteorg/flytescheduler # FLYTESCHEDULER_IMAGE
     # -- Docker image tag
-    tag: v1.1.92 # FLYTESCHEDULER_TAG
+    tag: v1.1.94 # FLYTESCHEDULER_TAG
     # -- Docker image pull policy
     pullPolicy: IfNotPresent
   # -- Default resources requests and limits for Flytescheduler deployment
@@ -212,7 +212,7 @@ flytepropeller:
   image:
     # -- Docker image for Flytepropeller deployment
     repository: cr.flyte.org/flyteorg/flytepropeller # FLYTEPROPELLER_IMAGE
-    tag: v1.1.88 # FLYTEPROPELLER_TAG
+    tag: v1.1.89 # FLYTEPROPELLER_TAG
     pullPolicy: IfNotPresent
   # -- Default resources requests and limits for Flytepropeller deployment
   resources:
@@ -270,7 +270,7 @@ flyteconsole:
   image:
     # -- Docker image for Flyteconsole deployment
     repository: cr.flyte.org/flyteorg/flyteconsole # FLYTECONSOLE_IMAGE
-    tag: v1.6.2 # FLYTECONSOLE_TAG
+    tag: v1.8.0 # FLYTECONSOLE_TAG
     pullPolicy: IfNotPresent
   # -- Default resources requests and limits for Flyteconsole deployment
   resources:

diff --git a/charts/flyte/README.md b/charts/flyte/README.md
diff --git a/charts/flyte/values.yaml b/charts/flyte/values.yaml
@@ -16,7 +16,7 @@ flyte:
       # -- Docker image for Flyteadmin deployment
       repository: cr.flyte.org/flyteorg/flyteadmin # FLYTEADMIN_IMAGE
       # -- Docker image tag
-      tag: v1.1.92 # FLYTEADMIN_TAG
+      tag: v1.1.94 # FLYTEADMIN_TAG
       # -- Docker image pull policy
       pullPolicy: IfNotPresent
     # -- Additional flyteadmin container environment variables
@@ -84,7 +84,7 @@ flyte:
       # -- Docker image for Flytescheduler deployment
       repository: cr.flyte.org/flyteorg/flytescheduler # FLYTESCHEDULER_IMAGE
       # -- Docker image tag
-      tag: v1.1.92 # FLYTESCHEDULER_TAG
+      tag: v1.1.94 # FLYTESCHEDULER_TAG
       # -- Docker image pull policy
       pullPolicy: IfNotPresent
     # -- Default resources requests and limits for Flytescheduler deployment
@@ -178,7 +178,7 @@ flyte:
       # -- Docker image for Flytepropeller deployment
       repository: cr.flyte.org/flyteorg/flytepropeller # FLYTEPROPELLER_IMAGE
       # -- Docker image tag
-      tag: v1.1.88 # FLYTEPROPELLER_TAG
+      tag: v1.1.89 # FLYTEPROPELLER_TAG
       # -- Docker image pull policy
       pullPolicy: IfNotPresent
     # -- Default resources requests and limits for Flytepropeller deployment
@@ -223,7 +223,7 @@ flyte:
       # -- Docker image for Flyteconsole deployment
       repository: cr.flyte.org/flyteorg/flyteconsole # FLYTECONSOLE_IMAGE
       # -- Docker image tag
-      tag: v1.6.2 # FLYTECONSOLE_TAG
+      tag: v1.8.0 # FLYTECONSOLE_TAG
       # -- Docker image pull policy
       pullPolicy: IfNotPresent
     # -- Default resources requests and limits for Flyteconsole deployment

diff --git a/deployment/eks/flyte_aws_scheduler_helm_generated.yaml b/deployment/eks/flyte_aws_scheduler_helm_generated.yaml
@@ -868,7 +868,7 @@ spec:
           - /etc/flyte/config/*.yaml
           - migrate
           - run
-          image: "cr.flyte.org/flyteorg/flyteadmin:v1.1.92"
+          image: "cr.flyte.org/flyteorg/flyteadmin:v1.1.94"
           imagePullPolicy: "IfNotPresent"
           name: run-migrations
           volumeMounts:
@@ -885,7 +885,7 @@ spec:
           - flytesnacks
           - flytetester
           - flyteexamples
-          image: "cr.flyte.org/flyteorg/flyteadmin:v1.1.92"
+          image: "cr.flyte.org/flyteorg/flyteadmin:v1.1.94"
           imagePullPolicy: "IfNotPresent"
           name: seed-projects
           volumeMounts:
@@ -899,7 +899,7 @@ spec:
           - /etc/flyte/config/*.yaml
           - clusterresource
           - sync
-          image: "cr.flyte.org/flyteorg/flyteadmin:v1.1.92"
+          image: "cr.flyte.org/flyteorg/flyteadmin:v1.1.94"
           imagePullPolicy: "IfNotPresent"
           name: sync-cluster-resources
           volumeMounts:
@@ -912,7 +912,7 @@ spec:
           - mountPath: /etc/secrets/
             name: admin-secrets
         - name: generate-secrets
-          image: "cr.flyte.org/flyteorg/flyteadmin:v1.1.92"
+          image: "cr.flyte.org/flyteorg/flyteadmin:v1.1.94"
           imagePullPolicy: "IfNotPresent"
           command: ["/bin/sh", "-c"]
           args:
@@ -935,7 +935,7 @@ spec:
         - --config
         - /etc/flyte/config/*.yaml
         - serve
-        image: "cr.flyte.org/flyteorg/flyteadmin:v1.1.92"
+        image: "cr.flyte.org/flyteorg/flyteadmin:v1.1.94"
         imagePullPolicy: "IfNotPresent"
         name: flyteadmin
         ports:
@@ -1036,7 +1036,7 @@ spec:
             - /etc/flyte/config/*.yaml
             - clusterresource
             - run
-          image: "cr.flyte.org/flyteorg/flyteadmin:v1.1.92"
+          image: "cr.flyte.org/flyteorg/flyteadmin:v1.1.94"
           imagePullPolicy: "IfNotPresent"
           name: sync-cluster-resources
           volumeMounts:
@@ -1089,7 +1089,7 @@ spec:
         runAsUser: 1000
         fsGroupChangePolicy: "OnRootMismatch"
       containers:
-      - image: "cr.flyte.org/flyteorg/flyteconsole:v1.6.2"
+      - image: "cr.flyte.org/flyteorg/flyteconsole:v1.8.0"
         imagePullPolicy: "IfNotPresent"
         name: flyteconsole
         envFrom:
@@ -1255,7 +1255,7 @@ spec:
           valueFrom:
             fieldRef:
               fieldPath: metadata.namespace
-        image: "cr.flyte.org/flyteorg/flytepropeller:v1.1.88"
+        image: "cr.flyte.org/flyteorg/flytepropeller:v1.1.89"
         imagePullPolicy: "IfNotPresent"
         name: flytepropeller
         ports:
@@ -1309,7 +1309,7 @@ spec:
       labels:
         app: flyte-pod-webhook
         app.kubernetes.io/name: flyte-pod-webhook
-        app.kubernetes.io/version: v1.1.88
+        app.kubernetes.io/version: v1.1.89
       annotations:
         configChecksum: "a9c71eeb913ac23741f1a6cdd8deb9681ecb6efdf2248c3513050c4c10ae7bb"
     spec:
@@ -1320,7 +1320,7 @@ spec:
       serviceAccountName: flyte-pod-webhook
       initContainers:
       - name: generate-secrets
-        image: "cr.flyte.org/flyteorg/flytepropeller:v1.1.88"
+        image: "cr.flyte.org/flyteorg/flytepropeller:v1.1.89"
         imagePullPolicy: "IfNotPresent"
         command:
           - flytepropeller
@@ -1343,7 +1343,7 @@ spec:
             mountPath: /etc/flyte/config
       containers:
         - name: webhook
-          image: "cr.flyte.org/flyteorg/flytepropeller:v1.1.88"
+          image: "cr.flyte.org/flyteorg/flytepropeller:v1.1.89"
           imagePullPolicy: "IfNotPresent"
           command:
             - flytepropeller

diff --git a/deployment/eks/flyte_generated.yaml b/deployment/eks/flyte_generated.yaml
@@ -8724,7 +8724,7 @@ spec:
           valueFrom:
             fieldRef:
               fieldPath: metadata.namespace
-        image: cr.flyte.org/flyteorg/flytepropeller:v1.1.88
+        image: cr.flyte.org/flyteorg/flytepropeller:v1.1.89
         imagePullPolicy: IfNotPresent
         name: webhook
         volumeMounts:
@@ -8751,7 +8751,7 @@ spec:
           valueFrom:
             fieldRef:
               fieldPath: metadata.namespace
-        image: cr.flyte.org/flyteorg/flytepropeller:v1.1.88
+        image: cr.flyte.org/flyteorg/flytepropeller:v1.1.89
         imagePullPolicy: IfNotPresent
         name: generate-secrets
         volumeMounts:
@@ -8799,7 +8799,7 @@ spec:
         - --config
         - /etc/flyte/config/*.yaml
         - serve
-        image: cr.flyte.org/flyteorg/flyteadmin:v1.1.92
+        image: cr.flyte.org/flyteorg/flyteadmin:v1.1.94
         imagePullPolicy: IfNotPresent
         name: flyteadmin
         ports:
@@ -8846,7 +8846,7 @@ spec:
         - /etc/flyte/config/*.yaml
         - migrate
         - run
-        image: cr.flyte.org/flyteorg/flyteadmin:v1.1.92
+        image: cr.flyte.org/flyteorg/flyteadmin:v1.1.94
         imagePullPolicy: IfNotPresent
         name: run-migrations
         volumeMounts:
@@ -8863,7 +8863,7 @@ spec:
         - flytesnacks
         - flytetester
         - flyteexamples
-        image: cr.flyte.org/flyteorg/flyteadmin:v1.1.92
+        image: cr.flyte.org/flyteorg/flyteadmin:v1.1.94
         imagePullPolicy: IfNotPresent
         name: seed-projects
         volumeMounts:
@@ -8877,7 +8877,7 @@ spec:
         - /etc/flyte/config/*.yaml
         - clusterresource
         - sync
-        image: cr.flyte.org/flyteorg/flyteadmin:v1.1.92
+        image: cr.flyte.org/flyteorg/flyteadmin:v1.1.94
         imagePullPolicy: IfNotPresent
         name: sync-cluster-resources
         volumeMounts:
@@ -8897,7 +8897,7 @@ spec:
           valueFrom:
             fieldRef:
               fieldPath: metadata.namespace
-        image: cr.flyte.org/flyteorg/flyteadmin:v1.1.92
+        image: cr.flyte.org/flyteorg/flyteadmin:v1.1.94
         imagePullPolicy: IfNotPresent
         name: generate-secrets
         volumeMounts:
@@ -8951,7 +8951,7 @@ spec:
       - envFrom:
         - configMapRef:
             name: flyte-console-config
-        image: cr.flyte.org/flyteorg/flyteconsole:v1.6.2
+        image: cr.flyte.org/flyteorg/flyteconsole:v1.8.0
         name: flyteconsole
         ports:
         - containerPort: 8080
@@ -9002,7 +9002,7 @@ spec:
           valueFrom:
             fieldRef:
               fieldPath: metadata.namespace
-        image: cr.flyte.org/flyteorg/flytepropeller:v1.1.88
+        image: cr.flyte.org/flyteorg/flytepropeller:v1.1.89
         imagePullPolicy: IfNotPresent
         name: flytepropeller
         ports:
@@ -9270,7 +9270,7 @@ spec:
             - /etc/flyte/config/*.yaml
             - clusterresource
             - sync
-            image: cr.flyte.org/flyteorg/flyteadmin:v1.1.92
+            image: cr.flyte.org/flyteorg/flyteadmin:v1.1.94
             imagePullPolicy: IfNotPresent
             name: sync-cluster-resources
             volumeMounts: