Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Release 0.9.0 #617

Merged
merged 21 commits into from
Nov 19, 2020
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
19 changes: 19 additions & 0 deletions CHANGELOG/CHANGELOG-v0.9.0.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,19 @@


### Flytekit
* Fast register - code only changes no longer need a rebuild of the container to run ([read the docs!](https://flyte.readthedocs.io/en/latest/user/features/fast_registration.html))
* Project archive/activate command in flyte-cli
* Bug fixes and misc improvements

Please take a look at the newest [alpha release](https://github.com/lyft/flytekit/releases/tag/v0.16.0a0) of Flytekit (v0.16.0a0) which introduces native Python based typing, and a new way of workflow authoring that enables local workflow execution.
For examples of the native typed SDK usage refer to: [Cookbook Examples](https://github.com/lyft/flytesnacks/tree/annotated/cookbook/recipes/native_typing)

### FlyteConsole
- Better Single task launch support
- Launch form with more types supported
- Bug and stability fixes

### Flyte Platform
- SparkOperator v1beta2 support
- Archive/Unarchive projects
- Bug Fixes
4 changes: 2 additions & 2 deletions Makefile
Original file line number Diff line number Diff line change
Expand Up @@ -24,9 +24,9 @@ generate-local-docs:
# Builds the entire doc tree. Assumes update_ref_docs has run and that all externals rsts are in _rsts/ dir
.PHONY: generate-docs
generate-docs: generate-dependent-repo-docs
@FLYTEKIT_VERSION=0.13.1 ./script/generate_docs.sh
@FLYTEKIT_VERSION=0.15.1 ./script/generate_docs.sh

# updates referenced docs from other repositories (e.g. flyteidl, flytekit)
.PHONY: generate-dependent-repo-docs
generate-dependent-repo-docs:
@FLYTEKIT_VERSION=0.13.1 FLYTEIDL_VERSION=0.18.8 ./script/update_ref_docs.sh
@FLYTEKIT_VERSION=0.15.1 FLYTEIDL_VERSION=0.18.10 ./script/update_ref_docs.sh
3 changes: 2 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@
![Commit activity](https://img.shields.io/github/commit-activity/w/lyft/flyte.svg?style=plastic)
![Commit since last release](https://img.shields.io/github/commits-since/lyft/flyte/latest.svg?style=plastic)
![GitHub milestones Completed](https://img.shields.io/github/milestones/closed/lyft/flyte?style=plastic)
![GitHub next milestone percentage](https://img.shields.io/github/milestones/progress-percent/lyft/flyte/9?style=plastic)
![GitHub next milestone percentage](https://img.shields.io/github/milestones/progress-percent/lyft/flyte/10?style=plastic)
![Twitter Follow](https://img.shields.io/twitter/follow/flyteorg?label=Follow&style=social)
[![Slack Status](https://img.shields.io/badge/slack-join_chat-white.svg?logo=slack&style=social)](https://docs.google.com/forms/d/e/1FAIpQLSf8bNuyhy7rkm77cOXPHIzCm3ApfL7Tdo7NUs6Ej2NOGQ1PYw/viewform?pli=1)

Expand Down Expand Up @@ -55,6 +55,7 @@ Resources that would help you get a better understanding of Flyte.

# Features
- Used at Scale in production by 500+ users at Lyft with more than *900k* workflow executed a month and more than *30+* million container executions per month
- Fast registration - from local to remote in one second.
- Centralized Inventory of Tasks, Workflows and Executions
- Single Task Execution support - Start executing a task and then convert it to a workflow
- gRPC / REST interface to define and executes tasks and workflows
Expand Down
12 changes: 6 additions & 6 deletions deployment/eks/flyte_generated.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -8569,7 +8569,7 @@ spec:
- --config
- /etc/flyte/config/*.yaml
- serve
image: docker.io/lyft/flyteadmin:v0.3.7
image: docker.io/lyft/flyteadmin:v0.3.15
imagePullPolicy: IfNotPresent
name: flyteadmin
ports:
Expand Down Expand Up @@ -8615,7 +8615,7 @@ spec:
- /etc/flyte/config/*.yaml
- migrate
- run
image: docker.io/lyft/flyteadmin:v0.3.7
image: docker.io/lyft/flyteadmin:v0.3.15
imagePullPolicy: IfNotPresent
name: run-migrations
volumeMounts:
Expand All @@ -8633,7 +8633,7 @@ spec:
- flytesnacks
- flytetester
- flyteexamples
image: docker.io/lyft/flyteadmin:v0.3.7
image: docker.io/lyft/flyteadmin:v0.3.15
imagePullPolicy: IfNotPresent
name: seed-projects
volumeMounts:
Expand All @@ -8648,7 +8648,7 @@ spec:
- /etc/flyte/config/*.yaml
- clusterresource
- sync
image: docker.io/lyft/flyteadmin:v0.3.7
image: docker.io/lyft/flyteadmin:v0.3.15
imagePullPolicy: IfNotPresent
name: sync-cluster-resources
volumeMounts:
Expand Down Expand Up @@ -8695,7 +8695,7 @@ spec:
- envFrom:
- configMapRef:
name: flyte-console-config
image: docker.io/lyft/flyteconsole:v0.12.1
image: docker.io/lyft/flyteconsole:v0.17.7
name: flyteconsole
ports:
- containerPort: 8080
Expand Down Expand Up @@ -8927,7 +8927,7 @@ spec:
- /etc/flyte/config/*.yaml
- clusterresource
- sync
image: docker.io/lyft/flyteadmin:v0.3.7
image: docker.io/lyft/flyteadmin:v0.3.15
imagePullPolicy: IfNotPresent
name: sync-cluster-resources
volumeMounts:
Expand Down
12 changes: 6 additions & 6 deletions deployment/gcp/flyte_generated.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -8637,7 +8637,7 @@ spec:
- --config
- /etc/flyte/config/*.yaml
- serve
image: docker.io/lyft/flyteadmin:v0.3.7
image: docker.io/lyft/flyteadmin:v0.3.15
imagePullPolicy: IfNotPresent
name: flyteadmin
ports:
Expand Down Expand Up @@ -8683,7 +8683,7 @@ spec:
- /etc/flyte/config/*.yaml
- migrate
- run
image: docker.io/lyft/flyteadmin:v0.3.7
image: docker.io/lyft/flyteadmin:v0.3.15
imagePullPolicy: IfNotPresent
name: run-migrations
volumeMounts:
Expand All @@ -8701,7 +8701,7 @@ spec:
- flytesnacks
- flytetester
- flyteexamples
image: docker.io/lyft/flyteadmin:v0.3.7
image: docker.io/lyft/flyteadmin:v0.3.15
imagePullPolicy: IfNotPresent
name: seed-projects
volumeMounts:
Expand All @@ -8716,7 +8716,7 @@ spec:
- /etc/flyte/config/*.yaml
- clusterresource
- sync
image: docker.io/lyft/flyteadmin:v0.3.7
image: docker.io/lyft/flyteadmin:v0.3.15
imagePullPolicy: IfNotPresent
name: sync-cluster-resources
volumeMounts:
Expand Down Expand Up @@ -8763,7 +8763,7 @@ spec:
- envFrom:
- configMapRef:
name: flyte-console-config
image: docker.io/lyft/flyteconsole:v0.12.1
image: docker.io/lyft/flyteconsole:v0.17.7
name: flyteconsole
ports:
- containerPort: 8080
Expand Down Expand Up @@ -8995,7 +8995,7 @@ spec:
- /etc/flyte/config/*.yaml
- clusterresource
- sync
image: docker.io/lyft/flyteadmin:v0.3.7
image: docker.io/lyft/flyteadmin:v0.3.15
imagePullPolicy: IfNotPresent
name: sync-cluster-resources
volumeMounts:
Expand Down
12 changes: 6 additions & 6 deletions deployment/sandbox/flyte_generated.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -8858,7 +8858,7 @@ spec:
- --config
- /etc/flyte/config/*.yaml
- serve
image: docker.io/lyft/flyteadmin:v0.3.7
image: docker.io/lyft/flyteadmin:v0.3.15
imagePullPolicy: IfNotPresent
name: flyteadmin
ports:
Expand Down Expand Up @@ -8904,7 +8904,7 @@ spec:
- /etc/flyte/config/*.yaml
- migrate
- run
image: docker.io/lyft/flyteadmin:v0.3.7
image: docker.io/lyft/flyteadmin:v0.3.15
imagePullPolicy: IfNotPresent
name: run-migrations
volumeMounts:
Expand All @@ -8922,7 +8922,7 @@ spec:
- flytesnacks
- flytetester
- flyteexamples
image: docker.io/lyft/flyteadmin:v0.3.7
image: docker.io/lyft/flyteadmin:v0.3.15
imagePullPolicy: IfNotPresent
name: seed-projects
volumeMounts:
Expand All @@ -8937,7 +8937,7 @@ spec:
- /etc/flyte/config/*.yaml
- clusterresource
- sync
image: docker.io/lyft/flyteadmin:v0.3.7
image: docker.io/lyft/flyteadmin:v0.3.15
imagePullPolicy: IfNotPresent
name: sync-cluster-resources
volumeMounts:
Expand Down Expand Up @@ -8990,7 +8990,7 @@ spec:
- envFrom:
- configMapRef:
name: flyte-console-config
image: docker.io/lyft/flyteconsole:v0.12.1
image: docker.io/lyft/flyteconsole:v0.17.7
name: flyteconsole
ports:
- containerPort: 8080
Expand Down Expand Up @@ -9279,7 +9279,7 @@ spec:
- /etc/flyte/config/*.yaml
- clusterresource
- sync
image: docker.io/lyft/flyteadmin:v0.3.7
image: docker.io/lyft/flyteadmin:v0.3.15
imagePullPolicy: IfNotPresent
name: sync-cluster-resources
volumeMounts:
Expand Down
8 changes: 4 additions & 4 deletions deployment/test/flyte_generated.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -925,7 +925,7 @@ spec:
- --config
- /etc/flyte/config/*.yaml
- serve
image: docker.io/lyft/flyteadmin:v0.3.7
image: docker.io/lyft/flyteadmin:v0.3.15
imagePullPolicy: IfNotPresent
name: flyteadmin
ports:
Expand Down Expand Up @@ -971,7 +971,7 @@ spec:
- /etc/flyte/config/*.yaml
- migrate
- run
image: docker.io/lyft/flyteadmin:v0.3.7
image: docker.io/lyft/flyteadmin:v0.3.15
imagePullPolicy: IfNotPresent
name: run-migrations
volumeMounts:
Expand All @@ -989,7 +989,7 @@ spec:
- flytesnacks
- flytetester
- flyteexamples
image: docker.io/lyft/flyteadmin:v0.3.7
image: docker.io/lyft/flyteadmin:v0.3.15
imagePullPolicy: IfNotPresent
name: seed-projects
volumeMounts:
Expand All @@ -1004,7 +1004,7 @@ spec:
- /etc/flyte/config/*.yaml
- clusterresource
- sync
image: docker.io/lyft/flyteadmin:v0.3.7
image: docker.io/lyft/flyteadmin:v0.3.15
imagePullPolicy: IfNotPresent
name: sync-cluster-resources
volumeMounts:
Expand Down
2 changes: 1 addition & 1 deletion end2end/tests/endtoend.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -11,7 +11,7 @@ spec:
command:
- bash
- -c
image: docker.io/lyft/flytetester:440d9a0530025825745ae9316b2dc5bee27e66b8
image: docker.io/lyft/flytetester:268fe35dc2dc3b9899dd934e6a4e6ce8639a58fa
imagePullPolicy: IfNotPresent
name: flytetester
resources:
Expand Down
4 changes: 2 additions & 2 deletions kustomize/overlays/eks/kustomization.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -80,11 +80,11 @@ secretGenerator:
images:
# FlyteAdmin
- name: flyteadmin # match images with this name
newTag: v0.3.7 # override the tag
newTag: v0.3.15 # override the tag
newName: docker.io/lyft/flyteadmin # override the name
# FlyteConsole
- name: flyteconsole # match images with this name
newTag: v0.12.1 # override the tag
newTag: v0.17.7 # override the tag
newName: docker.io/lyft/flyteconsole # override the namep
# Flyte DataCatalog
- name: datacatalog # match images with this name
Expand Down
4 changes: 2 additions & 2 deletions kustomize/overlays/gcp/kustomization.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -78,11 +78,11 @@ secretGenerator:
images:
# FlyteAdmin
- name: flyteadmin # match images with this name
newTag: v0.3.7 # override the tag
newTag: v0.3.15 # override the tag
newName: docker.io/lyft/flyteadmin # override the name
# FlyteConsole
- name: flyteconsole # match images with this name
newTag: v0.12.1 # override the tag
newTag: v0.17.7 # override the tag
newName: docker.io/lyft/flyteconsole # override the namep
# Flyte DataCatalog
- name: datacatalog # match images with this name
Expand Down
4 changes: 2 additions & 2 deletions kustomize/overlays/sandbox/kustomization.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -63,11 +63,11 @@ configMapGenerator:
images:
# FlyteAdmin
- name: flyteadmin # match images with this name
newTag: v0.3.7 # override the tag
newTag: v0.3.15 # override the tag
newName: docker.io/lyft/flyteadmin # override the name
# FlyteConsole
- name: flyteconsole # match images with this name
newTag: v0.12.1 # override the tag
newTag: v0.17.7 # override the tag
newName: docker.io/lyft/flyteconsole # override the namep
# Flyte DataCatalog
- name: datacatalog # match images with this name
Expand Down
4 changes: 2 additions & 2 deletions kustomize/overlays/test/kustomization.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -63,11 +63,11 @@ configMapGenerator:
images:
# FlyteAdmin
- name: flyteadmin # match images with this name
newTag: v0.3.7 # override the tag
newTag: v0.3.15 # override the tag
newName: docker.io/lyft/flyteadmin # override the name
# FlyteConsole
- name: flyteconsole # match images with this name
newTag: v0.12.1 # override the tag
newTag: v0.17.7 # override the tag
newName: docker.io/lyft/flyteconsole # override the namep
# Flyte DataCatalog
- name: datacatalog # match images with this name
Expand Down
2 changes: 1 addition & 1 deletion rsts/conf.py
Original file line number Diff line number Diff line change
Expand Up @@ -26,7 +26,7 @@
# The short X.Y version
version = u''
# The full version, including alpha/beta/rc tags
release = u'0.8.0'
release = u'0.9.0'


# -- General configuration ---------------------------------------------------
Expand Down