Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Artifact protos and related changes #4474

Merged
merged 61 commits into from
Dec 27, 2023
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
61 commits
Select commit Hold shift + click to select a range
34666a2
use-personal
wild-endeavor Aug 31, 2023
efd28b9
tidy
wild-endeavor Aug 31, 2023
165bcf2
update port to 30004
wild-endeavor Sep 4, 2023
df3b046
Artifacts bundle (#7)
wild-endeavor Sep 26, 2023
5d54379
Remove private repos (#4078)
wild-endeavor Sep 26, 2023
f33132a
nit from monorepo merge
wild-endeavor Sep 29, 2023
c9ce299
Artifacts bring in idl (#4204)
wild-endeavor Oct 11, 2023
6792f4e
Artifacts bring admin monorepo (#4203)
wild-endeavor Oct 30, 2023
ee03489
Artf/triggers (#4394)
wild-endeavor Nov 10, 2023
9741afc
make trigger key index unique (#4410)
wild-endeavor Nov 13, 2023
e7d66ec
revert data proxy changes (#4411)
wild-endeavor Nov 13, 2023
568127e
merge master and fix up some unit tests
wild-endeavor Nov 13, 2023
096b7c1
artf/ fix issue with trigger (#4412)
wild-endeavor Nov 13, 2023
05b4ea0
sandbox lite dockerfile (#4413)
wild-endeavor Nov 13, 2023
63b577e
More pgconn handling fixes (#4420)
wild-endeavor Nov 14, 2023
484e144
Artf/switch event (#4428)
wild-endeavor Nov 15, 2023
2e256d3
Artf/lints (#4429)
wild-endeavor Nov 15, 2023
d434103
look for other places where pgconn is cast and add handling (#4430)
wild-endeavor Nov 15, 2023
9584959
add artifacts branch to buf push (#4448)
squiishyy Nov 17, 2023
ba21a65
add dummy comment (#4451)
squiishyy Nov 17, 2023
4dbcba3
add dummy comment again (#4453)
squiishyy Nov 17, 2023
c3ce7aa
artf/updates to source (#4443)
wild-endeavor Nov 21, 2023
fdd8fe9
Merge remote-tracking branch 'origin/master' into artifacts
wild-endeavor Nov 22, 2023
8a895b9
add a feature gate (#4472)
wild-endeavor Nov 23, 2023
9d7e55e
fix bug in execution_manager with lpExpectedInputs, remove the standa…
wild-endeavor Nov 23, 2023
72f8b31
initial deletion of artifact code
wild-endeavor Nov 23, 2023
6cbd980
running make manifests in docker/sandbox-bundled to update generated …
wild-endeavor Nov 24, 2023
f6ea5d9
now compiles (#4481)
wild-endeavor Nov 27, 2023
098e5be
add a debug line
wild-endeavor Dec 1, 2023
ae30de8
more debugging
wild-endeavor Dec 1, 2023
8d8ce67
clean up go mod and switch the order of the input extraction to check…
wild-endeavor Dec 1, 2023
7a9d6a8
resolve merge conflicts
wild-endeavor Dec 20, 2023
0d38bdc
change artifacts http mappings in protos
squiishyy Dec 7, 2023
1330343
testing removal of go mod pin
wild-endeavor Dec 20, 2023
424db05
update go mod some more
wild-endeavor Dec 20, 2023
fecb836
merge master again
wild-endeavor Dec 20, 2023
c3cfa6f
copilot go mod
wild-endeavor Dec 20, 2023
5771394
change artifacts http mappings again (#4562)
squiishyy Dec 8, 2023
e743da7
panic and revert gorm log level change
wild-endeavor Dec 21, 2023
80267bd
revert local to 5
wild-endeavor Dec 21, 2023
cdae872
Merge branch 'artifacts-shell' of github.com:flyteorg/flyte into arti…
wild-endeavor Dec 21, 2023
a303ec9
make helm
wild-endeavor Dec 21, 2023
6777cb2
Merge remote-tracking branch 'origin/master' into artifacts-shell
wild-endeavor Dec 21, 2023
00545fd
Reclaim space prior to running functional tests in single-binary
eapolinario Dec 21, 2023
cfa4745
Pin flytectl version to 0.8.0
eapolinario Dec 21, 2023
e3cd981
Merge remote-tracking branch 'origin' into artifacts-shell
eapolinario Dec 21, 2023
673a4c1
Revert "Pin flytectl version to 0.8.0"
eapolinario Dec 21, 2023
3528c2e
Use flytagent v1.10.2
eapolinario Dec 21, 2023
7972fca
Debug single-binary
eapolinario Dec 22, 2023
890a80e
Use an infinite loop instead of watch (term env var is not set)
eapolinario Dec 22, 2023
a11d90e
Get logs from single-binary pod
eapolinario Dec 22, 2023
d14a140
Debug single-binary pod: use a different way of choosing the pod
eapolinario Dec 22, 2023
3968d40
Fix flytectl version
eapolinario Dec 22, 2023
8ded67b
Use port 5432 to connect to postgres
eapolinario Dec 22, 2023
3c7dbf6
Revert "Use port 5432 to connect to postgres"
eapolinario Dec 22, 2023
dd49bb2
Revert "Fix flytectl version"
eapolinario Dec 22, 2023
8ce70c2
fix database error
wild-endeavor Dec 23, 2023
7872748
Merge remote-tracking branch 'origin/master' into artifacts-shell
wild-endeavor Dec 23, 2023
ce5cb7b
revert .github/workflows/single-binary.yml by pulling from master
wild-endeavor Dec 23, 2023
8755b28
Merge branch 'master' into artifacts-shell
eapolinario Dec 26, 2023
80316c7
Review feedback
eapolinario Dec 26, 2023
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions .github/workflows/flyteidl-buf-publish.yml
Original file line number Diff line number Diff line change
Expand Up @@ -3,6 +3,7 @@ name: Publish flyteidl Buf Package
on:
push:
branches:
- artifacts-shell
- artifacts
- master
paths:
Expand Down
2 changes: 1 addition & 1 deletion charts/flyte-sandbox/Chart.lock
Original file line number Diff line number Diff line change
Expand Up @@ -15,4 +15,4 @@ dependencies:
repository: https://charts.bitnami.com/bitnami
version: 12.1.9
digest: sha256:e7155e540bbdb98f690eb12e2bd301a19d8b36833336f6991410cb44d8d9bb5e
generated: "2023-03-31T09:25:07.80904-07:00"
generated: "2023-10-28T10:05:34.269916+08:00"
2 changes: 1 addition & 1 deletion charts/flyte-sandbox/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -40,7 +40,7 @@ A Helm chart for the Flyte local sandbox
| flyte-binary.configuration.inline.task_resources.limits.gpu | int | `0` | |
| flyte-binary.configuration.inline.task_resources.limits.memory | int | `0` | |
| flyte-binary.configuration.inlineConfigMap | string | `"{{ include \"flyte-sandbox.configuration.inlineConfigMap\" . }}"` | |
| flyte-binary.configuration.logging.level | int | `6` | |
| flyte-binary.configuration.logging.level | int | `5` | |
| flyte-binary.configuration.logging.plugins.kubernetes.enabled | bool | `true` | |
| flyte-binary.configuration.logging.plugins.kubernetes.templateUri | string | `"http://localhost:30080/kubernetes-dashboard/#/log/{{.namespace }}/{{ .podName }}/pod?namespace={{ .namespace }}"` | |
| flyte-binary.configuration.storage.metadataContainer | string | `"my-s3-bucket"` | |
Expand Down
2 changes: 1 addition & 1 deletion charts/flyte-sandbox/values.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -29,7 +29,7 @@ flyte-binary:
accessKey: minio
secretKey: miniostorage
logging:
level: 6
level: 5
plugins:
kubernetes:
enabled: true
Expand Down
2 changes: 1 addition & 1 deletion charts/flyteagent/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -20,7 +20,7 @@ A Helm chart for Flyte agent
| fullnameOverride | string | `""` | |
| image.pullPolicy | string | `"IfNotPresent"` | Docker image pull policy |
| image.repository | string | `"ghcr.io/flyteorg/flyteagent"` | Docker image for flyteagent deployment |
| image.tag | string | `"1.10.1"` | Docker image tag |
| image.tag | string | `"1.10.2"` | Docker image tag |
| nameOverride | string | `""` | |
| nodeSelector | object | `{}` | nodeSelector for flyteagent deployment |
| podAnnotations | object | `{}` | Annotations for flyteagent pods |
Expand Down
2 changes: 1 addition & 1 deletion charts/flyteagent/values.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -23,7 +23,7 @@ image:
# -- Docker image for flyteagent deployment
repository: ghcr.io/flyteorg/flyteagent
# -- Docker image tag
tag: 1.10.1 # FLYTEAGENT_TAG
tag: 1.10.2 # FLYTEAGENT_TAG
# -- Docker image pull policy
pullPolicy: IfNotPresent
ports:
Expand Down
20 changes: 9 additions & 11 deletions datacatalog/go.mod
Original file line number Diff line number Diff line change
Expand Up @@ -9,17 +9,17 @@ require (
github.com/gofrs/uuid v4.2.0+incompatible
github.com/golang/glog v1.1.0
github.com/golang/protobuf v1.5.3
github.com/jackc/pgconn v1.10.1
github.com/jackc/pgconn v1.14.1
github.com/mitchellh/mapstructure v1.5.0
github.com/spf13/cobra v1.7.0
github.com/spf13/pflag v1.0.5
github.com/stretchr/testify v1.8.4
go.opentelemetry.io/contrib/instrumentation/google.golang.org/grpc/otelgrpc v0.35.0
go.opentelemetry.io/otel v1.19.0
google.golang.org/grpc v1.56.1
gorm.io/driver/postgres v1.2.3
gorm.io/driver/sqlite v1.5.0
gorm.io/gorm v1.25.1
gorm.io/driver/postgres v1.5.3
gorm.io/driver/sqlite v1.5.4
gorm.io/gorm v1.25.4
gorm.io/plugin/opentelemetry v0.1.4
)

Expand All @@ -46,6 +46,7 @@ require (
github.com/flyteorg/stow v0.3.8 // indirect
github.com/fsnotify/fsnotify v1.6.0 // indirect
github.com/ghodss/yaml v1.0.0 // indirect
github.com/go-gormigrate/gormigrate/v2 v2.1.1 // indirect
github.com/go-logr/logr v1.2.4 // indirect
github.com/go-logr/stdr v1.2.2 // indirect
github.com/go-openapi/jsonpointer v0.19.6 // indirect
Expand All @@ -65,10 +66,9 @@ require (
github.com/jackc/chunkreader/v2 v2.0.1 // indirect
github.com/jackc/pgio v1.0.0 // indirect
github.com/jackc/pgpassfile v1.0.0 // indirect
github.com/jackc/pgproto3/v2 v2.2.0 // indirect
github.com/jackc/pgservicefile v0.0.0-20200714003250-2b9c44734f2b // indirect
github.com/jackc/pgtype v1.9.0 // indirect
github.com/jackc/pgx/v4 v4.14.0 // indirect
github.com/jackc/pgproto3/v2 v2.3.2 // indirect
github.com/jackc/pgservicefile v0.0.0-20221227161230-091c0ba34f0a // indirect
github.com/jackc/pgx/v5 v5.4.3 // indirect
github.com/jinzhu/inflection v1.0.0 // indirect
github.com/jinzhu/now v1.1.5 // indirect
github.com/jmespath/go-jmespath v0.4.0 // indirect
Expand All @@ -79,7 +79,7 @@ require (
github.com/mailru/easyjson v0.7.7 // indirect
github.com/mattn/go-colorable v0.1.12 // indirect
github.com/mattn/go-isatty v0.0.14 // indirect
github.com/mattn/go-sqlite3 v1.14.15 // indirect
github.com/mattn/go-sqlite3 v1.14.17 // indirect
github.com/matttproud/golang_protobuf_extensions v1.0.4 // indirect
github.com/modern-go/concurrent v0.0.0-20180306012644-bacd9c7ef1dd // indirect
github.com/modern-go/reflect2 v1.0.2 // indirect
Expand Down Expand Up @@ -145,8 +145,6 @@ replace (
github.com/flyteorg/flyte/flyteplugins => ../flyteplugins
github.com/flyteorg/flyte/flytepropeller => ../flytepropeller
github.com/flyteorg/flyte/flytestdlib => ../flytestdlib
gorm.io/driver/sqlite => gorm.io/driver/sqlite v1.1.1
gorm.io/gorm => gorm.io/gorm v1.22.4
k8s.io/api => k8s.io/api v0.28.2
k8s.io/apimachinery => k8s.io/apimachinery v0.28.2
k8s.io/client-go => k8s.io/client-go v0.28.2
Expand Down
Loading
Loading