This repository has been archived by the owner on Oct 9, 2023. It is now read-only.

Handle WorkflowClosure from storage#459

Merged

hamersaw merged 28 commits intoflyteorg:masterfrom ckiosidis:add-data-reference-fields-to-crd

Aug 17, 2022

+191-20

Commits on Aug 17, 2022

add data reference fields

Babis Kiosidis
authored and
ckiosidis
committed
combine crd parts into one object/location

Babis Kiosidis
authored and
ckiosidis
committed
create and pass static obj storage to propeller handler

Babis Kiosidis
authored and
ckiosidis
committed
read static blob at the beginning

Babis Kiosidis
authored and
ckiosidis
committed
formatting

Babis Kiosidis
authored and
ckiosidis
committed
pass tests

Babis Kiosidis
authored and
ckiosidis
committed
remove terminated wfs' blob obj from cache

Babis Kiosidis
authored and
ckiosidis
committed
no return on remove blob method

Babis Kiosidis
authored and
ckiosidis
committed
test happy offloaded spec scenario

Babis Kiosidis
authored and
ckiosidis
committed
set static fields on every streak

Babis Kiosidis
authored and
ckiosidis
committed
formatting

Babis Kiosidis
authored and
ckiosidis
committed
added crdOffloadStore interface

hamersaw
authored and
ckiosidis
committed
made crdoffloadstore configurable

hamersaw
authored and
ckiosidis
committed
add metrics/formatting

Babis Kiosidis
authored and
ckiosidis
committed
load static workflow data outside streak loop

Babis Kiosidis
authored and
ckiosidis
committed
cleaned up metric reporting

hamersaw
authored and
ckiosidis
committed
renamed inmemory to active

hamersaw
authored and
ckiosidis
committed
added lruCRDOffloadStore unit tests

hamersaw
authored and
ckiosidis
committed
added activeCRDOffloadStore unit tests

hamersaw
authored and
ckiosidis
committed
added unit test for offloading crd error on handle

hamersaw
authored and
ckiosidis
committed
handle offloaded WorkflowClosure instead of parts of the crd

Babis Kiosidis
authored and
ckiosidis
committed
cache wf crd fields instead of wf closure
ckiosidis
committed
Update pkg/controller/controller.go

ckiosidis
and
kumare3
committed
reading workflow closure directly from data store rather than cache

hamersaw
authored and
ckiosidis
committed
added prometheus metric

hamersaw
authored and
ckiosidis
committed
updated comments

hamersaw
authored and
ckiosidis
committed
fixed unit tests

hamersaw
authored and
ckiosidis
committed
fixed lint issue

hamersaw
authored and
ckiosidis
committed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Handle WorkflowClosure from storage#459

Commits on Aug 17, 2022

add data reference fields

combine crd parts into one object/location

create and pass static obj storage to propeller handler

read static blob at the beginning

formatting

pass tests

remove terminated wfs' blob obj from cache

no return on remove blob method

test happy offloaded spec scenario

set static fields on every streak

formatting

added crdOffloadStore interface

made crdoffloadstore configurable

add metrics/formatting

load static workflow data outside streak loop

cleaned up metric reporting

renamed inmemory to active

added lruCRDOffloadStore unit tests

added activeCRDOffloadStore unit tests

added unit test for offloading crd error on handle

handle offloaded WorkflowClosure instead of parts of the crd

cache wf crd fields instead of wf closure

Update pkg/controller/controller.go

reading workflow closure directly from data store rather than cache

added prometheus metric

updated comments

fixed unit tests

fixed lint issue