Add support for Union[FlyteFile, FlyteDirectory] as input

[pingsutw]

Tracking issue

NA

Why are the changes needed?

Can not use Union[FlyteFile, FlyteDirectory] as input

What changes were proposed in this pull request?

Check the metadata in the literal before deserializing FlyteFile/FlyteDirectory

How was this patch tested?

local/remote

Setup process

import os
import tempfile
from typing import Union

from flytekit import task, workflow, ImageSpec
from flytekit.types.directory import FlyteDirectory
from flytekit.types.file import FlyteFile

new_flytekit = "git+https://github.com/flyteorg/flytekit.git@d6ae58fb1ee6a7509d15fb1022d294bc2978e1dd"
image_spec = ImageSpec(packages=[new_flytekit], registry="pingsutw", apt_packages=["git"])


@task(container_image=image_spec)
def t1() -> FlyteFile:
    temp_dir = tempfile.mkdtemp(prefix='temp_example_')
    file1_path = os.path.join(temp_dir, 'file1.txt')
    with open(file1_path, 'w') as file1:
        file1.write('Content of file1.txt')
    return file1_path


@task(container_image=image_spec)
def t2() -> FlyteDirectory:
    temp_dir = tempfile.mkdtemp(prefix='temp_example_')
    return temp_dir


@task(container_image=image_spec)
def t3() -> Union[FlyteFile, FlyteDirectory]:
    temp_dir = tempfile.mkdtemp(prefix='temp_example_')
    return temp_dir


@task(container_image=image_spec)
def res(a: Union[FlyteFile, FlyteDirectory]):
    print(a)


@workflow
def wf():
    res(a=t1())
    res(a=t2())
    res(a=t3())


if __name__ == '__main__':
    wf()

Screenshots

Check all the applicable boxes

• I updated the documentation accordingly.
• All new and existing tests passed.
• All commits are signed-off.

Related PRs

NA

Docs link

NA

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 83.31%. Comparing base (4767fd8) to head (9f7e65f).
Report is 2 commits behind head on master.

Additional details and impacted files

@@            Coverage Diff             @@
##           master    #2273      +/-   ##
==========================================
- Coverage   83.78%   83.31%   -0.48%     
==========================================
  Files         332      309      -23     
  Lines       25132    24055    -1077     
  Branches     3703     3493     -210     
==========================================
- Hits        21058    20041    -1017     
+ Misses       3449     3386      -63     
- Partials      625      628       +3     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.