-
Notifications
You must be signed in to change notification settings - Fork 304
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Raise an exception in case of local execution of raw containers tasks #1745
Conversation
Signed-off-by: eduardo apolinario <[email protected]>
…-locally Signed-off-by: Eduardo Apolinario <[email protected]>
Signed-off-by: eduardo apolinario <[email protected]>
for k, v in self.environment.items(): | ||
env += f" -e {k}={v}" | ||
print( | ||
f"\ndocker run --rm -v /tmp/inputs:{self._input_data_dir} -v /tmp/outputs:{self._output_data_dir} {env}" |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
qq: Why can't we run it with Docker?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
That'd be an interesting feature, we have to assume that the docker client is configured properly (which I think it's a fair assumption). In order for this to happen we have to solve a few problems:
- literals and promise generation. This can be easily done in
local_execute
. - Detect some features that we can't implement locally, for example pod templates.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I opened flyteorg/flyte#3876 to track this work.
…#1745) * Raise an exception in case of local raw containers Signed-off-by: eduardo apolinario <[email protected]> * Remove ContainerTask tests from test_type_hints Signed-off-by: eduardo apolinario <[email protected]> --------- Signed-off-by: eduardo apolinario <[email protected]> Signed-off-by: Eduardo Apolinario <[email protected]> Co-authored-by: eduardo apolinario <[email protected]>
TL;DR
ditto
Type
Are all requirements met?
Complete description
How did you fix the bug, make the feature etc. Link to any design docs etc
Tracking Issue
flyteorg/flyte#3833
Follow-up issue
NA
OR
https://github.com/flyteorg/flyte/issues/