refactor: Improve error handling and logging

[pingsutw]

Tracking issue

NA

Why are the changes needed?

It's difficult to debug since flytekit generates lots of irrelevant log messages.

What changes were proposed in this pull request?

Only print the traceback raised from the user code.

How was this patch tested?

import pandas as pd

from flytekit import task, workflow, ImageSpec, StructuredDataset

new_flytekit = "git+https://github.com/flyteorg/flytekit@44479af966f979ededd4b1aeabd1915027740231"


image = ImageSpec(registry="ghcr.io/unionai-oss", packages=["flytekitplugins-flyteinteractive"])


@task()
def t1() -> int:
    sd = StructuredDataset(uri="s3://abc")
    sd.open(pd.DataFrame).all()
    return 3 + 2


@task()
def t2() -> int:
    raise ValueError("failed")


@workflow
def wf():
    t1()
    t2()


if __name__ == "__main__":
    t1()

Screenshots

Before:

After:

• I updated the documentation accordingly.
• All new and existing tests passed.
• All commits are signed-off.

Related PRs

NA

Docs link

NA

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 91.31%. Comparing base (446bea0) to head (6979550).
Report is 3 commits behind head on master.

❗ Current head 6979550 differs from pull request most recent head 082ce57. Consider uploading reports for the commit 082ce57 to get more accurate results

Additional details and impacted files

@@            Coverage Diff             @@
##           master    #2358      +/-   ##
==========================================
- Coverage   95.81%   91.31%   -4.51%     
==========================================
  Files           5       61      +56     
  Lines         526     2521    +1995     
==========================================
+ Hits          504     2302    +1798     
- Misses         22      219     +197     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.