Support pydantic plugin in 2.xx version

[Future-Outlier]

Tracking Issues

https://flyte-org.slack.com/archives/CP2HDHKE1/p1708960554466059

Why are the changes needed?

When pydantic version >= 2, this current plugin will not work.

What changes were proposed in this pull request?

• use as pydantic to support 2 cases , pydantic version < 2 and pydantic version >= 2
• remove lazy_load to support 2 cases , pydantic version < 2 and pydantic version >= 2

How was this patch tested?

We test it in 2 scenarios, pydantic version < 2 and pydantic version >= 2.
We need to use

• from pydantic import BaseModel when pydantic version < 2
• from pydantic.v1 import BaseModel when pydantic version >= 2

from flytekit import task
from pydantic.v1 import BaseModel

class TrainConfig(BaseModel):
    lr: float = 1e-3
    batch_size: int = 32

@task
# def train() -> TrainConfig:
def train() -> TrainConfig:
    return TrainConfig(lr=1.1, batch_size=64)

if __name__ == "__main__":
    print(train(cfg=TrainConfig(lr=1.1, batch_size=64)))

FROM python:3.9-slim-buster
USER root
WORKDIR /root
ENV PYTHONPATH /root
RUN apt-get update && apt-get install build-essential -y
RUN apt-get install git -y

RUN pip install -U git+https://github.com/flyteorg/flytekit.git@e85e6ec5dba79dc09791abd1f1eac1ce115f0ef6#subdirectory=plugins/flytekit-pydantic

RUN pip install -U git+https://github.com/flyteorg/flytekit.git@e85e6ec5dba79dc09791abd1f1eac1ce115f0ef6

pyflyte run --image futureoutlier/flytekit:pydantic-v2 --remote pydantic_example.py train

Setup process

Screenshots

when pydantic version < 2

from flytekit import task
from pydantic import BaseModel

when pydantic version >= 2

from flytekit import task
from pydantic.v1 import BaseModel

remote execution

warning message

Check all the applicable boxes

• I updated the documentation accordingly.
• All new and existing tests passed.
• All commits are signed-off.

Related PRs

Docs link

[codecov]

Codecov Report

Attention: Patch coverage is 48.00000% with 13 lines in your changes are missing coverage. Please review.

Project coverage is 82.00%. Comparing base (40b8614) to head (4614074).

Files	Patch %	Lines
flytekit/interaction/click_types.py	16.66%	5 Missing ⚠️
.../flytekitplugins/pydantic/basemodel_transformer.py	71.42%	2 Missing ⚠️
...dantic/flytekitplugins/pydantic/deserialization.py	50.00%	2 Missing ⚠️
...pydantic/flytekitplugins/pydantic/serialization.py	50.00%	2 Missing ⚠️
...s/flytekit-pydantic/tests/test_type_transformer.py	50.00%	2 Missing ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##           master    #2217      +/-   ##
==========================================
- Coverage   83.52%   82.00%   -1.53%     
==========================================
  Files         296      306      +10     
  Lines       23244    23894     +650     
  Branches     3481     3481              
==========================================
+ Hits        19415    19594     +179     
- Misses       3207     3672     +465     
- Partials      622      628       +6     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[pingsutw]

Suggested change

# pydantic plugin is not suitable for lazy module.

[Future-Outlier]

will not show a warning message when import flytekit

will show warning message when using pydantic plugin

[pingsutw]

LGTM, thanks