Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bump pyarrow from 3.0.0 to 6.0.0 (for M1 mac installations; duplicates #740) #743

Merged
merged 1 commit into from
Nov 9, 2021
Merged

Bump pyarrow from 3.0.0 to 6.0.0 (for M1 mac installations; duplicates #740) #743

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion dev-requirements.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -202,7 +202,7 @@ py==1.11.0
# -c requirements.txt
# pytest
# retry
pyarrow==3.0.0
pyarrow==6.0.0
# via
# -c requirements.txt
# flytekit
Expand Down
2 changes: 1 addition & 1 deletion doc-requirements.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -234,7 +234,7 @@ py==1.11.0
# via retry
py4j==0.10.9.2
# via pyspark
pyarrow==3.0.0
pyarrow==6.0.0
# via flytekit
pycparser==2.20
# via cffi
Expand Down
2 changes: 1 addition & 1 deletion plugins/flytekit-aws-athena/requirements.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -69,7 +69,7 @@ protobuf==3.17.3
# flytekit
py==1.10.0
# via retry
pyarrow==3.0.0
pyarrow==6.0.0
# via flytekit
python-dateutil==2.8.1
# via
Expand Down
2 changes: 1 addition & 1 deletion plugins/flytekit-aws-sagemaker/requirements.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -101,7 +101,7 @@ psutil==5.8.0
# via sagemaker-training
py==1.10.0
# via retry
pyarrow==3.0.0
pyarrow==6.0.0
# via flytekit
pycparser==2.20
# via cffi
Expand Down
2 changes: 1 addition & 1 deletion plugins/flytekit-data-fsspec/requirements.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -71,7 +71,7 @@ protobuf==3.17.3
# flytekit
py==1.10.0
# via retry
pyarrow==3.0.0
pyarrow==6.0.0
# via flytekit
python-dateutil==2.8.1
# via
Expand Down
2 changes: 1 addition & 1 deletion plugins/flytekit-dolt/requirements.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -77,7 +77,7 @@ protobuf==3.17.3
# flytekit
py==1.10.0
# via retry
pyarrow==3.0.0
pyarrow==6.0.0
# via flytekit
python-dateutil==2.8.1
# via
Expand Down
2 changes: 1 addition & 1 deletion plugins/flytekit-greatexpectations/requirements.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -204,7 +204,7 @@ ptyprocess==0.7.0
# terminado
py==1.10.0
# via retry
pyarrow==3.0.0
pyarrow==6.0.0
# via flytekit
pycparser==2.20
# via cffi
Expand Down
2 changes: 1 addition & 1 deletion plugins/flytekit-hive/requirements.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -69,7 +69,7 @@ protobuf==3.17.3
# flytekit
py==1.10.0
# via retry
pyarrow==3.0.0
pyarrow==6.0.0
# via flytekit
python-dateutil==2.8.1
# via
Expand Down
2 changes: 1 addition & 1 deletion plugins/flytekit-k8s-pod/requirements.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -79,7 +79,7 @@ protobuf==3.17.3
# flytekit
py==1.10.0
# via retry
pyarrow==3.0.0
pyarrow==6.0.0
# via flytekit
pyasn1==0.4.8
# via
Expand Down
2 changes: 1 addition & 1 deletion plugins/flytekit-kf-pytorch/requirements.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -69,7 +69,7 @@ protobuf==3.17.3
# flytekit
py==1.10.0
# via retry
pyarrow==3.0.0
pyarrow==6.0.0
# via flytekit
python-dateutil==2.8.1
# via
Expand Down
2 changes: 1 addition & 1 deletion plugins/flytekit-kf-tensorflow/requirements.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -69,7 +69,7 @@ protobuf==3.17.3
# flytekit
py==1.10.0
# via retry
pyarrow==3.0.0
pyarrow==6.0.0
# via flytekit
python-dateutil==2.8.1
# via
Expand Down
2 changes: 1 addition & 1 deletion plugins/flytekit-modin/requirements.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -98,7 +98,7 @@ protobuf==3.18.0
# ray
py==1.10.0
# via retry
pyarrow==3.0.0
pyarrow==6.0.0
# via flytekit
pycparser==2.20
# via cffi
Expand Down
2 changes: 1 addition & 1 deletion plugins/flytekit-pandera/requirements.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -76,7 +76,7 @@ protobuf==3.17.3
# flytekit
py==1.10.0
# via retry
pyarrow==3.0.0
pyarrow==6.0.0
# via
# flytekit
# pandera
Expand Down
2 changes: 1 addition & 1 deletion plugins/flytekit-papermill/requirements.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -173,7 +173,7 @@ py==1.10.0
# via retry
py4j==0.10.9
# via pyspark
pyarrow==3.0.0
pyarrow==6.0.0
# via flytekit
pygments==2.10.0
# via
Expand Down
2 changes: 1 addition & 1 deletion plugins/flytekit-snowflake/requirements.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -69,7 +69,7 @@ protobuf==3.17.3
# flytekit
py==1.10.0
# via retry
pyarrow==3.0.0
pyarrow==6.0.0
# via flytekit
python-dateutil==2.8.1
# via
Expand Down
2 changes: 1 addition & 1 deletion plugins/flytekit-spark/requirements.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -71,7 +71,7 @@ py==1.10.0
# via retry
py4j==0.10.9
# via pyspark
pyarrow==3.0.0
pyarrow==6.0.0
# via flytekit
pyspark==3.1.2
# via flytekitplugins-spark
Expand Down
2 changes: 1 addition & 1 deletion plugins/flytekit-sqlalchemy/flytekitplugins/sqlalchemy/requirements.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -67,7 +67,7 @@ protobuf==3.17.3
# flytekit
py==1.10.0
# via retry
pyarrow==3.0.0
pyarrow==6.0.0
# via flytekit
python-dateutil==2.8.1
# via
Expand Down
2 changes: 1 addition & 1 deletion plugins/flytekit-sqlalchemy/requirements.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -71,7 +71,7 @@ protobuf==3.17.3
# flytekit
py==1.10.0
# via retry
pyarrow==3.0.0
pyarrow==6.0.0
# via flytekit
python-dateutil==2.8.1
# via
Expand Down
2 changes: 1 addition & 1 deletion requirements-spark2.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -206,7 +206,7 @@ py==1.11.0
# via retry
py4j==0.10.9.2
# via pyspark
pyarrow==3.0.0
pyarrow==6.0.0
# via flytekit
pycparser==2.20
# via cffi
Expand Down
2 changes: 1 addition & 1 deletion requirements.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -204,7 +204,7 @@ py==1.11.0
# via retry
py4j==0.10.9.2
# via pyspark
pyarrow==3.0.0
pyarrow==6.0.0
# via flytekit
pycparser==2.20
# via cffi
Expand Down
4 changes: 2 additions & 2 deletions setup.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -23,7 +23,7 @@
spark = ["pyspark>=2.4.0,<3.0.0"]
spark3 = ["pyspark>=3.0.0"]
sidecar = ["k8s-proto>=0.0.3,<1.0.0"]
schema = ["numpy>=1.14.0,<2.0.0", "pandas>=0.22.0,<2.0.0", "pyarrow>2.0.0"]
schema = ["numpy>=1.14.0,<2.0.0", "pandas>=0.22.0,<2.0.0", "pyarrow>=6.0.0"]
hive_sensor = ["hmsclient>=0.0.1,<1.0.0"]
notebook = ["papermill>=1.2.0", "nbconvert>=6.0.7", "ipykernel>=5.0.0,<6.0.0"]
sagemaker = ["sagemaker-training>=3.6.2,<4.0.0"]
Expand Down Expand Up @@ -67,7 +67,7 @@
"flyteidl>=0.21.4",
"wheel>=0.30.0,<1.0.0",
"pandas>=1.0.0,<2.0.0",
"pyarrow>=2.0.0,<4.0.0",
"pyarrow>=6.0.0,<7.0.0",
"click>=6.6,<8.0",
"croniter>=0.3.20,<4.0.0",
"deprecated>=1.0,<2.0",
Expand Down
2 changes: 1 addition & 1 deletion tests/flytekit/integration/remote/mock_flyte_repo/workflows/requirements.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -81,7 +81,7 @@ protobuf==3.19.1
# flytekit
py==1.11.0
# via retry
pyarrow==3.0.0
pyarrow==6.0.0
# via flytekit
pyparsing==3.0.4
# via matplotlib
Expand Down