Skip to content

Commit

Permalink
[SPARK-46002][INFRA] Upgrade to Python 3.9 in SQL test
Browse files Browse the repository at this point in the history
### What changes were proposed in this pull request?
Upgrade to Python 3.9 in SQL test

### Why are the changes needed?
this version has not been upgraded in more than 3 years

### Does this PR introduce _any_ user-facing change?
no, test-only

### How was this patch tested?
ci

### Was this patch authored or co-authored using generative AI tooling?
no

Closes apache#43902 from zhengruifeng/infra_sql_py310.

Authored-by: Ruifeng Zheng <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>
  • Loading branch information
zhengruifeng authored and dongjoon-hyun committed Nov 20, 2023
1 parent 8dcdac2 commit 839f0c9
Showing 1 changed file with 6 additions and 6 deletions.
12 changes: 6 additions & 6 deletions .github/workflows/build_and_test.yml
Original file line number Diff line number Diff line change
Expand Up @@ -244,20 +244,20 @@ jobs:
with:
distribution: zulu
java-version: ${{ matrix.java }}
- name: Install Python 3.8
- name: Install Python 3.9
uses: actions/setup-python@v4
# We should install one Python that is higher then 3+ for SQL and Yarn because:
# We should install one Python that is higher than 3+ for SQL and Yarn because:
# - SQL component also has Python related tests, for example, IntegratedUDFTestUtils.
# - Yarn has a Python specific test too, for example, YarnClusterSuite.
if: contains(matrix.modules, 'yarn') || (contains(matrix.modules, 'sql') && !contains(matrix.modules, 'sql-')) || contains(matrix.modules, 'connect')
with:
python-version: 3.8
python-version: '3.9'
architecture: x64
- name: Install Python packages (Python 3.8)
- name: Install Python packages (Python 3.9)
if: (contains(matrix.modules, 'sql') && !contains(matrix.modules, 'sql-')) || contains(matrix.modules, 'connect')
run: |
python3.8 -m pip install 'numpy>=1.20.0' pyarrow pandas scipy unittest-xml-reporting 'grpcio>=1.48,<1.57' 'grpcio-status>=1.48,<1.57' 'protobuf==4.25.1'
python3.8 -m pip list
python3.9 -m pip install 'numpy>=1.20.0' pyarrow pandas scipy unittest-xml-reporting 'grpcio>=1.48,<1.57' 'grpcio-status>=1.48,<1.57' 'protobuf==4.25.1'
python3.9 -m pip list
# Run the tests.
- name: Run tests
env: ${{ fromJSON(inputs.envs) }}
Expand Down

0 comments on commit 839f0c9

Please sign in to comment.