Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Version specific Jackson classes are left unshaded #3007

Closed
ted-jenks opened this issue Sep 9, 2024 · 0 comments · Fixed by #3017
Closed

Version specific Jackson classes are left unshaded #3007

ted-jenks opened this issue Sep 9, 2024 · 0 comments · Fixed by #3017

Comments

@ted-jenks
Copy link

Describe the bug, including details regarding any error messages, version, and platform.

Screenshot 2024-09-09 at 9 27 23 AM

The current jar contains version specific classes under META-INF/versions/... with unshaded package names. This leads to clashes with jackson and thus classpath duplicates. This is a major problem in many major projects right now (e.g. Spark).

Component(s)

No response

dongjoon-hyun pushed a commit to apache/spark that referenced this issue Oct 8, 2024
### What changes were proposed in this pull request?
The pr aims to upgrade `Parquet` from `1.14.2` to `1.14.3`.

### Why are the changes needed?
The full release notes: https://github.com/apache/parquet-java/releases/tag/apache-parquet-1.14.3
apache/parquet-java#3007: Ensure version specific Jackson classes are shaded
apache/parquet-java#3013: Fix potential ClassCastException at reading DELTA_BYTE_ARRAY encoding

### Does this PR introduce _any_ user-facing change?
No.

### How was this patch tested?
Pass GA.

### Was this patch authored or co-authored using generative AI tooling?
No.

Closes #48378 from panbingkun/SPARK-49903.

Authored-by: panbingkun <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>
himadripal pushed a commit to himadripal/spark that referenced this issue Oct 19, 2024
### What changes were proposed in this pull request?
The pr aims to upgrade `Parquet` from `1.14.2` to `1.14.3`.

### Why are the changes needed?
The full release notes: https://github.com/apache/parquet-java/releases/tag/apache-parquet-1.14.3
apache/parquet-java#3007: Ensure version specific Jackson classes are shaded
apache/parquet-java#3013: Fix potential ClassCastException at reading DELTA_BYTE_ARRAY encoding

### Does this PR introduce _any_ user-facing change?
No.

### How was this patch tested?
Pass GA.

### Was this patch authored or co-authored using generative AI tooling?
No.

Closes apache#48378 from panbingkun/SPARK-49903.

Authored-by: panbingkun <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
1 participant