Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

BIGTOP-4298: Upgrade Ranger to 2.5.0 #1318

Closed
wants to merge 3 commits into from

Conversation

JiaLiangC
Copy link
Contributor

Description of PR

upgrade ranger to 2.5.0

The Ranger plugin does not support Kafka 3, and including Kafka 3 will cause compilation failures. Kafka 3 has its own permission/authorization system, so the Kafka plugin compilation has been removed.

How was this patch tested?

build successfully in rocky-8
. /etc/profile.d/bigtop.sh;./gradlew ranger-clean ranger-pkg -PbuildThreads=2C repo
image

smote test run successfully on rocky-8
./docker-hadoop.sh -d -dcp -C config_rockylinux-8.yaml -F docker-compose-cgroupv2.yml -r file:///bigtop-home/output -L -G -k bigtop-utils,ranger -s ranger -c 1
image

build successfully in debian-11
image

smote test run successfully on debian-11
./docker-hadoop.sh -d -dcp -C config_debian-11.yaml -F docker-compose-cgroupv2.yml -r file:///bigtop-home/output -L -G -k bigtop-utils,ranger -s ranger -c 1
image

For code changes:

  • Does the title or this PR starts with the corresponding JIRA issue id (e.g. 'BIGTOP-3638. Your PR title ...')?
  • Make sure that newly added files do not have any licensing issues. When in doubt refer to https://www.apache.org/licenses/

@JiaLiangC JiaLiangC requested a review from sekikn December 9, 2024 08:15
@iwasakims
Copy link
Member

Hmm. Packaging fails due to unresolved dependency. I will retry this tomorrow to see if it is server side issue.

[ERROR] Failed to execute goal on project ranger-knox-plugin: Could not resolve dependencies for project org.apache.ranger:ranger-knox-plugin:jar:2.5.0: The following artifacts could not be resolved: org.jetbrains.pty4j:pty4j:jar:0.11.4, org.jetbrains.pty4j:purejavacomm:jar:0.0.11.1: Could not find artifact org.jetbrains.pty4j:pty4j:jar:0.11.4 in apache.snapshots.https (https://repository.apache.org/content/repositories/snapshots) -> [Help 1]

@JiaLiangC
Copy link
Contributor Author

Hmm. Packaging fails due to unresolved dependency. I will retry this tomorrow to see if it is server side issue.

[ERROR] Failed to execute goal on project ranger-knox-plugin: Could not resolve dependencies for project org.apache.ranger:ranger-knox-plugin:jar:2.5.0: The following artifacts could not be resolved: org.jetbrains.pty4j:pty4j:jar:0.11.4, org.jetbrains.pty4j:purejavacomm:jar:0.0.11.1: Could not find artifact org.jetbrains.pty4j:pty4j:jar:0.11.4 in apache.snapshots.https (https://repository.apache.org/content/repositories/snapshots) -> [Help 1]

I encountered similar dependency download issues when compiling Ranger. I resolved it by replacing all Maven mirror repositories in Ranger's root pom file with China's domestic mirrors, and then it worked fine. I didn't make this commit because it's likely due to China's network isolation issues.

@iwasakims
Copy link
Member

@JiaLiangC We need the patch of RANGER-4919 to fix the build failure. Could add the patch file to bigtop-packages/src/common/ranger?

@JiaLiangC JiaLiangC closed this by deleting the head repository Dec 25, 2024
@iwasakims
Copy link
Member

@JiaLiangC Are you willing to keep working on this?

@JiaLiangC
Copy link
Contributor Author

@iwasakims Of course, my personal repository was too messy, so I closed it and forked the repository again, which resulted in the PR being closed.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants