Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix(ingest) Azure AD: support nested groups (#4367) #4368

Conversation

cccs-eric
Copy link
Contributor

Relates to issue #4367 .
The proposed PR adds support to nested groups in Azure AD, as well as adding a config option to disable logging of filtered out users/groups (see this Slack thread). When dealing with a large Azure AD, many users/groups can be filtered out and the resulting log is very long and useless. Having the possibility to disable that reporting makes the user experience better in my opinion. There might be a better way of doing this as discussed with @dexter-mh-lee . I'm open for feedback.

This PR also:

  • improves datahub-frontend README build instructions
  • fixes AUTH_OIDC_SCOPE for Azure AD authentication
  • fixes a typo in the configure-oidc-react.md file

@github-actions
Copy link

github-actions bot commented Mar 10, 2022

Unit Test Results (build & test)

  91 files  ±0    91 suites  ±0   11m 33s ⏱️ + 5m 0s
595 tests ±0  543 ✔️ ±0  52 💤 ±0  0 ±0 

Results for commit ffb7fe2. ± Comparison against base commit bb8f45b.

♻️ This comment has been updated with latest results.

@github-actions
Copy link

github-actions bot commented Mar 10, 2022

Unit Test Results (metadata ingestion)

       4 files         4 suites   43m 15s ⏱️
   361 tests    361 ✔️   0 💤 0
1 336 runs  1 305 ✔️ 31 💤 0

Results for commit ffb7fe2.

♻️ This comment has been updated with latest results.

@jjoyce0510
Copy link
Collaborator

Thanks for the PR @cccs-eric !

I'm assuming "nested groups" are groups inside other groups? Do we plan to deal with this by "flattening" the nested group to add all of the nested users to the root group on DataHub?

@cccs-eric
Copy link
Contributor Author

That's exactly it @jjoyce0510 . Let's say we have the following:

  • Group A: User 1, Group B, Group C # In this case, Group A is a nested group.
  • Group B: User 2, User 3
  • Group C: User 4, User 5

When ingesting Group A, the source will now create a CorpGroup for Group A, and users 1,2,3,4,5 will be a member of Group A only. Group B and C will not be mapped to a CorpGroup unless they are also ingested as a root group.

Does it makes sense?

@jjoyce0510
Copy link
Collaborator

Yes - that makes sense. Thanks for the explanation!

Copy link
Collaborator

@jjoyce0510 jjoyce0510 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Overall this looks really awesome! Just a few minor comments, then we are good to merge.

@jjoyce0510
Copy link
Collaborator

Looks like lint is failing. You can run ./gradlew metadata-ingestion:lintFix to try to fix this :)

@cccs-eric cccs-eric force-pushed the feature/azure_ad_nested_groups branch from 1ddf934 to ffb7fe2 Compare March 12, 2022 14:45
@shirshanka shirshanka merged commit cb9b99f into datahub-project:master Mar 14, 2022
@cccs-eric cccs-eric deleted the feature/azure_ad_nested_groups branch March 14, 2022 16:14
aditya-radhakrishnan pushed a commit to aditya-radhakrishnan/datahub that referenced this pull request Mar 14, 2022
aditya-radhakrishnan pushed a commit to aditya-radhakrishnan/datahub that referenced this pull request Mar 14, 2022
maggiehays pushed a commit to maggiehays/datahub that referenced this pull request Aug 1, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants