Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

refactor: store urns parts in search index builder efficiently #1937

Merged
merged 1 commit into from
Oct 14, 2020

Conversation

jywadhwani
Copy link
Contributor

Checklist

  • The PR conforms to DataHub's Contributing Guideline (particularly Commit Message Format)
  • Links to related issues (if applicable)
  • Tests for the changes have been added/updated (if applicable)
  • Docs related to the changes have been added/updated (if applicable)

@mars-lan mars-lan added the hacktoberfest-accepted Acceptance for hacktoberfest https://hacktoberfest.com/participation/ label Oct 14, 2020
@jywadhwani jywadhwani merged commit 5fca512 into datahub-project:master Oct 14, 2020
@jplaisted
Copy link
Contributor

FYI seems like this ended up not setting the urn for most documents, causing the MAE processor to fail.

@jplaisted
Copy link
Contributor

This also indicates our tests here are lacking.

jplaisted pushed a commit that referenced this pull request Oct 28, 2020
…1937)" (#1970)

This broke MAE processor because not all documents have urns now.

This reverts commit 5fca512.
jywadhwani added a commit to jywadhwani/datahub that referenced this pull request Oct 28, 2020
jplaisted pushed a commit that referenced this pull request Oct 28, 2020
The other index builders need similar improvements, but after #1937 some coverage is better than no coverage.
jywadhwani added a commit to jywadhwani/datahub that referenced this pull request Oct 28, 2020
jywadhwani added a commit that referenced this pull request Oct 29, 2020
…1972)

* refactor search index builder to store urn parts efficiently (#1937)

Co-authored-by: Jyoti Wadhwani <[email protected]>

* set urn for all documents

* rebase, fix merge conflicts and modify tests

Co-authored-by: Jyoti Wadhwani <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
hacktoberfest-accepted Acceptance for hacktoberfest https://hacktoberfest.com/participation/
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants