Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add buildAllDep option && Fix package verstion estimation for ParseSpecCmsswdist. #11132

Conversation

todor-ivanov
Copy link
Contributor

Fixes #11131

Status

READY

Description

With the current PR we are adding the following options to the ParseSpecCmsswdist.py script

  • --all to be able to parse all spec files not only python related
  • --level` to state the level of recursion

And we fix version string parsing for non-python packages

Is it backward compatible (if not, which system it affects?)

YES

Related PRs

None

External dependencies / deployment changes

None

@todor-ivanov todor-ivanov requested review from vkuznet and amaltaro May 6, 2022 12:42
@cmsdmwmbot
Copy link

Jenkins results:

  • Python3 Unit tests: succeeded
    • 7 tests added
    • 2 changes in unstable tests
  • Python3 Pylint check: failed
    • 3 warnings and errors that must be fixed
    • 4 comments to review
  • Pylint py3k check: succeeded
  • Pycodestyle check: succeeded
    • 5 comments to review

Details at https://cmssdt.cern.ch/dmwm-jenkins/view/All/job/DMWM-WMCore-PR-test/13159/artifact/artifacts/PullRequestReport.html

bin/adhoc-scripts/ParseSpecCmsswdist.py Show resolved Hide resolved
bin/adhoc-scripts/ParseSpecCmsswdist.py Outdated Show resolved Hide resolved
@todor-ivanov todor-ivanov force-pushed the bugfix_Dep_FixParseSpecCmsswdistRecursiveRun_fix-11131 branch from 79b3da5 to e7323bc Compare May 6, 2022 14:00
@todor-ivanov
Copy link
Contributor Author

Thanks for your review @vkuznet I think I have addressed your comments. Could you please take another look?

@todor-ivanov todor-ivanov requested a review from vkuznet May 6, 2022 14:06
@cmsdmwmbot
Copy link

Jenkins results:

  • Python3 Unit tests: succeeded
    • 7 tests added
    • 2 changes in unstable tests
  • Python3 Pylint check: failed
    • 3 warnings and errors that must be fixed
    • 4 comments to review
  • Pylint py3k check: succeeded
  • Pycodestyle check: succeeded
    • 5 comments to review

Details at https://cmssdt.cern.ch/dmwm-jenkins/view/All/job/DMWM-WMCore-PR-test/13162/artifact/artifacts/PullRequestReport.html

Copy link
Contributor

@amaltaro amaltaro left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Todor, please find some comments along the code for your consideration.

logging.info("%s: specsAll: \n%s", specfile, pformat(specsAll))
logging.info("%s: sepcsPy: \n%s", specfile, pformat(specsPy))
if buildAllDep:
for spec in specsAll:
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

How about replacing these 3 lines by:

DEPS_SPEC.extend(spec)

and then at the very end of this script, filtering to unique dependencies only (list(set(DEPS_SPEC)))?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

that's a valid point. I was just trying to make the intervention as little as possible. But yes lets do it the right way. So I did suggest even shorter path here. Please take a look.

bin/adhoc-scripts/ParseSpecCmsswdist.py Outdated Show resolved Hide resolved
bin/adhoc-scripts/ParseSpecCmsswdist.py Outdated Show resolved Hide resolved
bin/adhoc-scripts/ParseSpecCmsswdist.py Outdated Show resolved Hide resolved
…ecCmsswdist.

Fix variable type transition.

change DEPS_SPEC type to set && Switch to log level info.
@todor-ivanov todor-ivanov force-pushed the bugfix_Dep_FixParseSpecCmsswdistRecursiveRun_fix-11131 branch from e7323bc to d3d618a Compare May 9, 2022 17:22
@cmsdmwmbot
Copy link

Jenkins results:

  • Python3 Unit tests: succeeded
    • 7 tests added
  • Python3 Pylint check: failed
    • 4 warnings and errors that must be fixed
    • 4 comments to review
  • Pylint py3k check: succeeded
  • Pycodestyle check: succeeded
    • 3 comments to review

Details at https://cmssdt.cern.ch/dmwm-jenkins/view/All/job/DMWM-WMCore-PR-test/13177/artifact/artifacts/PullRequestReport.html

@cmsdmwmbot
Copy link

Jenkins results:

  • Python3 Unit tests: succeeded
    • 7 tests added
  • Python3 Pylint check: failed
    • 1 warnings and errors that must be fixed
    • 4 comments to review
  • Pylint py3k check: succeeded
  • Pycodestyle check: succeeded
    • 3 comments to review

Details at https://cmssdt.cern.ch/dmwm-jenkins/view/All/job/DMWM-WMCore-PR-test/13179/artifact/artifacts/PullRequestReport.html

@amaltaro amaltaro self-requested a review May 9, 2022 20:41
Copy link
Contributor

@amaltaro amaltaro left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I would get rid of the global variable here, but given that it's only a bin script and you have likely tested it, let's get it merged. Thanks for making those changes.

@amaltaro amaltaro merged commit 61f35e0 into dmwm:master May 9, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Failed recursive run with ParseSpecCmsswdist && non-python dependencies skipped
4 participants