Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update Rucio Int url #10855

Merged
merged 1 commit into from
Oct 7, 2021
Merged

Update Rucio Int url #10855

merged 1 commit into from
Oct 7, 2021

Conversation

amaltaro
Copy link
Contributor

@amaltaro amaltaro commented Oct 7, 2021

Fixes #10854

Status

ready

Description

As requested by Eric V., Rucio Integration server is under a new domain name. This PR updates every single place that had a reference to the - about to be - deprecated urls.

Is it backward compatible (if not, which system it affects?)

yes

Related PRs

None

External dependencies / deployment changes

Preprod services_config changes (to be deployed in testbed asap!): https://gitlab.cern.ch/cmsweb-k8s/services_config/-/merge_requests/112
Deployment changes: dmwm/deployment#1095

@cmsdmwmbot
Copy link

Jenkins results:

  • Python2 Unit tests: failed
    • 4 new failures
  • Python3 Unit tests: failed
    • 4 new failures
    • 2 changes in unstable tests
  • Python2 Pylint check: failed
    • 51 warnings and errors that must be fixed
    • 8 warnings
    • 114 comments to review
  • Python3 Pylint check: failed
    • 52 warnings and errors that must be fixed
    • 8 warnings
    • 145 comments to review
  • Pylint py3k check: failed
    • 2 warnings
  • Pycodestyle check: succeeded
    • 32 comments to review

Details at https://cmssdt.cern.ch/dmwm-jenkins/view/All/job/DMWM-WMCore-PR-test/12486/artifact/artifacts/PullRequestReport.html

@amaltaro
Copy link
Contributor Author

amaltaro commented Oct 7, 2021

test this please

@cmsdmwmbot
Copy link

Jenkins results:

  • Python2 Unit tests: failed
    • 18 new failures
  • Python3 Unit tests: failed
    • 17 new failures
    • 3 changes in unstable tests
  • Python2 Pylint check: failed
    • 51 warnings and errors that must be fixed
    • 8 warnings
    • 114 comments to review
  • Python3 Pylint check: failed
    • 52 warnings and errors that must be fixed
    • 8 warnings
    • 145 comments to review
  • Pylint py3k check: failed
    • 2 warnings
  • Pycodestyle check: succeeded
    • 32 comments to review

Details at https://cmssdt.cern.ch/dmwm-jenkins/view/All/job/DMWM-WMCore-PR-test/12488/artifact/artifacts/PullRequestReport.html

@amaltaro
Copy link
Contributor Author

amaltaro commented Oct 7, 2021

test this please

@cmsdmwmbot
Copy link

Jenkins results:

  • Python2 Unit tests: failed
    • 19 new failures
  • Python3 Unit tests: failed
    • 17 new failures
    • 2 changes in unstable tests
  • Python2 Pylint check: failed
    • 51 warnings and errors that must be fixed
    • 8 warnings
    • 114 comments to review
  • Python3 Pylint check: failed
    • 52 warnings and errors that must be fixed
    • 8 warnings
    • 145 comments to review
  • Pylint py3k check: failed
    • 2 warnings
  • Pycodestyle check: succeeded
    • 32 comments to review

Details at https://cmssdt.cern.ch/dmwm-jenkins/view/All/job/DMWM-WMCore-PR-test/12489/artifact/artifacts/PullRequestReport.html

@amaltaro
Copy link
Contributor Author

amaltaro commented Oct 7, 2021

And just as I feared/expected, we still have some unit tests relying on PhEDEx data/calls. Many - if not all - of these failures are coming from the current outage of the datasvc in CMSWEB

url=https://cmsweb.cern.ch:8443/phedex/datasvc/json/prod/nodes, code=503, reason=Service Unavailable

I'm considering to merge this, such that Eric V. can move forward with the decommissioning of the old Rucio Int cluster. Then I will work on these new failures with this GH issue: #10176

@cmsdmwmbot
Copy link

Jenkins results:

  • Python2 Unit tests: failed
    • 19 new failures
  • Python3 Unit tests: failed
    • 17 new failures
    • 1 changes in unstable tests
  • Python2 Pylint check: failed
    • 51 warnings and errors that must be fixed
    • 8 warnings
    • 114 comments to review
  • Python3 Pylint check: failed
    • 52 warnings and errors that must be fixed
    • 8 warnings
    • 145 comments to review
  • Pylint py3k check: failed
    • 2 warnings
  • Pycodestyle check: succeeded
    • 32 comments to review

Details at https://cmssdt.cern.ch/dmwm-jenkins/view/All/job/DMWM-WMCore-PR-test/12491/artifact/artifacts/PullRequestReport.html

@cmsdmwmbot
Copy link

Jenkins results:

  • Python2 Unit tests: failed
    • 19 new failures
  • Python3 Unit tests: failed
    • 17 new failures
    • 3 changes in unstable tests
  • Python2 Pylint check: failed
    • 51 warnings and errors that must be fixed
    • 8 warnings
    • 114 comments to review
  • Python3 Pylint check: failed
    • 52 warnings and errors that must be fixed
    • 8 warnings
    • 145 comments to review
  • Pylint py3k check: failed
    • 2 warnings
  • Pycodestyle check: succeeded
    • 32 comments to review

Details at https://cmssdt.cern.ch/dmwm-jenkins/view/All/job/DMWM-WMCore-PR-test/12492/artifact/artifacts/PullRequestReport.html

@cmsdmwmbot
Copy link

Jenkins results:

  • Python2 Unit tests: failed
    • 3 new failures
  • Python3 Unit tests: failed
    • 3 new failures
    • 1 changes in unstable tests
  • Python2 Pylint check: failed
    • 51 warnings and errors that must be fixed
    • 8 warnings
    • 114 comments to review
  • Python3 Pylint check: failed
    • 52 warnings and errors that must be fixed
    • 8 warnings
    • 145 comments to review
  • Pylint py3k check: failed
    • 2 warnings
  • Pycodestyle check: succeeded
    • 32 comments to review

Details at https://cmssdt.cern.ch/dmwm-jenkins/view/All/job/DMWM-WMCore-PR-test/12497/artifact/artifacts/PullRequestReport.html

@amaltaro
Copy link
Contributor Author

amaltaro commented Oct 7, 2021

Now there are only these 3 unit tests failing:

    WMCore_t.MicroService_t.Tools_t.PycurlRucio_t.PycurlRucioTests:testGetBlocksAndSizeRucio changed from success to error
    WMCore_t.MicroService_t.Tools_t.PycurlRucio_t.PycurlRucioTests:testGetPileupContainerSizesRucio changed from success to error
    WMCore_t.MicroService_t.Tools_t.PycurlRucio_t.PycurlRucioTests:testListReplicationRules changed from success to error

with this error:

======================================================================
ERROR: Test the listReplicationRules function, which fetches the container
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/home/dmwm/wmcore_unittest/WMCore/test/python/WMCore_t/MicroService_t/Tools_t/PycurlRucio_t.py", line 73, in testListReplicationRules
    self.rucioToken, self.tokenValidity = getRucioToken(self.rucioAuthUrl, self.rucioAccount)
  File "/home/dmwm/wmcore_unittest/WMCore/src/python/WMCore/MicroService/Tools/PycurlRucio.py", line 78, in getRucioToken
    res = mgr.getheader(url, params=params, headers=headers, ckey=ckey(), cert=cert())
  File "/home/dmwm/wmcore_unittest/WMCore/src/python/WMCore/Services/pycurl_manager.py", line 324, in getheader
    header, _ = self.request(url, params, headers, verb,
  File "/home/dmwm/wmcore_unittest/WMCore/src/python/Utils/PortForward.py", line 69, in portMangle
    return callFunc(callObj, url, *args, **kwargs)
  File "/home/dmwm/wmcore_unittest/WMCore/src/python/WMCore/Services/pycurl_manager.py", line 283, in request
    curl.perform()
pycurl.error: (51, "SSL: no alternative certificate subject name matches target host name 'cms-rucio-auth-int.cern.ch'")

I'm following this up with Eric via slack.

@cmsdmwmbot
Copy link

Jenkins results:

  • Python2 Unit tests: failed
    • 3 new failures
  • Python3 Unit tests: failed
    • 3 new failures
    • 1 changes in unstable tests
  • Python2 Pylint check: failed
    • 51 warnings and errors that must be fixed
    • 8 warnings
    • 114 comments to review
  • Python3 Pylint check: failed
    • 52 warnings and errors that must be fixed
    • 8 warnings
    • 145 comments to review
  • Pylint py3k check: failed
    • 2 warnings
  • Pycodestyle check: succeeded
    • 32 comments to review

Details at https://cmssdt.cern.ch/dmwm-jenkins/view/All/job/DMWM-WMCore-PR-test/12499/artifact/artifacts/PullRequestReport.html

@cmsdmwmbot
Copy link

Jenkins results:

  • Python2 Unit tests: failed
    • 4 new failures
    • 15 tests no longer failing
    • 1 changes in unstable tests
  • Python3 Unit tests: failed
    • 3 new failures
    • 13 tests no longer failing
  • Python2 Pylint check: failed
    • 51 warnings and errors that must be fixed
    • 8 warnings
    • 114 comments to review
  • Python3 Pylint check: failed
    • 52 warnings and errors that must be fixed
    • 8 warnings
    • 145 comments to review
  • Pylint py3k check: failed
    • 2 warnings
  • Pycodestyle check: succeeded
    • 32 comments to review

Details at https://cmssdt.cern.ch/dmwm-jenkins/view/All/job/DMWM-WMCore-PR-test/12501/artifact/artifacts/PullRequestReport.html

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Update Rucio Int urls whenever we have default values defined
2 participants