Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[PERF] Move performance testing YAML from dotnet/runtime to dotnet/performance #111454

Merged
Merged
Show file tree
Hide file tree
Changes from 2 commits
Commits
Show all changes
25 commits
Select commit Hold shift + click to select a range
7f83cf4
Move runtime yaml to performance
caaavik-msft Jan 2, 2025
1e7256e
Fix yaml path
caaavik-msft Jan 2, 2025
8b1858f
Fix extends template parameters
caaavik-msft Jan 2, 2025
6137e70
Try to fix invalid stages
caaavik-msft Jan 2, 2025
3c1e8a0
Try defining resource in root template
caaavik-msft Jan 2, 2025
d9aff6b
Change default branch during testing
caaavik-msft Jan 6, 2025
0af4673
Use additionalJobIdentifier
caaavik-msft Jan 7, 2025
6b17bde
Use correct checkout paths
caaavik-msft Jan 8, 2025
be8e0a1
Ensure isScenario is passed in for ios_scenarios
caaavik-msft Jan 8, 2025
801957c
Merge branch 'main' into caaavik/move-runtime-yaml-to-performance
caaavik-msft Jan 8, 2025
1b334a9
Remove perfBranch now that we can set branch in Run pipeline dialog
caaavik-msft Jan 8, 2025
e90805b
Set default ref during testing
caaavik-msft Jan 8, 2025
ad0cd4b
Move all job listings to performance repository
caaavik-msft Jan 15, 2025
fda5a66
Merge branch 'main' into caaavik/move-runtime-yaml-to-performance
caaavik-msft Jan 15, 2025
ff7c214
Fix template conditions
caaavik-msft Jan 15, 2025
640901e
Fix perf_slow pipeline
caaavik-msft Jan 15, 2025
7e2da17
Use new paths for yamls in performance repo
caaavik-msft Jan 15, 2025
639ad20
Move all remaining perf templates to performance directory
caaavik-msft Jan 21, 2025
f9a62e0
Fix missing parameters
caaavik-msft Jan 24, 2025
0c67e27
Update all remaining references from old paths to new paths. Add comm…
caaavik-msft Jan 30, 2025
00e858e
Remove clr subsets from mono build jobs
caaavik-msft Jan 30, 2025
3987e4b
Merge branch 'main' into caaavik/move-runtime-yaml-to-performance
caaavik-msft Jan 30, 2025
66a41db
Fix capitalization of true
caaavik-msft Jan 30, 2025
3f2238f
Change public CI job to point to fork during testing
caaavik-msft Jan 30, 2025
3a47ebb
Revert removing clr subsets from mono builds. Reset repository resour…
caaavik-msft Jan 31, 2025
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion eng/pipelines/coreclr/perf_slow.yml
Original file line number Diff line number Diff line change
Expand Up @@ -53,7 +53,7 @@ extends:
- stage: Build
jobs:
- ${{ if ne(variables['System.TeamProject'], 'public') }}:
- template: /eng/pipelines/runtime-perf-slow-jobs.yml@performance
LoopedBard3 marked this conversation as resolved.
Show resolved Hide resolved
- template: /eng/pipelines/runtime-slow-perf-jobs.yml@performance
parameters:
${{ if or(in(variables['Build.Reason'], 'Schedule'), parameters.runScheduledJobs) }}:
runScheduledJobs: true
Expand Down
66 changes: 66 additions & 0 deletions eng/pipelines/performance/perf-slow.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,66 @@
parameters:
- name: runPrivateJobs
type: boolean
default: false
- name: runScheduledJobs
type: boolean
default: false
- name: onlySanityCheck
type: boolean
default: false

trigger:
batch: true
branches:
include:
- main
- release/9.0
paths:
include:
- '*'
- src/libraries/System.Private.CoreLib/*
exclude:
- '**.md'
- .devcontainer/*
- .github/*
- docs/*
- LICENSE.TXT
- PATENTS.TXT
- THIRD-PARTY-NOTICES.TXT

resources:
repositories:
- repository: performance
type: git
name: internal/dotnet-performance
ref: caaavik/move-runtime-yaml-to-performance # TODO: remove before merge

variables:
- template: /eng/pipelines/common/variables.yml

schedules:
- cron: "30 2 * * *"
displayName: Every night at 2:30AM
branches:
include:
- main
always: true

extends:
template: /eng/pipelines/common/templates/pipeline-with-resources.yml
parameters:
stages:
- stage: Build
jobs:
- ${{ if ne(variables['System.TeamProject'], 'public') }}:
- template: /eng/pipelines/runtime-slow-perf-jobs.yml@performance
parameters:
${{ if or(in(variables['Build.Reason'], 'Schedule'), parameters.runScheduledJobs) }}:
runScheduledJobs: true
${{ if or(notin(variables['Build.Reason'], 'Schedule', 'Manual'), parameters.runPrivateJobs) }}:
runPrivateJobs: true
runtimeRepoAlias: self
performanceRepoAlias: performance
jobParameters:
${{ if parameters.onlySanityCheck }}:
onlySanityCheck: true
77 changes: 77 additions & 0 deletions eng/pipelines/performance/perf.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,77 @@
parameters:
- name: onlySanityCheck
type: boolean
default: false

trigger:
batch: true
branches:
include:
- main
- release/9.0
- release/8.0
paths:
include:
- '*'
- src/libraries/System.Private.CoreLib/*
exclude:
- '**.md'
- .devcontainer/*
- .github/*
- docs/*
- LICENSE.TXT
- PATENTS.TXT
- THIRD-PARTY-NOTICES.TXT

resources:
repositories:
- repository: performance
type: git
name: internal/dotnet-performance
ref: caaavik/move-runtime-yaml-to-performance # TODO: remove before merge
caaavik-msft marked this conversation as resolved.
Show resolved Hide resolved

variables:
- template: /eng/pipelines/common/variables.yml

#
# For the 'schedule' case, only wasm/jsc perf jobs are run.
# And the rest are build jobs - wasm, mono, coreclr, and libraries.
#
# Since, we are not running *any* perf jobs, none of these builds are needed,
# thus the whole scheduled run can be disabled.
#
schedules:
- cron: "0 0 * * 1"
displayName: Weekly Monday 12am UTC Build
branches:
include:
- main
always: true

extends:
template: /eng/pipelines/common/templates/pipeline-with-resources.yml
parameters:
stages:
- stage: Build
jobs:

- template: /eng/pipelines/runtime-wasm-perf-jobs.yml@performance
parameters:
#${{ and(ne(variables['System.TeamProject'], 'public'), in(variables['Build.Reason'], 'Schedule')) }}:
# runProfile: 'non-v8'
${{ if eq(variables['System.TeamProject'], 'internal') }}:
runProfile: 'v8'
runtimeRepoAlias: self
performanceRepoAlias: performance
jobParameters:
${{ if parameters.onlySanityCheck }}:
onlySanityCheck: true

- ${{ if and(ne(variables['System.TeamProject'], 'public'), notin(variables['Build.Reason'], 'Schedule')) }}:
- template: /eng/pipelines/runtime-perf-jobs.yml@performance
parameters:
runtimeRepoAlias: self
performanceRepoAlias: performance
jobParameters:
${{ if parameters.onlySanityCheck }}:
onlySanityCheck: true
46 changes: 46 additions & 0 deletions eng/pipelines/performance/runtime-wasm-perf.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,46 @@
# This is a wrapper yml for `perf-wasm-jobs`, which has all the perf related
# wasm jobs. This file is essentially so we can point the pipeline in azdo
# UI to this, and thus avoid any scheduled triggers

trigger: none

pr:
branches:
include:
- main
paths:
include:
- eng/pipelines/runtime-wasm-perf.yml
- eng/pipelines/coreclr/perf*.yml
- eng/pipelines/coreclr/templates/perf-job.yml
- eng/pipelines/coreclr/templates/run-perf*
- eng/testing/performance/*
- eng/testing/BrowserVersions.props

resources:
repositories:
- repository: performance
type: github
name: dotnet/performance
endpoint: public

variables:
- template: /eng/pipelines/common/variables.yml

extends:
template: /eng/pipelines/common/templates/pipeline-with-resources.yml
parameters:
stages:
- stage: Build
jobs:
- template: /eng/pipelines/runtime-wasm-perf-jobs.yml@performance
parameters:
runtimeRepoAlias: self
performanceRepoAlias: performance
runProfile: 'v8'
jobParameters:
onlySanityCheck: true
#downloadSpecificBuild:
#buildId: '1878694'
#pipeline: 'perf-wasm'
#branchName: 'refs/pull/72119/head'
Original file line number Diff line number Diff line change
Expand Up @@ -63,7 +63,7 @@ jobs:
nameSuffix: AndroidMono
isOfficialBuild: false
postBuildSteps:
- template: /eng/pipelines/coreclr/templates/build-perf-sample-apps.yml
- template: /eng/pipelines/performance/templates/build-perf-sample-apps.yml
parameters:
rootFolder: '$(Build.SourcesDirectory)/artifacts/'
includeRootFolder: true
Expand Down Expand Up @@ -131,7 +131,7 @@ jobs:
pool:
vmImage: 'macos-13'
postBuildSteps:
- template: /eng/pipelines/coreclr/templates/build-perf-bdn-app.yml
- template: /eng/pipelines/performance/templates/build-perf-bdn-app.yml
parameters:
rootFolder: '$(Build.SourcesDirectory)/artifacts/'
includeRootFolder: true
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -15,7 +15,7 @@ jobs:
nameSuffix: iOSMono
isOfficialBuild: false
postBuildSteps:
- template: /eng/pipelines/coreclr/templates/build-perf-sample-apps.yml
- template: /eng/pipelines/performance/templates/build-perf-sample-apps.yml
parameters:
rootFolder: '$(Build.SourcesDirectory)/artifacts/'
includeRootFolder: true
Expand All @@ -39,7 +39,7 @@ jobs:
nameSuffix: iOSNativeAOT
isOfficialBuild: false
postBuildSteps:
- template: /eng/pipelines/coreclr/templates/build-perf-sample-apps.yml
- template: /eng/pipelines/performance/templates/build-perf-sample-apps.yml
parameters:
rootFolder: '$(Build.SourcesDirectory)/artifacts/'
includeRootFolder: true
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -11,6 +11,6 @@ jobs:
nameSuffix: wasm
isOfficialBuild: false
postBuildSteps:
- template: /eng/pipelines/coreclr/perf-wasm-prepare-artifacts-steps.yml
- template: /eng/pipelines/performance/templates/perf-wasm-prepare-artifacts-steps.yml
parameters:
configForBuild: Release
1 change: 1 addition & 0 deletions eng/pipelines/runtime-wasm-perf.yml
Original file line number Diff line number Diff line change
Expand Up @@ -29,6 +29,7 @@ variables:

extends:
template: /eng/pipelines/common/templates/pipeline-with-resources.yml
parameters:
stages:
- stage: Build
jobs:
Expand Down
Loading