New icons! #35

andrewiggins · 2020-12-05T21:39:12Z

Trying out some new icons:

Running status: ⏳ instead of ⏱
Unsure result: ❔ instead of 🔍

Closes #16

github-actions · 2020-12-05T21:39:30Z

📊 Tachometer Benchmark Results

Summary

test-bench-1: unsure 🔍 -10% - +12% (-4.10ms - +5.24ms)
^{local-framework vs base-framework}
test-bench-2: slower ❌ 8% - 35% (3.22ms - 11.96ms)
^{base-framework vs other-framework Customize summary}

Results

test-bench-1

Browser: chrome-headless 83.0.4103.116
Sample size: 60
Built by: PR Setup Job Flow #76
Commit: 9d594a4

Version	Avg time	vs fast-framework	vs base-framework	vs local-framework
fast-framework	32.09ms - 38.19ms	-	faster ✔ 8% - 27% 3.22ms - 11.96ms	faster ✔ 9% - 28% 3.55ms - 12.77ms
base-framework	39.60ms - 45.87ms	slower ❌ 8% - 35% 3.22ms - 11.96ms	-	unsure 🔍 -12% - +9% -5.24ms - +4.10ms
local-framework	39.84ms - 46.76ms	slower ❌ 9% - 38% 3.55ms - 12.77ms	unsure 🔍 -10% - +12% -4.10ms - +5.24ms	-

test-bench-2

Browser: chrome-headless 83.0.4103.116
Sample size: 60
Built by: PR Setup Job Flow #76
Commit: 9d594a4

Version	Avg time	vs other-framework	vs base-framework	vs local-framework	vs fast-framework
other-framework	43.30ms - 52.48ms	-	slower ❌ 19% - 54% 7.24ms - 18.26ms	unsure 🔍 -1% - +26% -0.40ms - +10.72ms	unsure 🔍 -3% - +24% -1.15ms - +10.34ms
base-framework	39.60ms - 45.87ms	slower ❌ 8% - 35% 3.22ms - 11.96ms	-	unsure 🔍 -22% - -0% -10.72ms - +0.40ms	unsure 🔍 -12% - +9% -5.24ms - +4.10ms
local-framework	39.84ms - 46.76ms	slower ❌ 9% - 38% 3.55ms - 12.77ms	unsure 🔍 -21% - +2% -10.34ms - +1.15ms	-	unsure 🔍 -10% - +12% -4.10ms - +5.24ms
fast-framework	32.09ms - 38.19ms	faster ✔ 17% - 36% 7.24ms - 18.26ms	faster ✔ 8% - 27% 3.22ms - 11.96ms	faster ✔ 9% - 28% 3.55ms - 12.77ms	-

_{tachometer-reporter-action v2 for PR Setup Job Flow}

github-actions · 2020-12-05T21:39:30Z

📊 Tachometer Benchmark Results

Summary

duration

multi-bench-1: faster ✔ 4% - 8% (6.30ms - 13.34ms)
^{local-framework vs base-framework}
multi-bench-2: slower ❌ 9% - 17% (0.32ms - 0.59ms)
^{base-framework vs fast-framework Customize summary}

window.usedJSHeapSize

multi-bench-1: slower ❌ 91% - 91% (3.25ms - 3.26ms)
^{local-framework vs base-framework}
multi-bench-2: faster ✔ 8% - 8% (0.09ms - 0.09ms)
^{base-framework vs fast-framework Customize summary}

Results

multi-bench-1

Browser: chrome-headless 84.0.4147.125
Sample size: 10
Built by: PR Multi-Measurement Setup Job Flow #54
Commit: 9d594a4

duration

Version	Avg time	vs fast-framework	vs base-framework	vs local-framework
fast-framework	137.71ms - 141.73ms	-	faster ✔ 20% - 22% 34.69ms - 39.26ms	faster ✔ 14% - 18% 23.26ms - 31.06ms
base-framework	175.60ms - 177.79ms	slower ❌ 24% - 28% 34.69ms - 39.26ms	-	slower ❌ 4% - 8% 6.30ms - 13.34ms
local-framework	163.53ms - 170.22ms	slower ❌ 16% - 22% 23.26ms - 31.06ms	faster ✔ 4% - 8% 6.30ms - 13.34ms	-

window.usedJSHeapSize

Version	Avg time	vs fast-framework	vs base-framework	vs local-framework
fast-framework	2.61ms - 2.61ms	-	faster ✔ 27% - 27% 0.95ms - 0.95ms	faster ✔ 62% - 62% 4.20ms - 4.21ms
base-framework	3.56ms - 3.57ms	slower ❌ 36% - 37% 0.95ms - 0.95ms	-	faster ✔ 48% - 48% 3.25ms - 3.26ms
local-framework	6.81ms - 6.82ms	slower ❌ 161% - 161% 4.20ms - 4.21ms	slower ❌ 91% - 91% 3.25ms - 3.26ms	-

multi-bench-2

Browser: chrome-headless 84.0.4147.125
Sample size: 10
Built by: PR Multi-Measurement Setup Job Flow #54
Commit: 9d594a4

duration

Version	Avg time	vs fast-framework	vs base-framework	vs local-framework
fast-framework	3.46ms - 3.70ms	-	faster ✔ 8% - 15% 0.32ms - 0.59ms	slower ❌ 34% - 54% 0.89ms - 1.28ms
base-framework	3.98ms - 4.10ms	slower ❌ 9% - 17% 0.32ms - 0.59ms	-	slower ❌ 52% - 72% 1.38ms - 1.71ms
local-framework	2.34ms - 2.65ms	faster ✔ 26% - 35% 0.89ms - 1.28ms	faster ✔ 34% - 42% 1.38ms - 1.71ms	-

window.usedJSHeapSize

Version	Avg time	vs fast-framework	vs base-framework	vs local-framework
fast-framework	1.09ms - 1.09ms	-	slower ❌ 9% - 9% 0.09ms - 0.09ms	slower ❌ 11% - 11% 0.11ms - 0.11ms
base-framework	1.00ms - 1.00ms	faster ✔ 8% - 8% 0.09ms - 0.09ms	-	slower ❌ 2% - 2% 0.02ms - 0.02ms
local-framework	0.98ms - 0.98ms	faster ✔ 10% - 10% 0.11ms - 0.11ms	faster ✔ 2% - 2% 0.02ms - 0.02ms	-

_{tachometer-reporter-action v2 for PR Multi-Measurement Setup Job Flow}

github-actions · 2020-12-05T21:39:33Z

📊 Tachometer Benchmark Results

Summary

test_bench: unsure 🔍 -10% - +12% (-4.10ms - +5.24ms)
^{local-framework vs base-framework}
test_bench_2: slower ❌ 8% - 35% (3.22ms - 11.96ms)
^{base-framework vs other-framework Customize summary}

Results

test_bench

Browser: chrome-headless 83.0.4103.116
Sample size: 60
Built by: PR Multi Init Flow #76
Commit: 9d594a4

Version	Avg time	vs fast-framework	vs base-framework	vs local-framework
fast-framework	32.09ms - 38.19ms	-	faster ✔ 8% - 27% 3.22ms - 11.96ms	faster ✔ 9% - 28% 3.55ms - 12.77ms
base-framework	39.60ms - 45.87ms	slower ❌ 8% - 35% 3.22ms - 11.96ms	-	unsure 🔍 -12% - +9% -5.24ms - +4.10ms
local-framework	39.84ms - 46.76ms	slower ❌ 9% - 38% 3.55ms - 12.77ms	unsure 🔍 -10% - +12% -4.10ms - +5.24ms	-

test_bench_2

Browser: chrome-headless 83.0.4103.116
Sample size: 60
Built by: PR Multi Init Flow #76
Commit: 9d594a4

Version	Avg time	vs other-framework	vs base-framework	vs local-framework	vs fast-framework
other-framework	43.30ms - 52.48ms	-	slower ❌ 19% - 54% 7.24ms - 18.26ms	unsure 🔍 -1% - +26% -0.40ms - +10.72ms	unsure 🔍 -3% - +24% -1.15ms - +10.34ms
base-framework	39.60ms - 45.87ms	slower ❌ 8% - 35% 3.22ms - 11.96ms	-	unsure 🔍 -22% - -0% -10.72ms - +0.40ms	unsure 🔍 -12% - +9% -5.24ms - +4.10ms
local-framework	39.84ms - 46.76ms	slower ❌ 9% - 38% 3.55ms - 12.77ms	unsure 🔍 -21% - +2% -10.34ms - +1.15ms	-	unsure 🔍 -10% - +12% -4.10ms - +5.24ms
fast-framework	32.09ms - 38.19ms	faster ✔ 17% - 36% 7.24ms - 18.26ms	faster ✔ 8% - 27% 3.22ms - 11.96ms	faster ✔ 9% - 28% 3.55ms - 12.77ms	-

_{tachometer-reporter-action v2 for PR Multi Init Flow}

github-actions · 2020-12-05T21:39:52Z

📊 Tachometer Benchmark Results

Summary

test_bench: unsure ❔ -10% - +12% (-4.10ms - +5.24ms)
^{local-framework vs base-framework}

Results

test_bench

Browser: chrome-headless 83.0.4103.116
Sample size: 60
Built by: PR Single Job #76
Commit: 9d594a4

Version	Avg time	vs fast-framework	vs base-framework	vs local-framework
fast-framework	32.09ms - 38.19ms	-	faster ✔ 8% - 27% 3.22ms - 11.96ms	faster ✔ 9% - 28% 3.55ms - 12.77ms
base-framework	39.60ms - 45.87ms	slower ❌ 8% - 35% 3.22ms - 11.96ms	-	unsure ❔ -12% - +9% -5.24ms - +4.10ms
local-framework	39.84ms - 46.76ms	slower ❌ 9% - 38% 3.55ms - 12.77ms	unsure ❔ -10% - +12% -4.10ms - +5.24ms	-

_{tachometer-reporter-action v2 for PR Single Job}

github-actions · 2020-12-08T03:15:48Z

📊 Tachometer Benchmark Results

Summary

duration

multi-bench-1: faster ✔ 4% - 8% (6.30ms - 13.34ms)
^{local-framework vs base-framework}

render

multi-measure-names: slower ❌ 12% - 25% (2.30ms - 4.61ms)
^{this-change vs tip-of-tree}

update

multi-measure-names: slower ❌ 142% - 158% (33.02ms - 35.52ms)
^{this-change vs tip-of-tree}

Results

multi-bench-1

Browser: chrome-headless 84.0.4147.125
Sample size: 10
Built by: PR Multi-Measurement Summarize Job Flow #18
Commit: 9d594a4

duration

Version	Avg time	vs fast-framework	vs base-framework	vs local-framework
fast-framework	137.71ms - 141.73ms	-	faster ✔ 20% - 22% 34.69ms - 39.26ms	faster ✔ 14% - 18% 23.26ms - 31.06ms
base-framework	175.60ms - 177.79ms	slower ❌ 24% - 28% 34.69ms - 39.26ms	-	slower ❌ 4% - 8% 6.30ms - 13.34ms
local-framework	163.53ms - 170.22ms	slower ❌ 16% - 22% 23.26ms - 31.06ms	faster ✔ 4% - 8% 6.30ms - 13.34ms	-

window.usedJSHeapSize

Version	Avg time	vs fast-framework	vs base-framework	vs local-framework
fast-framework	2.61ms - 2.61ms	-	faster ✔ 27% - 27% 0.95ms - 0.95ms	faster ✔ 62% - 62% 4.20ms - 4.21ms
base-framework	3.56ms - 3.57ms	slower ❌ 36% - 37% 0.95ms - 0.95ms	-	faster ✔ 48% - 48% 3.25ms - 3.26ms
local-framework	6.81ms - 6.82ms	slower ❌ 161% - 161% 4.20ms - 4.21ms	slower ❌ 91% - 91% 3.25ms - 3.26ms	-

multi-measure-names

Browser: chrome-headless 85.0.4183.83
Sample size: 30
Built by: PR Multi-Measurement Summarize Job Flow #18
Commit: 9d594a4

render

Version	Avg time	vs this-change	vs tip-of-tree tip-of-tree	vs previous-release previous-release
this-change	20.82ms - 22.81ms	-	slower ❌ 12% - 25% 2.30ms - 4.61ms	faster ✔ 37% - 43% 13.48ms - 15.85ms
tip-of-tree tip-of-tree	17.78ms - 18.94ms	faster ✔ 11% - 21% 2.30ms - 4.61ms	-	faster ✔ 48% - 51% 17.26ms - 18.98ms
previous-release previous-release	35.84ms - 37.12ms	slower ❌ 59% - 75% 13.48ms - 15.85ms	slower ❌ 92% - 106% 17.26ms - 18.98ms	-

update

Version	Avg time	vs this-change	vs tip-of-tree tip-of-tree	vs previous-release previous-release
this-change	55.97ms - 58.17ms	-	slower ❌ 142% - 158% 33.02ms - 35.52ms	faster ✔ 31% - 34% 26.16ms - 29.21ms
tip-of-tree tip-of-tree	22.21ms - 23.39ms	faster ✔ 59% - 61% 33.02ms - 35.52ms	-	faster ✔ 72% - 74% 60.75ms - 63.17ms
previous-release previous-release	83.70ms - 85.81ms	slower ❌ 45% - 52% 26.16ms - 29.21ms	slower ❌ 261% - 282% 60.75ms - 63.17ms	-

nop-update

Version	Avg time	vs this-change	vs tip-of-tree tip-of-tree	vs previous-release previous-release
this-change	136.50ms - 140.18ms	-	slower ❌ 142% - 159% 80.59ms - 85.64ms	faster ✔ 17% - 20% 28.79ms - 33.70ms
tip-of-tree tip-of-tree	53.49ms - 56.95ms	faster ✔ 59% - 61% 80.59ms - 85.64ms	-	faster ✔ 66% - 69% 111.99ms - 116.74ms
previous-release previous-release	167.95ms - 171.21ms	slower ❌ 21% - 25% 28.79ms - 33.70ms	slower ❌ 197% - 217% 111.99ms - 116.74ms	-

_{tachometer-reporter-action v2 for PR Multi-Measurement Summarize Job Flow}

andrewiggins force-pushed the new-icons branch from 0b3bfac to 11971d5 Compare December 5, 2020 21:59

andrewiggins added 2 commits December 5, 2020 21:09

Try out new icons (❔, ⏳)

de85c9c

Improve comment

b63bbca

andrewiggins force-pushed the new-icons branch from 11971d5 to b63bbca Compare December 6, 2020 05:15

Remove icon and update text for 0%

55b9089

andrewiggins force-pushed the new-icons branch from 889a0cd to 55b9089 Compare December 6, 2020 05:45

Merge branch 'master' into new-icons

603ea15

Fix assertUIState helper

c0fec66

Base automatically changed from master to main January 22, 2021 19:04

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

New icons! #35

New icons! #35

andrewiggins commented Dec 5, 2020 •

edited

Loading

github-actions bot commented Dec 5, 2020 •

edited

Loading

📊 Tachometer Benchmark Results

Summary

Results

github-actions bot commented Dec 5, 2020 •

edited

Loading

📊 Tachometer Benchmark Results

Summary

duration

window.usedJSHeapSize

Results

duration

window.usedJSHeapSize

duration

window.usedJSHeapSize

github-actions bot commented Dec 5, 2020 •

edited

Loading

📊 Tachometer Benchmark Results

Summary

Results

github-actions bot commented Dec 5, 2020 •

edited

Loading

📊 Tachometer Benchmark Results

Summary

Results

github-actions bot commented Dec 8, 2020 •

edited

Loading

📊 Tachometer Benchmark Results

Summary

duration

render

update

Results

duration

window.usedJSHeapSize

render

update

nop-update

New icons! #35

Are you sure you want to change the base?

New icons! #35

Conversation

andrewiggins commented Dec 5, 2020 • edited Loading

github-actions bot commented Dec 5, 2020 • edited Loading

📊 Tachometer Benchmark Results

Summary

Results

github-actions bot commented Dec 5, 2020 • edited Loading

📊 Tachometer Benchmark Results

Summary

duration

window.usedJSHeapSize

Results

duration

window.usedJSHeapSize

duration

window.usedJSHeapSize

github-actions bot commented Dec 5, 2020 • edited Loading

📊 Tachometer Benchmark Results

Summary

Results

github-actions bot commented Dec 5, 2020 • edited Loading

📊 Tachometer Benchmark Results

Summary

Results

github-actions bot commented Dec 8, 2020 • edited Loading

📊 Tachometer Benchmark Results

Summary

duration

render

update

Results

duration

window.usedJSHeapSize

render

update

nop-update

andrewiggins commented Dec 5, 2020 •

edited

Loading

github-actions bot commented Dec 5, 2020 •

edited

Loading

github-actions bot commented Dec 5, 2020 •

edited

Loading

github-actions bot commented Dec 5, 2020 •

edited

Loading

github-actions bot commented Dec 5, 2020 •

edited

Loading

github-actions bot commented Dec 8, 2020 •

edited

Loading