Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

replace FlatList with .map solution #53655

Conversation

JKobrynski
Copy link
Contributor

Explanation of Change

FlatList was replaced with a data.map(() => {}) solution to get rid of the flashing effect.

Fixed Issues

$ #53027
PROPOSAL: #53027 (comment)

Tests

  1. Open the web app and log into your account
  2. Enable debug mode in Troubleshoot
  3. Open an expense thread (create one if you don't have any)
  4. Enter debug view then check on "View transaction" tab
  5. Go to "violations" > Create a violation and save it
  6. You might need to repeat step 5 many times in a row to be able to notice the flashing effect
  • Verify that no errors appear in the JS console

Offline tests

N/A

QA Steps

Same as Tests section above

  • Verify that no errors appear in the JS console

PR Author Checklist

  • I linked the correct issue in the ### Fixed Issues section above
  • I wrote clear testing steps that cover the changes made in this PR
    • I added steps for local testing in the Tests section
    • I added steps for the expected offline behavior in the Offline steps section
    • I added steps for Staging and/or Production testing in the QA steps section
    • I added steps to cover failure scenarios (i.e. verify an input displays the correct error message if the entered data is not correct)
    • I turned off my network connection and tested it while offline to ensure it matches the expected behavior (i.e. verify the default avatar icon is displayed if app is offline)
    • I tested this PR with a High Traffic account against the staging or production API to ensure there are no regressions (e.g. long loading states that impact usability).
  • I included screenshots or videos for tests on all platforms
  • I ran the tests on all platforms & verified they passed on:
    • Android: Native
    • Android: mWeb Chrome
    • iOS: Native
    • iOS: mWeb Safari
    • MacOS: Chrome / Safari
    • MacOS: Desktop
  • I verified there are no console errors (if there's a console error not related to the PR, report it or open an issue for it to be fixed)
  • I followed proper code patterns (see Reviewing the code)
    • I verified that any callback methods that were added or modified are named for what the method does and never what callback they handle (i.e. toggleReport and not onIconClick)
    • I verified that comments were added to code that is not self explanatory
    • I verified that any new or modified comments were clear, correct English, and explained "why" the code was doing something instead of only explaining "what" the code was doing.
    • I verified any copy / text shown in the product is localized by adding it to src/languages/* files and using the translation method
      • If any non-english text was added/modified, I used JaimeGPT to get English > Spanish translation. I then posted it in #expensify-open-source and it was approved by an internal Expensify engineer. Link to Slack message:
    • I verified all numbers, amounts, dates and phone numbers shown in the product are using the localization methods
    • I verified any copy / text that was added to the app is grammatically correct in English. It adheres to proper capitalization guidelines (note: only the first word of header/labels should be capitalized), and is either coming verbatim from figma or has been approved by marketing (in order to get marketing approval, ask the Bug Zero team member to add the Waiting for copy label to the issue)
    • I verified proper file naming conventions were followed for any new files or renamed files. All non-platform specific files are named after what they export and are not named "index.js". All platform-specific files are named for the platform the code supports as outlined in the README.
    • I verified the JSDocs style guidelines (in STYLE.md) were followed
  • If a new code pattern is added I verified it was agreed to be used by multiple Expensify engineers
  • I followed the guidelines as stated in the Review Guidelines
  • I tested other components that can be impacted by my changes (i.e. if the PR modifies a shared library or component like Avatar, I verified the components using Avatar are working as expected)
  • I verified all code is DRY (the PR doesn't include any logic written more than once, with the exception of tests)
  • I verified any variables that can be defined as constants (ie. in CONST.ts or at the top of the file that uses the constant) are defined as such
  • I verified that if a function's arguments changed that all usages have also been updated correctly
  • If any new file was added I verified that:
    • The file has a description of what it does and/or why is needed at the top of the file if the code is not self explanatory
  • If a new CSS style is added I verified that:
    • A similar style doesn't already exist
    • The style can't be created with an existing StyleUtils function (i.e. StyleUtils.getBackgroundAndBorderStyle(theme.componentBG))
  • If the PR modifies code that runs when editing or sending messages, I tested and verified there is no unexpected behavior for all supported markdown - URLs, single line code, code blocks, quotes, headings, bold, strikethrough, and italic.
  • If the PR modifies a generic component, I tested and verified that those changes do not break usages of that component in the rest of the App (i.e. if a shared library or component like Avatar is modified, I verified that Avatar is working as expected in all cases)
  • If the PR modifies a component related to any of the existing Storybook stories, I tested and verified all stories for that component are still working as expected.
  • If the PR modifies a component or page that can be accessed by a direct deeplink, I verified that the code functions as expected when the deeplink is used - from a logged in and logged out account.
  • If the PR modifies the UI (e.g. new buttons, new UI components, changing the padding/spacing/sizing, moving components, etc) or modifies the form input styles:
    • I verified that all the inputs inside a form are aligned with each other.
    • I added Design label and/or tagged @Expensify/design so the design team can review the changes.
  • If a new page is added, I verified it's using the ScrollView component to make it scrollable when more elements are added to the page.
  • I added unit tests for any new feature or bug fix in this PR to help automatically prevent regressions in this user flow.
  • If the main branch was merged into this PR after a review, I tested again and verified the outcome was still expected according to the Test steps.

Screenshots/Videos

MacOS: Chrome / Safari
noflatlist-compressed.mov

@JKobrynski JKobrynski marked this pull request as ready for review December 5, 2024 20:19
@JKobrynski JKobrynski requested a review from a team as a code owner December 5, 2024 20:19
@melvin-bot melvin-bot bot requested review from DylanDylann and removed request for a team December 5, 2024 20:19
Copy link

melvin-bot bot commented Dec 5, 2024

@DylanDylann Please copy/paste the Reviewer Checklist from here into a new comment on this PR and complete it. If you have the K2 extension, you can simply click: [this button]

@DylanDylann
Copy link
Contributor

@jacobkim9881 Let's do the same thing on DebugReportActions

@jacobkim9881

This comment was marked as resolved.

@JKobrynski
Copy link
Contributor Author

@DylanDylann done!

@DylanDylann
Copy link
Contributor

Sorry, @jacobkim9881 I want to tag @JKobrynski

/>
{/* This list was previously rendered as a FlatList, but it turned out that it caused the component to flash in some cases,
so it was replaced by this solution. */}
{sortedAllReportActions?.map((item, index) => renderItem(item, index))}

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Switching to .map() isn't ideal since FlatList provides built-in virtualization and better performance for large lists.

The flashing issue you mentioned might be due to the missing keyExtractor prop in the FlatList.

I suggest re-adding FlatList with a keyExtractor like this to see if it resolves the issue:

<FlatList
    data={sortedAllReportActions}
    renderItem={renderItem}
    keyExtractor={(item) => item.reportActionID.toString()}
    scrollEnabled={false}
/>

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I tried it before (forgot to mention it in the proposal) and unfortunately this doesn't fix it.

Here is a demo:

keyextractor-compressed.mov

@DylanDylann
Copy link
Contributor

@jacobkim9881 I still get flicker

Screen.Recording.2024-12-09.at.17.20.13.mov

@DylanDylann
Copy link
Contributor

@JKobrynski From my investigation, the bug comes from

Debug.setDebugData(`${ONYXKEYS.COLLECTION.TRANSACTION_VIOLATIONS}${transactionID}`, [...(transactionViolations ?? []), parsedTransactionViolation]);
Navigation.navigate(ROUTES.DEBUG_TRANSACTION_TAB_VIOLATIONS.getRoute(transactionID));

We update Onyx data and then navigate to a new page, but the navigation action is executed before completely updating ONYX. This is a common way to address this bug in other places

        Debug.setDebugData(`${ONYXKEYS.COLLECTION.TRANSACTION_VIOLATIONS}${transactionID}`, [...(transactionViolations ?? []), parsedTransactionViolation]);

        Navigation.setNavigationActionToMicrotaskQueue(() =>
            Navigation.navigate(ROUTES.DEBUG_TRANSACTION_TAB_VIOLATIONS.getRoute(transactionID)),
        );

@JKobrynski
Copy link
Contributor Author

@DylanDylann all right, I will try that solution. Thanks!

@pac-guerreiro
Copy link
Contributor

@DylanDylann I'm back from my vacation, so I'll take it from here 😄

@pac-guerreiro
Copy link
Contributor

@DylanDylann I tried your fix but the issue still happens. I found a way to easily reproduce the issue by throttling the CPU on Google Chrome.

Tomorrow, I'll investigate it further 😄

@pac-guerreiro
Copy link
Contributor

@DylanDylann I'm able to reproduce this issue on track/submit expense flow as well:

Screen.Recording.2024-12-12.at.14.47.05.mp4

I suspect this issue is caused by OnyxTabNavigator. I just asked internally if someone has experienced this before and can help with it 😄

@pac-guerreiro
Copy link
Contributor

pac-guerreiro commented Dec 17, 2024

@DylanDylann

Last friday (12/13/24)

  • I did some trial and error to understand what could be causing OnyxTabNavigator to re-render the page contents, but I didn't manage to find the cause.

Today:

  • I created my own tab navigator, DebugTabNavigator, which mimics OnyxTabNavigator behaviour and layout but uses a StackNavigator instead of a MaterialTopTabNavigator and it fixes the problem.

I just noticed that there as linter issues. I'll fix these earlier in the morning 😄

@pac-guerreiro
Copy link
Contributor

@DylanDylann sorry for the delay here, yesterday I thought I had addressed all eslint issues 😅

It's ready now for your review 😄

@DylanDylann
Copy link
Contributor

Thanks

@DylanDylann
Copy link
Contributor

@pac-guerreiro Thanks, this is a great refactor

@DylanDylann
Copy link
Contributor

DylanDylann commented Dec 20, 2024

Reviewer Checklist

  • I have verified the author checklist is complete (all boxes are checked off).
  • I verified the correct issue is linked in the ### Fixed Issues section above
  • I verified testing steps are clear and they cover the changes made in this PR
    • I verified the steps for local testing are in the Tests section
    • I verified the steps for Staging and/or Production testing are in the QA steps section
    • I verified the steps cover any possible failure scenarios (i.e. verify an input displays the correct error message if the entered data is not correct)
    • I turned off my network connection and tested it while offline to ensure it matches the expected behavior (i.e. verify the default avatar icon is displayed if app is offline)
  • I checked that screenshots or videos are included for tests on all platforms
  • I included screenshots or videos for tests on all platforms
  • I verified tests pass on all platforms & I tested again on:
    • Android: Native
    • Android: mWeb Chrome
    • iOS: Native
    • iOS: mWeb Safari
    • MacOS: Chrome / Safari
    • MacOS: Desktop
  • If there are any errors in the console that are unrelated to this PR, I either fixed them (preferred) or linked to where I reported them in Slack
  • I verified proper code patterns were followed (see Reviewing the code)
    • I verified that any callback methods that were added or modified are named for what the method does and never what callback they handle (i.e. toggleReport and not onIconClick).
    • I verified that the left part of a conditional rendering a React component is a boolean and NOT a string, e.g. myBool && <MyComponent />.
    • I verified that comments were added to code that is not self explanatory
    • I verified that any new or modified comments were clear, correct English, and explained "why" the code was doing something instead of only explaining "what" the code was doing.
    • I verified any copy / text shown in the product is localized by adding it to src/languages/* files and using the translation method
    • I verified all numbers, amounts, dates and phone numbers shown in the product are using the localization methods
    • I verified any copy / text that was added to the app is grammatically correct in English. It adheres to proper capitalization guidelines (note: only the first word of header/labels should be capitalized), and is either coming verbatim from figma or has been approved by marketing (in order to get marketing approval, ask the Bug Zero team member to add the Waiting for copy label to the issue)
    • I verified proper file naming conventions were followed for any new files or renamed files. All non-platform specific files are named after what they export and are not named "index.js". All platform-specific files are named for the platform the code supports as outlined in the README.
    • I verified the JSDocs style guidelines (in STYLE.md) were followed
  • If a new code pattern is added I verified it was agreed to be used by multiple Expensify engineers
  • I verified that this PR follows the guidelines as stated in the Review Guidelines
  • I verified other components that can be impacted by these changes have been tested, and I retested again (i.e. if the PR modifies a shared library or component like Avatar, I verified the components using Avatar have been tested & I retested again)
  • I verified all code is DRY (the PR doesn't include any logic written more than once, with the exception of tests)
  • I verified any variables that can be defined as constants (ie. in CONST.js or at the top of the file that uses the constant) are defined as such
  • If a new component is created I verified that:
    • A similar component doesn't exist in the codebase
    • All props are defined accurately and each prop has a /** comment above it */
    • The file is named correctly
    • The component has a clear name that is non-ambiguous and the purpose of the component can be inferred from the name alone
    • The only data being stored in the state is data necessary for rendering and nothing else
    • For Class Components, any internal methods passed to components event handlers are bound to this properly so there are no scoping issues (i.e. for onClick={this.submit} the method this.submit should be bound to this in the constructor)
    • Any internal methods bound to this are necessary to be bound (i.e. avoid this.submit = this.submit.bind(this); if this.submit is never passed to a component event handler like onClick)
    • All JSX used for rendering exists in the render method
    • The component has the minimum amount of code necessary for its purpose, and it is broken down into smaller components in order to separate concerns and functions
  • If any new file was added I verified that:
    • The file has a description of what it does and/or why is needed at the top of the file if the code is not self explanatory
  • If a new CSS style is added I verified that:
    • A similar style doesn't already exist
    • The style can't be created with an existing StyleUtils function (i.e. StyleUtils.getBackgroundAndBorderStyle(theme.componentBG)
  • If the PR modifies code that runs when editing or sending messages, I tested and verified there is no unexpected behavior for all supported markdown - URLs, single line code, code blocks, quotes, headings, bold, strikethrough, and italic.
  • If the PR modifies a generic component, I tested and verified that those changes do not break usages of that component in the rest of the App (i.e. if a shared library or component like Avatar is modified, I verified that Avatar is working as expected in all cases)
  • If the PR modifies a component related to any of the existing Storybook stories, I tested and verified all stories for that component are still working as expected.
  • If the PR modifies a component or page that can be accessed by a direct deeplink, I verified that the code functions as expected when the deeplink is used - from a logged in and logged out account.
  • If the PR modifies the UI (e.g. new buttons, new UI components, changing the padding/spacing/sizing, moving components, etc) or modifies the form input styles:
    • I verified that all the inputs inside a form are aligned with each other.
    • I added Design label and/or tagged @Expensify/design so the design team can review the changes.
  • If a new page is added, I verified it's using the ScrollView component to make it scrollable when more elements are added to the page.
  • If the main branch was merged into this PR after a review, I tested again and verified the outcome was still expected according to the Test steps.
  • I have checked off every checkbox in the PR reviewer checklist, including those that don't apply to this PR.

Screenshots/Videos

Android: Native
Screen.Recording.2024-12-23.at.12.19.57.mov
Android: mWeb Chrome
Screen.Recording.2024-12-23.at.12.13.52.mov
iOS: Native
Screen.Recording.2024-12-23.at.12.20.33.mov
iOS: mWeb Safari
Screen.Recording.2024-12-23.at.12.14.35.mov
MacOS: Chrome / Safari
Screen.Recording.2024-12-20.at.14.38.28.mov
MacOS: Desktop
Screen.Recording.2024-12-20.at.14.50.16.mov

@DylanDylann
Copy link
Contributor

@pac-guerreiro App crash on native

Screen.Recording.2024-12-20.at.15.40.49.mov

@pac-guerreiro
Copy link
Contributor

@DylanDylann I fixed the crash, thanks! 😄

@pac-guerreiro
Copy link
Contributor

@DylanDylann

I'll be away until January 2nd but someone should take care of my work 😄 Happy holidays! 🎉

Copy link
Contributor

@DylanDylann DylanDylann left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM 💯

@melvin-bot melvin-bot bot requested a review from blimpich December 23, 2024 05:21
Copy link
Contributor

@blimpich blimpich left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM! Thank you for fixing this tricky bug!

@blimpich blimpich merged commit 126d92a into Expensify:main Dec 23, 2024
17 checks passed
@OSBotify
Copy link
Contributor

✋ This PR was not deployed to staging yet because QA is ongoing. It will be automatically deployed to staging after the next production release.

@github-actions github-actions bot added the DeployBlockerCash This issue or pull request should block deployment label Dec 23, 2024
Copy link
Contributor

Performance Comparison Report 📊

Significant Changes To Duration

Name Duration
Linking 566.861 ms → 669.112 ms (+102.251 ms, +18.0%) 🔴
Show details
Name Duration
Linking Baseline
Mean: 566.861 ms
Stdev: 120.947 ms (21.3%)
Runs: 374.70515900012106 384.61413600016385 395.7351069999859 402.42960700020194 402.75329599995166 404.3485509995371 411.3621010007337 411.79272499959916 412.3385420003906 419.3373210001737 419.7341310000047 424.07515500020236 428.08158400002867 428.85648600012064 433.30790199991316 433.84436100069433 435.9267180003226 442.6863609999418 442.77677400037646 452.3777270000428 460.4102380005643 460.4991459995508 461.4201659997925 469.1679290002212 477.09513300005347 608.1996670002118 616.4925950001925 623.3887130003422 625.5850019995123 635.0684420000762 635.828857999295 636.6008310001343 637.5058189993724 648.9017739994451 648.9119879994541 653.9051520004869 657.6873370008543 659.584268999286 661.0819500004873 663.346353999339 664.4691570000723 664.9563400000334 665.4125169999897 667.0489100003615 670.731404999271 672.765951000154 674.3220219993964 675.4776610005647 681.9275719998404 682.4046629993245 682.5787360006943 684.0174150001258 684.4664719998837 687.6334640001878 689.5643730005249 693.7690030001104 695.3121740007773 698.7924810005352 728.2291259998456 745.9882010007277

Current
Mean: 669.112 ms
Stdev: 33.429 ms (5.0%)
Runs: 598.4779059998691 600.2917890008539 605.2268889993429 621.5479739997536 633.0485030002892 634.0418299995363 634.5390219995752 640.0615649996325 642.1409499999136 643.8221850004047 644.5959879998118 645.1690269997343 646.2465009996668 647.6852219998837 648.8867189995944 656.7001960007474 658.5214039999992 659.3739419998601 662.3263750001788 662.4049070002511 663.1221519997343 663.1547039998695 663.3835460003465 664.8094080006704 668.4494630005211 668.8837489997968 670.0768639994785 671.9817300001159 674.2581380000338 675.1110840002075 675.9841719996184 676.9458009991795 680.787760999985 682.5882980003953 684.5562749998644 687.347453000024 691.4524330003187 692.0303950002417 693.4797780001536 697.6394460005686 699.872192999348 712.2799479998648 712.6208910001442 721.7289230003953 727.9344490002841 728.0930169997737 740.8343100007623 742.856282999739

Meaningless Changes To Duration

Show entries
Name Duration
App start time nativeLaunch 26.596 ms → 27.172 ms (+0.576 ms, +2.2%)
App start time nativeLaunchEnd_To_appCreationStart 85.610 ms → 82.136 ms (-3.475 ms, -4.1%)
App start time contentAppeared_To_screenTTI 642.338 ms → 644.200 ms (+1.862 ms, ±0.0%)
App start time appCreation 80.618 ms → 85.407 ms (+4.789 ms, +5.9%)
App start time TTI 1517.868 ms → 1514.813 ms (-3.054 ms, ±0.0%)
App start time appCreationEnd_To_contentAppeared 670.678 ms → 671.220 ms (+0.542 ms, ±0.0%)
App start time regularAppStart 0.024 ms → 0.028 ms (+0.004 ms, +18.0%) 🟡
App start time runJsBundle 477.717 ms → 481.267 ms (+3.550 ms, +0.7%)
App start time (CPU) 124.717 % → 120.550 % (-4.167 %, -3.3%)
App start time (FPS) 59.895 FPS → 59.892 FPS (-0.003 FPS, ±0.0%)
App start time (RAM) 375.673 MB → 373.894 MB (-1.779 MB, ±0.0%)
App start time (CPU/JS) 74.688 % → 75.062 % (+0.374 %, +0.5%)
App start time (CPU/UI) 19.047 % → 16.739 % (-2.308 %, -12.1%)
Open search router TTI Load Search Options 100.795 ms → 102.098 ms (+1.303 ms, +1.3%)
Open search router TTI Open Search Router TTI 687.052 ms → 686.500 ms (-0.552 ms, ±0.0%)
Open search router TTI (CPU) 147.538 % → 146.350 % (-1.189 %, -0.8%)
Open search router TTI (FPS) 56.482 FPS → 59.486 FPS (+3.003 FPS, -5.3%)
Open search router TTI (RAM) 384.969 MB → 384.059 MB (-0.910 MB, ±0.0%)
Open search router TTI (CPU/JS) 77.480 % → 78.903 % (+1.423 %, +1.8%)
Open search router TTI (CPU/UI) 27.052 % → 28.066 % (+1.014 %, +3.7%)
Report typing Composer typing rerender count 1.000 renders → 1.000 renders
Report typing Message sent 486.920 ms → 490.119 ms (+3.199 ms, +0.7%)
Report typing (CPU) 105.201 % → 105.301 % (+0.100 %, ±0.0%)
Report typing (FPS) 59.996 FPS → 60.000 FPS (+0.004 FPS, ±0.0%)
Report typing (RAM) 457.137 MB → 457.837 MB (+0.700 MB, ±0.0%)
Report typing (CPU/JS) 47.203 % → 47.377 % (+0.173 %, ±0.0%)
Report typing (CPU/UI) 27.803 % → 27.637 % (-0.166 %, -0.6%)
Chat opening Chat TTI 501.145 ms → 506.094 ms (+4.949 ms, +1.0%)
Chat opening (CPU) 154.808 % → 154.284 % (-0.524 %, ±0.0%)
Chat opening (FPS) 60.000 FPS → 57.901 FPS (-2.099 FPS, +3.5%)
Chat opening (RAM) 373.971 MB → 378.667 MB (+4.695 MB, +1.3%)
Chat opening (CPU/JS) 78.861 % → 76.090 % (-2.771 %, -3.5%)
Chat opening (CPU/UI) 34.098 % → 32.763 % (-1.336 %, -3.9%)
Linking (CPU) 127.683 % → 126.425 % (-1.258 %, -1.0%)
Linking (FPS) 60.000 FPS → 60.000 FPS
Linking (RAM) 440.429 MB → 440.763 MB (+0.334 MB, ±0.0%)
Linking (CPU/JS) 57.917 % → 57.818 % (-0.100 %, ±0.0%)
Linking (CPU/UI) 33.616 % → 33.447 % (-0.169 %, -0.5%)
Show details
Name Duration
App start time nativeLaunch Baseline
Mean: 26.596 ms
Stdev: 3.514 ms (13.2%)
Runs: 22 22 22 22 22 23 23 23 23 23 23 23 23 24 24 24 24 24 25 25 25 25 25 25 25 25 26 26 26 26 26 26 26 27 27 27 27 28 28 28 28 29 29 29 29 29 29 30 30 31 32 32 33 33 35 35 35

Current
Mean: 27.172 ms
Stdev: 3.874 ms (14.3%)
Runs: 22 22 22 22 23 23 23 24 24 24 24 24 24 24 24 24 25 25 25 25 25 25 25 25 25 26 26 26 26 26 27 27 27 27 27 27 27 28 28 28 28 28 29 29 29 30 31 31 31 32 32 32 33 35 35 35 36 39
App start time nativeLaunchEnd_To_appCreationStart Baseline
Mean: 85.610 ms
Stdev: 13.919 ms (16.3%)
Runs: 62 66 67 67 68 68 69 69 71 71 71 72 73 73 73 74 75 75 75 78 78 79 80 81 82 82 82 82 83 83 83 85 87 87 88 88 88 88 89 90 91 94 96 96 96 97 98 99 100 102 104 104 105 105 109 109 109 113 122

Current
Mean: 82.136 ms
Stdev: 10.630 ms (12.9%)
Runs: 62 63 68 68 68 69 69 70 70 71 71 71 72 72 73 73 73 74 74 74 74 76 78 78 79 80 80 80 81 81 82 83 84 85 85 86 86 87 87 89 90 90 90 90 91 91 91 92 93 94 96 97 98 98 99 99 99 101 101
App start time contentAppeared_To_screenTTI Baseline
Mean: 642.338 ms
Stdev: 46.904 ms (7.3%)
Runs: 555.8432010000106 555.9188449999783 556.4177250000648 566.5600109999068 578.0378089998849 584.7359110000543 586.9318409999833 588.7602389999665 589.1974110000301 592.976740000071 593.344892000081 595.9957290000748 601.5253560000565 602.9169189999811 607.7271310000215 609.8054519998841 612.7448670000304 620.0058599999174 622.7007869998924 627.1781379999593 629.2792690000497 630.561791999964 631.2558120000176 634.4109799999278 634.6730009999592 639.8227339999285 639.9601020000409 640.3200060001109 646.2867699998897 647.9074619999155 651.168330000015 653.3002730000298 655.4345249999315 655.9380689999089 656.3292459999211 656.429393999977 658.2185589999426 658.99303100002 659.2353970000986 665.5676359999925 667.022651999956 668.4550620000809 670.4767730000895 677.4491890000645 679.4763070000336 681.0770330000669 688.3629530000035 695.5366259999573 696.1739940000698 700.574908999959 701.3467079999391 702.8637550000567 717.4399989999365 730.3279659999534 735.8064129999839 764.1463250000961

Current
Mean: 644.200 ms
Stdev: 45.832 ms (7.1%)
Runs: 559.5541830000002 567.6677600000985 574.921209000051 576.1077630000655 583.5665559999179 587.2275870000012 591.8152540000156 592.863662000047 593.8195360000245 598.3373139998876 598.9653149999212 602.6675619999878 605.2563279999886 608.0828430000693 609.3899000000674 610.1848039999604 610.9718969999813 614.8718439999502 614.9511740000453 626.5390200000256 627.568566000089 630.7513850000687 635.6371289999224 636.6509169999044 638.5249069998972 638.9436439999845 639.2037049999926 640.0285600000061 640.2719240000006 641.5445499999914 643.574285000097 644.0933320000768 648.6717379998881 653.9594900000375 655.9445430000778 656.2194709999021 659.0872460000683 661.6730009999592 662.7569079999812 663.0577219999395 663.6123879998922 664.857638000045 673.472502999939 675.4710079999641 676.7834260000382 678.665563999908 684.3841709999833 687.9094759998843 688.6236670000944 689.8723959999625 690.626823999919 700.2061169999652 708.4169830000028 732.9287159999367 735.5278670000844 745.4807619999629 776.6342269999441
App start time appCreation Baseline
Mean: 80.618 ms
Stdev: 8.074 ms (10.0%)
Runs: 65 66 67 68 70 71 72 72 72 73 73 74 74 76 76 76 77 77 77 78 78 79 79 79 79 80 80 80 81 81 81 81 82 82 82 83 83 83 84 84 85 86 86 86 86 87 87 87 90 90 93 95 97 102 102

Current
Mean: 85.407 ms
Stdev: 10.401 ms (12.2%)
Runs: 69 70 71 72 73 73 74 75 75 75 75 76 77 77 77 78 78 78 78 78 79 79 80 81 81 81 82 82 82 83 84 84 84 85 87 89 89 89 89 89 90 90 91 91 91 91 93 96 96 98 99 99 99 104 105 106 107 107 108
App start time TTI Baseline
Mean: 1517.868 ms
Stdev: 95.305 ms (6.3%)
Runs: 1342.8432010000106 1350.0378089998849 1359.9188449999783 1361.4177250000648 1377.344892000081 1377.7359110000543 1384.1781379999593 1392.7271310000215 1401.5600109999068 1410.805451999884 1414.976740000071 1423.1974110000301 1428.5253560000565 1449.168330000015 1451.4491890000645 1451.7602389999665 1452.9318409999833 1456.7448670000304 1458.2792690000497 1471.2558120000176 1473.9169189999811 1481.4109799999278 1491.6730009999592 1505.3279659999534 1508.9827020000666 1509.3002730000298 1511.8227339999285 1515.9957290000748 1516.9074619999155 1519.561791999964 1525.0058599999174 1526.429393999977 1531.4763070000336 1533.7007869998924 1538.022651999956 1542.4345249999315 1547.2867699998897 1556.2353970000986 1556.9380689999089 1557.329245999921 1557.960102000041 1562.3200060001109 1563.2185589999426 1571.8637550000567 1577.4767730000895 1579.455062000081 1580.5366259999573 1589.99303100002 1591.3629530000035 1601.8064129999839 1604.5676359999925 1612.1739940000698 1618.346707999939 1636.4399989999365 1637.574908999959 1641.0770330000669 1701.39580700011 1709.063792000059 1709.146325000096 1759.663055999903

Current
Mean: 1514.813 ms
Stdev: 94.695 ms (6.3%)
Runs: 1321.8857650000136 1342.6677600000985 1363.5541830000002 1375.3373139998876 1380.1077630000655 1390.2563279999886 1400.7513850000687 1402.8195360000245 1403.863662000047 1410.2275870000012 1412.0828430000693 1420.6675619999878 1420.921209000051 1421.7569079999812 1425.8152540000156 1434.5249069998972 1438.568566000089 1467.2037049999926 1467.8718439999502 1469.1848039999604 1479.9594900000375 1482.9653149999212 1483.9718969999813 1485.3899000000674 1487.6509169999044 1492.566555999918 1495.9511740000453 1504.471007999964 1510.857638000045 1522.5445499999914 1525.028560000006 1531.472502999939 1534.0933320000768 1537.5390200000256 1544.665563999908 1549.6371289999224 1552.2719240000006 1553.6730009999592 1557.6717379998881 1566.8723959999625 1567.6123879998922 1569.9436439999845 1575.574285000097 1577.4169830000028 1580.9445430000778 1581.2061169999652 1581.4807619999629 1585.0577219999395 1590.0872460000683 1605.9287159999367 1606.9094759998843 1611.626823999919 1613.3841709999833 1615.2194709999021 1620.7834260000382 1622.6236670000944 1631.5278670000844 1643.634226999944 1756.3067439999431 1782.201708999928
App start time appCreationEnd_To_contentAppeared Baseline
Mean: 670.678 ms
Stdev: 40.939 ms (6.1%)
Runs: 595 596 601 602 603 608 609 611 613 614 629 631 633 634 635 642 643 644 649 650 655 658 658 666 668 669 670 670 672 678 680 681 687 688 689 689 691 692 694 695 695 699 700 701 703 704 704 711 712 713 713 713 715 716 728 729 730 735 757

Current
Mean: 671.220 ms
Stdev: 40.724 ms (6.1%)
Runs: 577 592 594 600 602 610 614 625 628 628 628 629 635 638 643 645 648 652 656 658 658 660 660 661 661 666 667 668 672 678 680 681 683 683 684 685 686 686 688 692 693 694 696 703 703 707 708 709 713 716 717 717 717 718 727 738 739 739 747
App start time regularAppStart Baseline
Mean: 0.024 ms
Stdev: 0.002 ms (8.9%)
Runs: 0.019816000014543533 0.019898000173270702 0.020183000015094876 0.02079300000332296 0.02087399992160499 0.020915000000968575 0.02095600008033216 0.02115899999625981 0.021200000075623393 0.021241000154986978 0.021321999840438366 0.021361999912187457 0.0213620001450181 0.021566000068560243 0.021646999986842275 0.02176899998448789 0.021932000061497092 0.022216999903321266 0.022338999900966883 0.022379999980330467 0.022461000131443143 0.022704999893903732 0.022745999973267317 0.023152999812737107 0.023397000040858984 0.023397000040858984 0.02347899996675551 0.0235190000385046 0.023600999964401126 0.023680999875068665 0.023722999962046742 0.023763000033795834 0.02388500003144145 0.02388500003144145 0.024129000026732683 0.0242510000243783 0.024292000103741884 0.024332999950274825 0.024413999868556857 0.02441499987617135 0.024454000173136592 0.024455000180751085 0.024616999784484506 0.024658000096678734 0.024698999943211675 0.02478000009432435 0.024942999938502908 0.02510600001551211 0.02510600001551211 0.025350000010803342 0.025879000080749393 0.026285999920219183 0.026448999997228384 0.026489000068977475 0.026895999908447266 0.027222000062465668 0.02750599989667535 0.028442999813705683 0.028645999962463975

Current
Mean: 0.028 ms
Stdev: 0.003 ms (9.7%)
Runs: 0.022582999896258116 0.023071999894455075 0.023234000196680427 0.023763000033795834 0.023803999880328774 0.02404800010845065 0.024130000034347177 0.02494300017133355 0.025145999854430556 0.025350000010803342 0.025390000082552433 0.02547200000844896 0.025553000159561634 0.0256759999319911 0.025757000083103776 0.025797999929636717 0.026042000157758594 0.02608199999667704 0.02608199999667704 0.026326999999582767 0.02636700007133186 0.02661100006662309 0.02677399991080165 0.026855000061914325 0.026978000067174435 0.027383999899029732 0.027384999906644225 0.02738500013947487 0.02750699990428984 0.02779199997894466 0.027913999976590276 0.027994999894872308 0.028116999892517924 0.028156999964267015 0.0281980000436306 0.028483000118285418 0.02852399996481836 0.028686999808996916 0.028929999796673656 0.02897099987603724 0.02941900002770126 0.029541000025346875 0.029541000025346875 0.029581999871879816 0.02998899994418025 0.03002900001592934 0.030396000016480684 0.030396000016480684 0.030598999932408333 0.030681000091135502 0.030762000009417534 0.03080300008878112 0.030844000168144703 0.030882999999448657 0.03088400000706315 0.031128000002354383 0.03234799997881055 0.033528999891132116 0.03552299994044006
App start time runJsBundle Baseline
Mean: 477.717 ms
Stdev: 28.577 ms (6.0%)
Runs: 422 425 427 430 430 431 436 444 444 444 453 454 456 456 457 459 460 461 461 464 466 467 468 468 470 471 474 474 476 476 481 482 483 483 484 484 485 488 491 494 495 496 496 497 498 498 499 500 505 505 506 507 510 512 512 519 528 529 531 541

Current
Mean: 481.267 ms
Stdev: 31.836 ms (6.6%)
Runs: 410 418 422 425 432 434 435 438 445 451 453 454 455 455 455 456 459 461 464 464 467 467 467 472 473 474 476 477 480 483 484 486 487 495 495 496 498 498 499 500 500 501 502 504 510 510 510 512 514 516 519 519 520 521 521 522 523 528 529 535
App start time (CPU) Baseline
Mean: 124.717 %
Stdev: 10.281 % (8.2%)
Runs: 107.76571633066922 108.8247011952191 109.84086336199015 110.22776690584912 111.86790505675954 112.00672574270055 112.63218118686869 113.03934719427679 113.4148502569555 113.96266480730222 114.56509857659987 114.75667189952902 114.77432862261948 114.91839076795563 115.77496751092454 116.7672646881064 116.77639369109079 117.71371769383703 117.83009358677596 118.01061557588704 118.70178926441353 119.1581334372675 119.16149104876399 119.20203017059075 120.15127701375245 120.7255781404078 121.22145588964813 122.22655792718616 123.04703843165383 123.14378848243389 124.02381104169325 124.07107469512194 124.36420947059246 124.86802631107145 126.20960397459298 126.82422499073698 127.23170260269977 127.44679505423272 128.56143029482396 129.03989181879646 129.22176301441868 129.25368978000557 130.12429414554254 131.2737536693628 132.23527007482866 132.78401146692926 133.1100404541499 136.32620473339037 136.7699218176242 137.22188222086226 137.42907220942863 138.29435991470524 138.3877519637063 138.4012782916606 138.5542168674699 138.88231426692957 141.60011266060343 143.66283470170336 145.05820105820104 149.58149670553723

Current
Mean: 120.550 %
Stdev: 7.368 % (6.1%)
Runs: 106.22651111807079 108.31673306772907 109.7432961160416 110.99688597892046 111.07892491133575 111.70062898073371 112.61904761904765 112.75227719235576 112.83600999215132 113.37222095530723 113.7282395997297 115.48331907613345 116.30339641008129 116.44617202211262 116.71305668016194 116.80054610109224 116.8243586487173 116.86793069239873 117.1954719387755 117.46150556030796 117.804780876494 117.83863452669613 119.0264761059044 119.37328472205455 119.48594491255395 119.53732088115778 119.66306430962773 119.82676791646892 119.90820424555369 120.60551464828454 120.8487416077263 120.91758471621807 121.05048420193677 121.2130855397149 121.7200303130773 121.8265399938707 122.86401829503934 122.93572154471543 123.1106719367589 123.54464409258932 123.75634477476297 123.7743051413575 124.79316050744622 125.01195333418337 125.15389101276487 126.37981407702527 128.4205491851553 129.25851703406812 133.86214179426875 134.19686833459622 134.4025644927019 136.48806804062565 138.7310182899602 138.9210199174101
App start time (FPS) Baseline
Mean: 59.895 FPS
Stdev: 0.264 FPS (0.4%)
Runs: 58.85450395544046 59.02892300124187 59.057278825824504 59.42804784559583 59.57460842232356 59.6806893824143 59.74163464050581 59.80445271844096 59.83294910435762 59.948960783276476 59.9949810593212 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60

Current
Mean: 59.892 FPS
Stdev: 0.241 FPS (0.4%)
Runs: 59.093582528418445 59.11450198381942 59.21603589763933 59.29370440741089 59.516701206480114 59.59094421566502 59.60267498832842 59.6464345920377 59.80005643503019 59.8115514223973 59.95824684329196 59.96502515633928 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60
App start time (RAM) Baseline
Mean: 375.673 MB
Stdev: 8.746 MB (2.3%)
Runs: 364.142578125 364.216796875 365.23046875 365.90234375 365.9140625 366.314453125 366.513671875 366.63671875 366.650390625 366.982421875 367.0234375 367.060546875 367.06640625 367.119140625 367.16015625 367.400390625 367.748046875 367.900390625 368.099609375 368.158203125 368.7578125 369.150390625 370.064453125 370.7421875 370.857421875 370.904296875 371.6640625 372.392578125 373.2734375 374.345703125 374.634765625 374.7265625 375.044921875 375.533203125 375.8828125 376.8125 377.78515625 377.90234375 379.46484375 379.703125 380.63671875 381.4375 382.0755208333333 382.3359375 382.6901041666667 382.9309895833333 384.6236979166667 385.4973958333333 385.74609375 386.0481770833333 386.8763020833333 387.0963541666667 387.1458333333333 387.2903645833333 387.9518229166667 388.2083333333333 388.41015625 388.9401041666667 390.1979166666667 401.37109375

Current
Mean: 373.894 MB
Stdev: 7.995 MB (2.1%)
Runs: 363.19921875 363.6640625 364.47265625 364.55078125 364.564453125 364.67578125 364.75 364.826171875 364.943359375 365.208984375 365.388671875 365.638671875 366.5390625 367.259765625 367.59375 367.765625 367.853515625 368.103515625 368.23046875 368.232421875 368.2578125 368.74609375 368.919921875 369.634765625 369.84765625 369.955078125 370.583984375 371.4375 371.484375 371.712890625 371.755859375 372.5234375 372.666015625 374.384765625 374.47265625 375.484375 376.041015625 376.18359375 376.431640625 376.5703125 377.537109375 378.033203125 378.146484375 378.66015625 379.232421875 379.35546875 379.8606770833333 380.9609375 382.10546875 382.4453125 382.7252604166667 383.5026041666667 383.7799479166667 386.06640625 386.6393229166667 386.6497395833333 387.6731770833333 388.9479166666667 389.69140625 397.09375
App start time (CPU/JS) Baseline
Mean: 74.688 %
Stdev: 2.582 % (3.5%)
Runs: 69.1 70.5 70.6 71.3 71.8 71.8 71.9 71.9 71.9 72 72 72 72.5 72.6 72.9 73 73 73 73.6 73.7 73.8 73.9 73.9 74 74 74.1 74.1 74.2 74.4 74.5 74.5 74.6 74.8 74.9 75 75.2 75.4 75.5 75.7 75.8 75.9 76 76.1 76.4 76.7 77 77 77.1 77.7 77.8 78.1 78.9 79 79.4 79.8 80 80.9

Current
Mean: 75.062 %
Stdev: 2.729 % (3.6%)
Runs: 70.8 71 71.1 71.8 71.8 71.9 71.9 71.9 72.2 72.2 72.3 72.5 72.5 72.6 72.6 72.7 72.8 72.9 72.9 72.9 73 73.3 73.5 73.7 73.8 74 74 74 74.1 74.8 75 75.1 75.3 75.3 75.3 75.7 75.7 75.9 75.9 76.2 76.5 76.5 76.6 76.9 76.9 77.6 77.8 77.9 77.9 77.9 78.7 78.7 78.7 78.9 78.9 79 79.6 79.7 80.9 81.2
App start time (CPU/UI) Baseline
Mean: 19.047 %
Stdev: 6.578 % (34.5%)
Runs: 9.9 10 10.9 11 11.9 11.9 11.9 11.9 12 12.8 12.9 12.9 12.9 12.9 13 13.9 14.7 14.9 14.9 14.9 14.9 15.8 15.9 15.9 15.9 16 16 16.6 16.8 16.8 17.9 17.9 17.9 18.7 18.8 19 19 19.1 19.9 20.1 21 21 21.2 23.1 23.7 24.5 24.7 25.3 26.2 26.6 27.5 27.9 28.4 28.6 28.6 30.6 31.3 33.3 33.3 35

Current
Mean: 16.739 %
Stdev: 4.038 % (24.1%)
Runs: 10.9 11.8 11.9 11.9 12.9 12.9 12.9 12.9 12.9 13 13.7 13.9 13.9 13.9 14.7 14.9 14.9 14.9 14.9 14.9 14.9 14.9 15 15 15 15 15.8 15.9 16 16 16 16.1 16.8 16.8 16.9 16.9 17 17 17 17.9 18.1 18.9 18.9 18.9 19 19.9 20 23.1 25.3 25.9 26 26.1 26.6 26.7
Open search router TTI Load Search Options Baseline
Mean: 100.795 ms
Stdev: 6.463 ms (6.4%)
Runs: 86.06457499996759 86.54345699981786 87.45361300022341 90.20906600006856 90.65087900008075 91.16036000009626 91.39200900006108 91.69535299995914 93.39152000006288 93.92826299997978 93.92826299997978 94.04341599997133 94.3247070000507 94.4413250000216 94.46789600001648 94.53035499993712 94.7876389999874 95.04711899999529 95.07250999985263 95.48824100010097 95.53039500000887 96.00020299991593 96.02124099992216 96.17818199982867 96.39941400010139 96.50813799956813 96.60079000005499 96.61926300008781 96.66276099998504 96.75349899986759 96.88891600002535 96.88891600002535 96.90254699997604 97.11092100013047 97.12467400007881 97.24576900014654 97.41967799980193 97.75541199976578 97.85017899982631 98.00235999980941 98.13802099972963 98.32275400008075 98.51924599986523 98.57609099987894 98.70849599968642 98.73063100036234 98.8500570000615 99.41060399985872 99.4497070000507 99.55774000007659 99.61511200014502 99.70597300003283 99.95865899999626 99.96809899993241 99.97102899989113 100.13016800023615 100.14070700015873 100.32767700008117 100.33064800011925 100.34000699990429 100.39274100004695 100.4178059999831 100.4178059999831 100.64237500028685 101.07897899998352 101.15966800018214 101.18351199990138 101.52762900013477 101.70324699999765 101.70324699999765 101.7735190000385 102.05456599988975 102.08691499987617 102.18294299999252 102.32613099995069 102.77388500003144 102.97920700022951 103.14331099996343 103.33105499995872 103.6728919998277 104.18367600021884 104.26733399997465 104.26733399997465 104.66544599994086 104.89864100003615 105.06555199995637 105.10965900006704 105.19750999985263 105.49137399997562 105.58345500007272 105.78527799993753 105.93530300003476 105.9557289998047 106.01102699991316 106.52705899998546 107.11348499986343 107.18151900032535 108.05818699998781 108.80346699990332 109.94584199995734 111.21988900005817 111.25077300006524 112.34167500026524 112.72208600025624 113.04585700016469 113.8651129999198 116.18998200003989 116.73937999992631 116.74092600005679 116.77046700008214 116.89339200011455

Current
Mean: 102.098 ms
Stdev: 7.371 ms (7.2%)
Runs: 85.61747199995443 85.82491099997424 86.72391699999571 86.73567699990235 89.7459309999831 90.43835399998352 91.95402000006288 92.04113800008781 92.35363800008781 93.28621400007978 93.41581299994141 93.89001500001177 93.92325899982825 94.11242699995637 94.32482900004834 94.57088200002909 95.0379229998216 95.0834150002338 95.13179499981925 95.22066300013103 95.22603300004266 95.40124500007369 95.71765099978074 96.03434300003573 96.12390100001357 96.54020100017078 96.58268200000748 96.60786899994127 96.63094100030139 96.73596199997701 96.91227199998684 97.5434570000507 97.58134000003338 97.82906099967659 97.9961749999784 98.33516500005499 98.3577480004169 98.4616700001061 98.60733999987133 98.69401099998504 98.77994799986482 98.86800099955872 98.89860000018962 98.96215899987146 99.0842699999921 99.33235700009391 99.36714700004086 99.37284300010651 99.94506799988449 100.11730999988504 100.13216100004502 100.1481119999662 100.17407299997285 100.26440400001593 100.36515299999155 100.55912300013006 100.59847000008449 100.68143700016662 100.71805900009349 100.82934499997646 100.91809099982493 101.07674199994653 101.11185699980706 101.39314699964598 101.41487700026482 101.8144129998982 101.8878979999572 102.15173300006427 102.24324599979445 102.66133600007743 103.04085300001316 103.19612600002438 103.35282400017604 103.40824400028214 103.6424559999723 104.47839399985969 104.83414799999446 104.95170099986717 105.06665000040084 105.64265999989584 105.7191570000723 106.0286049998831 106.37471499992535 106.73868800001219 106.73872900009155 106.75496400007978 106.90266899997368 107.17692100000568 107.2049559999723 107.40983100002632 107.48046900006011 107.52701899968088 107.87479599984363 108.07303800014779 108.25614399998449 108.28080299985595 108.29215500038117 108.77502399985678 108.97334800008684 109.03511499986053 109.43432600004598 109.56595900002867 109.75581900007091 110.01037599984556 110.88374800002202 111.06559300003573 111.13073700014502 111.62992400000803 111.71097800019197 112.01383399986662 112.4340820000507 114.50553399999626 115.18632099987008 116.20283999992535 116.57926400005817 118.21264700009488 119.65413499996066 120.9498700001277 122.25
Open search router TTI Open Search Router TTI Baseline
Mean: 687.052 ms
Stdev: 61.655 ms (9.0%)
Runs: 563.5155840001535 566.4659840001259 568.1116129998118 572.645712000085 576.4145909999497 578.6663420000114 588.070800999878 604.5558670000173 612.5994469998404 614.3564859998878 617.7594810002483 617.9684250000864 622.0212409999222 623.203125 656.8398030002136 657.8789059999399 660.9461669998709 666.0780440000817 666.6758220000193 666.8387050000019 668.8669849999715 675.052001999924 676.816529000178 682.8049320001155 683.4025069996715 684.1453859996982 687.1466469999868 687.6083179998677 690.2967940000817 693.4236650001258 701.9210620000958 702.0589199999813 707.0597739999648 713.4133709999733 714.7558189998381 717.369059999939 718.0190019998699 718.6717530000024 718.806194000179 723.4818939999677 725.2421059999615 725.9064939999953 727.2980150000658 728.8437100001611 729.694010999985 730.2234300000127 739.0677900002338 743.8559580000583 746.7885340000503 751.4822590001859 752.8498130000662 755.2365319998935 758.2757569998503 763.2738850000314 768.1615400002338 768.7510590001475 771.516764999833 778.6672780001536 804.2117109997198

Current
Mean: 686.500 ms
Stdev: 53.583 ms (7.8%)
Runs: 573.4297279999591 579.7094319998287 591.6849769996479 593.8782560001127 594.4179289999884 594.7681479998864 597.9639900000766 599.5512289998587 603.9401040002704 608.3155930000357 618.767741000047 620.6140139999334 629.887614000123 630.694010999985 633.1071369999554 653.6001800000668 654.1481529998127 657.7506520000752 662.2227789997123 666.8906660000794 672.6698809999507 678.7093919999897 686.6193450000137 686.6416840003803 689.3756510000676 692.8705239999108 703.5738939999137 707.1659339999314 707.8345549996011 708.2776699999813 709.9872639998794 710.1463629999198 712.8119719999377 713.8208420001902 716.0130210001953 716.3332529999316 716.3336999998428 717.3224690000061 721.0551349997986 721.4974770001136 721.8281260000076 724.1291099998634 724.346029000124 726.3594160000794 726.7967129999306 728.0018310002051 729.4395350001287 729.5583910001442 732.4794519999996 733.417277000146 739.9853929998353 740.3696290000807 741.593913000077 741.9029540000483 744.8852949999273 745.1600339999422 746.3198649999686 747.0993250003085 749.7390139999334 762.1949060000479
Open search router TTI (CPU) Baseline
Mean: 147.538 %
Stdev: 4.852 % (3.3%)
Runs: 139.142171130481 139.71479374517378 140.1975960900165 140.47990758653964 140.57695418176195 140.70632196114127 141.26356422946012 141.47524188958454 141.9806681286249 142.72674173565233 142.9937698261296 143.31314199714635 143.39621530600564 143.63319462384283 143.64407665075575 143.70273738237813 143.71801954008623 144.42740785018253 144.58207795784628 144.86815842000212 145.1854756614604 145.35255019525866 145.72416865555542 146.1234159950754 146.12544992873075 146.25667038107994 146.27090532152837 146.46388709420785 146.81057211642886 146.8862331468224 147.101119815157 147.11545481309898 147.1435240716622 147.22138287949338 147.26197725521098 147.67921413633962 147.8526466513406 148.87105832217807 149.29296012264376 149.3084853755002 150.2113264118344 150.64478080153054 150.7341519743813 151.03542250744798 151.52418663828735 151.76826457349142 152.0150093627471 152.26478369353055 152.43392338300183 152.84893509445945 153.0490033223651 153.1153830703099 153.12558602646558 153.14829287076472 153.69593535879315 154.39249040057075 154.76190476190467 157.17813728316924 158.7156103106751 159.0502819063069

Current
Mean: 146.350 %
Stdev: 4.142 % (2.8%)
Runs: 137.20378752475668 140.12707533994657 140.21063311978105 141.30457411869497 141.31885863876062 141.41946153735415 141.63383322074722 141.8391314143279 141.88420876546334 142.3250753183514 142.60368392186817 142.62532977708742 142.73537129613737 142.82072093378764 142.8652202650107 142.8938040885707 143.2209601998317 143.54941035975514 143.60212286474984 143.676312062713 143.94308455466978 144.25539871296064 144.27584803935488 144.39317904000762 144.72972522958418 144.83399797123963 144.8612151159258 144.88590128305262 144.91996812117884 145.4192721611784 145.43108379971352 145.53955399262642 145.63759233332036 145.9004093533183 146.07670732599078 146.83416494699773 147.03715820044 147.2651373947471 147.94246268646566 148.30893744335668 148.73700613965272 149.22882184890486 149.95783274671007 150.16657225156703 150.2598589732514 150.27338718211757 150.28271165393645 150.75364139294715 151.3919246406132 151.40873015873018 151.52463662341071 151.8181802121737 151.8680864771225 151.92261257998308 152.04426960648848 152.13275412235666 152.4925349610515 153.01447012156737 153.71398004708578 155.6497218398216
Open search router TTI (FPS) Baseline
Mean: 56.482 FPS
Stdev: 1.716 FPS (3.0%)
Runs: 52.41014907548394 53.40515126455459 53.60598207079532 54.01682053327628 54.202720200223304 54.44618968986103 54.472880859157016 54.474845596435394 54.528587935381964 54.529568706902616 54.7380188817896 54.76965611160674 54.9598499982746 55.11237997385231 55.18707585532764 55.35012812153801 55.42607264999216 55.469181503296866 55.53608711536485 55.61084006557215 55.72093960118747 55.84599978677099 55.98350075068779 55.98751282657471 56.02274974090844 56.04475498000401 56.06015204868798 56.13706193258728 56.35269308165175 56.41176145636006 56.45721783856031 56.5460619430756 56.55570902716033 56.628651482828985 56.700396501866436 56.84290650800534 57.02031916748933 57.11026032396077 57.23763429287084 57.290307077987535 57.384084962620115 57.416464515053995 57.461855692398885 57.629995192980786 57.78927131569948 57.855267242167045 58.06384877074675 58.46577840256462 58.47002366631588 58.6041471778268 58.69758010062781 58.71141017702989 58.71409646932999 58.766053594869526 59.02504092415681 59.197705746071634 59.35616317180309 59.64676048668296 60

Current
Mean: 59.486 FPS
Stdev: 0.705 FPS (1.2%)
Runs: 57.67344839522596 57.70316867364956 57.826972520885796 58.002219634719594 58.10964323567622 58.15000681478867 58.42889754897774 58.464273769433014 58.51130095425485 58.60044779684177 58.70925550665761 58.92658559568739 58.97500729581798 59.05885451379177 59.29889085069163 59.314107859805645 59.36271526412939 59.45400944052138 59.64079308402652 59.655404943317 59.66668804524819 59.70369100454951 59.72839324485067 59.74397570789842 59.75998688412754 59.7843132260911 59.79222496564743 59.803635950155964 59.80996329902196 59.84749921413942 59.892540858573845 59.90121101024053 59.91051151728114 59.99174684889517 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60
Open search router TTI (RAM) Baseline
Mean: 384.969 MB
Stdev: 3.457 MB (0.9%)
Runs: 375.8720703125 378.2109375 379.9892578125 380.3798828125 380.6259765625 380.798828125 380.818359375 381.0286458333333 381.1015625 381.388671875 381.7626953125 381.763671875 381.9326171875 382.7802734375 382.95703125 382.9755859375 383.0546875 383.1669921875 383.7138671875 383.8046875 384.056640625 384.224609375 384.4248046875 384.4306640625 384.6953125 384.7001953125 384.7353515625 384.8056640625 385.0322265625 385.1826171875 385.3427734375 385.35546875 385.373046875 385.693359375 385.7763671875 385.8916015625 386.0810546875 386.1787109375 386.2216796875 386.3173828125 386.814453125 386.8642578125 386.921875 387.09765625 387.4521484375 387.8330078125 388.490234375 388.8779296875 389.1728515625 389.263671875 389.76484375 390.0234375 390.0927734375 390.5966796875 393.1162109375 393.251953125

Current
Mean: 384.059 MB
Stdev: 2.838 MB (0.7%)
Runs: 376.7174479166667 378.91796875 379.150390625 379.328125 379.34765625 380.470703125 381.1328125 381.2958984375 381.7880859375 381.8017578125 381.8212890625 381.8310546875 382.0830078125 382.13671875 382.310546875 382.6318359375 382.7119140625 382.7646484375 382.814453125 382.8310546875 382.9111328125 383.0048828125 383.0830078125 383.26953125 383.5166015625 383.5283203125 383.9111328125 383.95703125 384.287109375 384.3974609375 384.4248046875 384.44921875 384.5009765625 384.685546875 384.7998046875 384.9755859375 385.1650390625 385.359375 385.587890625 385.6005859375 385.6767578125 385.783203125 385.8701171875 386.11328125 386.2734375 386.3310546875 386.3388671875 386.361328125 386.607421875 386.8623046875 387.7783203125 388.65234375 388.705078125 389.650390625 390.2666015625 390.7412109375
Open search router TTI (CPU/JS) Baseline
Mean: 77.480 %
Stdev: 3.113 % (4.0%)
Runs: 69.9 70.2 72.3 72.4 72.4 72.4 73.5 73.5 73.8 74.2 74.3 74.9 75 75.1 75.3 75.6 75.9 76.1 76.2 76.2 76.3 76.7 76.8 77.1 77.4 77.4 77.4 77.5 77.6 77.8 77.8 77.9 77.9 78.1 78.2 78.2 78.3 78.3 78.4 78.7 78.9 78.9 79.2 79.2 79.5 79.9 80 80.1 80.2 80.3 80.6 81.1 81.2 81.3 81.5 82.2 82.4 82.7 82.8 83.8

Current
Mean: 78.903 %
Stdev: 2.210 % (2.8%)
Runs: 73.3 74.5 75.4 75.5 75.8 75.9 75.9 76.2 76.4 76.6 76.8 76.9 77.1 77.1 77.3 77.3 77.4 77.4 77.8 77.9 77.9 78.2 78.2 78.5 78.6 78.7 78.8 78.9 78.9 78.9 78.9 79 79 79.1 79.4 79.6 79.7 79.8 79.8 79.9 80.1 80.1 80.1 80.2 80.4 80.4 80.4 80.4 80.6 81 81.5 81.6 81.6 81.8 82 82.2 82.2 82.3 82.6 84.4
Open search router TTI (CPU/UI) Baseline
Mean: 27.052 %
Stdev: 1.558 % (5.8%)
Runs: 22.7 24.1 24.3 24.5 24.8 24.8 25.2 25.4 25.6 25.7 25.8 25.8 25.9 25.9 26.1 26.2 26.3 26.3 26.3 26.4 26.4 26.4 26.5 26.7 26.7 26.8 26.8 26.9 26.9 26.9 27 27.2 27.2 27.4 27.4 27.4 27.5 27.6 27.8 27.9 28 28.1 28.1 28.2 28.3 28.4 28.4 28.7 28.8 28.9 29 29.2 29.3 29.4 29.4 29.5 29.8 30

Current
Mean: 28.066 %
Stdev: 1.421 % (5.1%)
Runs: 25.2 25.4 25.7 25.8 26 26.2 26.4 26.5 26.6 26.6 26.8 26.8 26.9 26.9 26.9 27.2 27.3 27.3 27.4 27.4 27.4 27.4 27.4 27.4 27.5 27.6 27.7 27.9 27.9 27.9 27.9 27.9 28.3 28.4 28.4 28.4 28.4 28.5 28.6 28.8 28.8 28.8 28.9 28.9 29 29.3 29.4 29.5 29.6 29.7 29.9 29.9 29.9 30.2 30.3 30.3 30.5 30.8 31.2
Report typing Composer typing rerender count Baseline
Mean: 1.000 renders
Stdev: 0.000 renders (0.0%)
Runs: 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1

Current
Mean: 1.000 renders
Stdev: 0.000 renders (0.0%)
Runs: 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1
Report typing Message sent Baseline
Mean: 486.920 ms
Stdev: 45.585 ms (9.4%)
Runs: 399.71777300024405 401.7161460001953 403.8326010000892 403.8358559999615 410.8072919999249 411.5386960003525 418.3686929997057 421.37719700019807 422.228637999855 423.20613600034267 423.478637999855 432.10827599978074 452.2586260000244 461.11958799976856 461.23824100010097 461.44356300029904 464.1836350001395 466.7495929999277 468.47029699990526 469.67419399973005 469.81217499962077 471.21610500011593 471.34167500026524 476.0373949999921 480.84130800003186 482.1389160002582 482.2144780000672 485.63155199959874 488.0579429999925 491.3202309999615 496.10962000023574 496.29435299988836 497.6636970001273 501.822714000009 504.0250649997033 504.9181320001371 507.2814529999159 507.7915039998479 508.7031259997748 509.1997890002094 511.58504300005734 513.1903079999611 516.4031990002841 516.4239909998141 520.3929449999705 523.5374360000715 524.1228840001859 527.3076579999179 528.4403080004267 535.9274909999222 539.2278239997104 540.5665699997917 541.3096930002794 544.4844570001587 545.1743979998864 546.1109219999053 554.531413000077 554.7694909996353 558.6716310000047 563.2579350001179

Current
Mean: 490.119 ms
Stdev: 44.171 ms (9.0%)
Runs: 400.8635260001756 407.8988859998062 409.91361499996856 417.4755460000597 418.05102599970996 423.63924199994653 427.410279000178 427.69258599961177 429.4877520003356 430.4445809996687 432.18054200010374 443.77022300008684 454.38647499959916 459.43973799981177 459.92175300000235 462.4883630000986 462.89778699958697 468.27962200017646 471.74141399981454 472.34143100026995 475.03096499992535 475.31795200007036 479.1306150001474 483.96541399974376 484.46618700027466 484.6147470003925 486.5294600003399 488.3790690000169 489.4523109998554 491.02347799995914 491.4359940001741 495.5190030001104 497.783976000268 499.7279460001737 503.43754100007936 505.5324299996719 506.6759849996306 508.21972599998116 508.3384199999273 508.9364419998601 510.0690510002896 516.4497890002094 518.2779950001277 524.1366780004464 531.069540000055 534.3324799998663 535.571411000099 536.6875820001587 537.5040279999375 538.3458659998141 538.7993979998864 539.6210529999807 539.9016110002995 539.9323330000043 540.6267500002868 541.1951099997386 541.4681810000911 543.8648279998451 557.4874680000357 597.9377040001564
Report typing (CPU) Baseline
Mean: 105.201 %
Stdev: 2.837 % (2.7%)
Runs: 99.18994469521436 100.43556603084893 101.01789183873537 101.02350411424723 101.14197691795768 101.57351728801663 101.73338189131137 101.92236749112166 102.00083892890859 102.02136938627353 102.1818718657056 102.2039760048378 102.24243992340271 102.34438047429832 102.73308590761481 102.94669332011367 103.25233577470082 103.41666731420175 103.43418416513272 103.49062293826023 103.519301691623 103.98856757787388 104.02070582085629 104.13639545715604 104.37639548211247 104.54740615344699 104.99904373374422 105.13336316802732 105.21081262441584 105.24453929677347 105.40459771521698 105.46905754065727 105.59417705110896 105.75705982490375 105.76434340164363 105.78871221323156 105.79084917714371 106.06651194329719 106.44402866197828 106.65500874916012 106.69595258595446 106.81582338361932 106.97048860609924 106.98330424998335 106.99000738230728 107.25764481329604 107.36873070804062 107.50509190936627 107.60456034609938 107.97592089366022 108.38181357834193 108.41893209259965 108.76551305212477 109.07602273159573 109.0929807075105 109.86841551860756 109.97028362004984 110.04823487080691 110.05169778856401 112.010321079151

Current
Mean: 105.301 %
Stdev: 2.803 % (2.7%)
Runs: 99.95445330563085 101.02466829495404 101.15046132594414 101.1570145241473 101.33451207666003 101.81571670413716 102.00412941947424 102.22536651647604 102.38440750481408 102.45104532692409 102.55515744631404 102.8231381141222 102.8910413648953 102.91708705330453 103.1236465074278 103.18252639189022 103.32896600378754 103.48845321038425 103.53986550215997 103.66722158640762 103.8177769652105 103.89617564780465 104.30778845427444 104.39582030344792 104.43790875494514 104.47817715662028 104.72344496202086 104.78130979342107 104.79415511665972 105.08973063761854 105.1287256287436 105.24891912281527 105.31168489319954 105.39999690668697 105.43804172043157 105.58004872166244 106.06909260944467 106.24198363582319 106.27802397489629 106.30656408569367 106.41330664868738 106.47783246856585 106.52382286170658 106.60065611230756 106.64536729200606 106.88294039763211 106.95499485128573 107.36449721556396 107.46415751523257 108.11274336860033 108.4639147246608 108.56144052395295 108.68495945054798 108.68696591533507 109.6568464326346 110.53853942784612 110.7748424911879 110.94520164934038 111.47221848268816 112.12022398169438
Report typing (FPS) Baseline
Mean: 59.996 FPS
Stdev: 0.008 FPS (0.0%)
Runs: 59.968977782376015 59.97112328826501 59.97372531424248 59.97693103502911 59.98058472569151 59.982858683098875 59.98518801009298 59.98775526617035 59.99489832145858 59.99804625009699 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60

Current
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60
Report typing (RAM) Baseline
Mean: 457.137 MB
Stdev: 4.293 MB (0.9%)
Runs: 449.79926215277777 450.7282986111111 450.94618055555554 451.15254934210526 451.3561197916667 451.4748263888889 451.6779513888889 451.90316611842104 452.4123263888889 452.47504340277777 452.60503472222223 452.60958059210526 453.0017361111111 453.50303819444446 453.65907118055554 453.80550986842104 453.8414884868421 453.8675986842105 454.0891927083333 454.2306857638889 454.2654079861111 454.5944010416667 454.6546052631579 454.87520559210526 455.1439144736842 455.40342881944446 455.8910361842105 456.1145833333333 456.6091579861111 456.8032483552632 457.07154605263156 457.24696180555554 457.27842881944446 457.5256076388889 457.73314144736844 458.21983506944446 458.23231907894734 458.2808388157895 458.4787326388889 459.197265625 459.4467516447368 460.0013020833333 460.3805509868421 460.38563368055554 460.7582236842105 460.99565972222223 461.47764756944446 461.48285590277777 461.6716579861111 461.67454769736844 461.9568142361111 462.1624177631579 462.2368421052632 463.2896792763158 463.5638020833333 464.0581825657895 464.34950657894734 464.7434895833333 465.1646792763158 465.6675575657895

Current
Mean: 457.837 MB
Stdev: 3.809 MB (0.8%)
Runs: 450.16710069444446 451.0525173611111 451.3567708333333 452.150390625 452.30164930555554 452.4485677083333 452.6584201388889 452.9052220394737 452.96332465277777 453.1325954861111 453.2592516447368 453.9311266447368 454.12890625 454.3706825657895 454.67925347222223 455.3943142361111 455.3980263157895 455.4713541666667 455.4720394736842 455.8443667763158 456.02256944444446 456.2200520833333 456.61328125 456.86739309210526 456.89864309210526 456.9173177083333 457.17660361842104 457.9055989583333 458.0201822916667 458.0232204861111 458.14887152777777 458.5279947916667 458.98741319444446 459.09971217105266 459.10341282894734 459.109375 459.11610243055554 459.16493055555554 459.3550575657895 459.3626302083333 459.8059895833333 459.8802083333333 460.36328125 460.74370659722223 460.8802083333333 460.91102430555554 461.2907986111111 461.2923177083333 461.3196614583333 461.3231907894737 461.35464638157896 461.54796006944446 461.7738486842105 461.86805555555554 462.82051809210526 463.55186631944446 463.8098958333333 464.5659950657895 464.97450657894734 466.4079861111111
Report typing (CPU/JS) Baseline
Mean: 47.203 %
Stdev: 2.635 % (5.6%)
Runs: 42.8 42.8 43.1 43.1 43.2 43.2 43.7 43.7 43.8 43.9 44.1 44.5 44.6 44.8 45.1 45.1 45.5 45.5 45.7 45.9 45.9 45.9 46 46.1 46.1 46.2 46.4 46.5 47.5 47.5 47.5 47.6 47.6 47.7 47.9 47.9 48.3 48.5 48.5 48.6 48.6 48.8 48.8 49.1 49.5 49.6 49.6 49.7 49.9 50.1 50.2 50.2 50.5 50.6 51.1 51.2 51.2 51.3 51.5 52.4

Current
Mean: 47.377 %
Stdev: 2.701 % (5.7%)
Runs: 42.3 42.8 43.1 43.3 43.3 43.4 43.5 43.7 44 44.3 44.5 44.7 44.8 44.9 45.2 45.2 45.5 45.8 45.9 46 46.2 46.3 46.7 46.7 47.2 47.2 47.6 47.6 47.6 47.6 47.7 47.9 48 48 48.1 48.1 48.2 48.3 48.3 48.3 48.4 48.4 48.4 48.4 48.5 48.6 49.1 49.2 49.6 50 50.1 50.3 50.7 50.7 51.3 51.6 52.8 52.8 52.9 53
Report typing (CPU/UI) Baseline
Mean: 27.803 %
Stdev: 0.889 % (3.2%)
Runs: 25.6 26.1 26.1 26.5 26.6 26.6 26.7 26.7 26.8 27.1 27.1 27.1 27.1 27.2 27.2 27.3 27.3 27.3 27.5 27.5 27.5 27.5 27.6 27.6 27.6 27.6 27.6 27.7 27.8 27.8 27.8 27.8 27.8 27.9 27.9 27.9 28 28.1 28.1 28.1 28.2 28.3 28.3 28.4 28.5 28.5 28.5 28.6 28.6 28.7 28.7 28.8 28.9 29 29 29.1 29.4 29.7 30.1

Current
Mean: 27.637 %
Stdev: 0.855 % (3.1%)
Runs: 25.8 26 26.2 26.4 26.5 26.5 26.6 26.6 26.7 26.7 26.7 26.8 26.8 26.9 27.1 27.1 27.1 27.1 27.1 27.2 27.2 27.2 27.3 27.4 27.5 27.5 27.5 27.6 27.6 27.7 27.7 27.7 27.7 27.8 27.8 27.9 27.9 27.9 27.9 28.1 28.1 28.1 28.2 28.2 28.2 28.2 28.3 28.4 28.5 28.5 28.8 28.9 28.9 28.9 29 29 29.1 29.2 29.3
Chat opening Chat TTI Baseline
Mean: 501.145 ms
Stdev: 108.704 ms (21.7%)
Runs: 298.4676919998601 306.24666399974376 313.15921999979764 315.7086999998428 324.4215500000864 324.8867599996738 327.2677000002004 328.3182379999198 332.5809329999611 348.22277799993753 349.7769369999878 373.227498000022 375.63871199963614 378.85298700025305 381.2493489999324 395.5056149996817 399.24414099985734 407.16048199962825 426.03584800008684 436.70129400026053 495.5802410002798 509.8394369999878 513.9681400000118 525.3002519998699 529.181599999778 532.8888349998742 535.9070240003057 547.5989589998499 548.7162279998884 549.4500730000436 552.5318599999882 552.8132330002263 553.4096269998699 555.1274830000475 558.7511400002986 559.5222579999827 566.7529299999587 567.2845049998723 568.2260740003549 569.0510249999352 570.530965000391 570.5854500001296 571.1966960001737 575.9813650003634 576.5428880001418 579.8758549997583 580.4154869997874 588.1615399997681 592.3990070000291 593.1314300000668 603.7243249998428 603.778239000123 605.9969080002047 612.0515140001662 615.6932779997587 626.0848799999803 628.538126999978 641.9375410000794 646.3827720000409 651.1206060000695

Current
Mean: 506.094 ms
Stdev: 119.639 ms (23.6%)
Runs: 283.0319409999065 286.7339679999277 292.9007569998503 295.7947999997996 315.03108700038865 321.4787200000137 323.3507489999756 331.5417479998432 333.30676300032064 340.24808800034225 347.1551109999418 348.7622070000507 354.66914900019765 366.03991700010374 381.6059570000507 389.80309999966994 408.19010500004515 408.25052900006995 410.5783279999159 476.2138269999996 482.0633539999835 483.4691570000723 512.8636879995465 517.771483999677 526.0317379999906 528.3385420003906 535.9354659998789 545.5205080001615 548.4234219999053 548.6457519996911 550.4363199998625 558.9396159998141 559.043701000046 563.707112999633 569.7333579999395 571.6283359997906 577.6674810000695 578.7685549999587 579.0524089997634 580.8232829999179 582.5826420001686 589.9484860002995 592.5012619998306 593.2729899999686 596.933960000053 600.9334720000625 602.4493410000578 610.6289880000986 617.3151859999634 618.6389970001765 619.8594969999976 621.3276370000094 630.1255700001493 634.3037930000573 643.4202479999512 643.68802900007 647.8309330004267 650.5207520001568 654.6831459999084 681.106364000123
Chat opening (CPU) Baseline
Mean: 154.808 %
Stdev: 4.286 % (2.8%)
Runs: 144.08299598426078 146.96374656012594 148.49870140288752 148.69379895535548 149.47361124402207 149.60039946412957 149.93126642089132 149.9734007050795 150.38042513535842 150.68273590759387 150.74789634805592 150.96829899991118 151.33577428837071 151.62203187656934 151.89471080579338 152.15330619735445 152.28013576314885 152.4881561772109 152.49215807051 152.66397510396985 152.7033087163097 152.72509960159368 152.93987392356308 152.978885172002 153.20803902861402 153.25217821019442 153.29124708686277 154.14351007360077 154.1923743819051 154.43630316945578 154.72977599595762 155.38734867043232 155.47050722229122 156.51776437933609 156.6212439756898 156.68440130198124 156.76969437387626 156.81705393000576 156.83829432674398 156.90809086146962 157.00406141584799 157.5715050284228 157.64969941308325 157.85358878541638 157.8607652992611 157.9474023167538 158.09163736917193 158.17455301693724 158.46032791946163 158.5700529198867 158.95047992259236 160.59242868843995 162.11962689521468 162.2470524670934 162.29015356315637 162.99887641865672 163.4419045952974 163.48698875197186

Current
Mean: 154.284 %
Stdev: 6.203 % (4.0%)
Runs: 143.54270703175925 143.60242239509355 143.77646377256855 144.3860443851443 145.0771035227893 145.26938634908166 145.41832669322696 145.48462214759255 145.90123328906878 146.3257610685657 147.48391119524237 148.43566234146982 149.01758741796033 149.09304805930873 149.68083405208105 149.88379883100052 150.28426714497382 151.04022312727514 151.20594763567172 151.2224395919284 151.72346939586953 152.19521912350604 152.8911180712035 153.13486887610918 153.28174603174602 153.3077979112984 153.75135931399544 153.8703875210995 154.01326500043072 154.37256857137882 154.48318722817478 154.5748862295438 154.93867533626567 155.20053120849923 155.30664503610396 155.3776237075665 155.44414899736287 155.5302594773774 155.68593226753865 155.82596748907608 156.28931546801365 157.73902459426944 158.25075216829228 158.7717420886427 158.86798026322074 158.87178831283592 158.8820666302138 159.39195505624158 159.76857383638844 160.00468425756972 161.62775195012293 161.6816841187167 162.1959351683177 162.82186845820559 164.07539185498126 164.27244636607213 164.64007178570304 164.72773576353273 164.8150868500731 168.27919900309905
Chat opening (FPS) Baseline
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60

Current
Mean: 57.901 FPS
Stdev: 1.536 FPS (2.7%)
Runs: 54.294654126270665 54.38885038519777 55.32201236763299 55.701089288735915 55.76480182603893 55.77462426446792 55.85887409491769 55.99299431588389 56.11002242748625 56.30334825067861 56.35353999090829 56.5034835814362 56.53809300055849 56.70592995116415 56.72553028817807 56.74035894430498 56.774603103086655 56.787841067363054 56.92761553208775 56.99923032441366 57.00948686912846 57.06627364149411 57.157188007301265 57.473949542398834 57.7251023131232 57.778306604528154 57.78066097750614 57.84348719289932 57.90019952744607 58.041603552113 58.34708683535548 58.38831423050733 58.42463381096966 58.85633585171403 58.92531833457281 58.95287493705373 58.955920047773134 58.999110327301906 58.999833689527236 59.022039120965474 59.022492155734156 59.06334991290938 59.12598994957439 59.14392997202592 59.20651586096211 59.252246521358025 59.327925914766396 59.409861520227565 59.47140674596625 59.57020931566951 59.64951498861412 59.90351214321031 59.90969238070332 60 60 60 60 60
Chat opening (RAM) Baseline
Mean: 373.971 MB
Stdev: 5.085 MB (1.4%)
Runs: 364.2200520833333 364.4622395833333 364.9348958333333 365.0104166666667 365.25 365.9713541666667 366.109375 367.12109375 367.3216145833333 367.765625 368.56640625 368.7799479166667 369.3294270833333 369.4010416666667 369.8880208333333 370.328125 370.8447265625 370.96484375 370.9973958333333 371.2799479166667 371.5065104166667 371.5595703125 371.6884765625 372.23828125 372.912109375 373.6432291666667 373.7255859375 373.8125 374.068359375 375.2431640625 375.4375 375.462890625 375.5576171875 375.572265625 375.888671875 376.0380859375 376.5517578125 376.8466796875 376.9765625 377.392578125 377.5380859375 377.6865234375 377.9296875 378.046875 378.0615234375 378.181640625 378.1884765625 378.259765625 378.6552734375 378.822265625 378.8447265625 379.2392578125 379.2587890625 379.89453125 380.5107421875 381.130859375 381.34765625 381.4931640625 381.513671875 382.998046875

Current
Mean: 378.667 MB
Stdev: 5.336 MB (1.4%)
Runs: 365.7877604166667 366.2890625 366.4205729166667 369.6650390625 369.8658854166667 370.1744791666667 371.3294270833333 371.8528645833333 371.9736328125 372.3564453125 372.48046875 373.1770833333333 374.2998046875 374.564453125 374.6884765625 375.181640625 375.80078125 376.13671875 376.416015625 376.51953125 376.744140625 376.859375 377.5009765625 377.681640625 377.9716796875 378.013671875 378.7513020833333 378.984375 379.8251953125 379.9892578125 380.265625 380.3662109375 380.4873046875 380.689453125 381.6865234375 381.822265625 382.0126953125 382.0732421875 382.181640625 382.3115234375 382.4921875 382.5263671875 382.9404296875 382.9638671875 383.1328125 383.201171875 383.4326171875 383.43359375 383.5751953125 383.5771484375 383.791015625 383.9951171875 384.5263671875 384.572265625 384.8515625 384.916015625 384.9560546875 385.279296875 385.2939453125 385.3359375
Chat opening (CPU/JS) Baseline
Mean: 78.861 %
Stdev: 2.067 % (2.6%)
Runs: 74.5 74.5 75.3 75.8 75.8 76.2 76.4 76.5 76.5 76.7 76.8 76.8 76.9 77.3 77.4 77.4 77.9 77.9 77.9 78.3 78.3 78.3 78.5 78.5 78.5 78.7 78.7 78.8 78.8 78.9 78.9 78.9 79 79 79.1 79.3 79.3 79.3 79.4 79.5 79.7 79.7 79.8 79.8 80 80.1 80.5 80.6 81.1 81.2 81.3 81.4 81.5 81.5 82 82.4 82.8 82.9 84

Current
Mean: 76.090 %
Stdev: 3.187 % (4.2%)
Runs: 69.9 70.6 70.8 71.7 71.8 71.9 71.9 72 72.1 72.2 72.3 72.6 72.7 72.8 72.9 72.9 73.7 74.3 74.6 74.9 74.9 75 75 75.1 75.3 75.4 75.6 75.7 75.8 75.9 76 76.3 76.3 76.3 76.6 76.6 76.8 76.9 77.2 77.8 77.9 78.3 78.6 78.9 79.3 79.4 79.4 79.4 79.5 79.6 79.7 79.9 79.9 80.2 80.4 80.6 80.6 81.3 81.3 82.1
Chat opening (CPU/UI) Baseline
Mean: 34.098 %
Stdev: 3.234 % (9.5%)
Runs: 26.6 27.5 27.9 28 28.6 28.7 28.8 29.8 29.8 30.4 30.6 31.3 31.5 31.5 31.6 31.9 32.1 32.2 32.2 32.4 32.7 33.2 33.6 33.6 34 34.4 34.4 34.5 34.9 34.9 35 35.1 35.4 35.4 35.4 35.5 35.5 35.5 36 36 36.1 36.3 36.3 36.4 36.4 36.8 36.9 36.9 37.1 37.2 37.3 37.4 37.6 37.9 38.1 38.3 38.3 38.3 38.4 39.5

Current
Mean: 32.763 %
Stdev: 2.327 % (7.1%)
Runs: 27.9 28 28.5 29 29 29.2 29.3 29.4 29.4 29.6 30.3 30.7 31.3 31.4 31.4 31.4 31.8 31.9 32.2 32.2 32.4 32.7 32.8 32.9 32.9 32.9 33 33 33.2 33.3 33.4 33.4 33.4 33.4 33.4 33.5 33.6 33.7 33.8 33.9 34 34.1 34.2 34.4 34.9 34.9 34.9 34.9 35.4 35.7 35.8 35.9 36.4 36.9 36.9 36.9
Linking (CPU) Baseline
Mean: 127.683 %
Stdev: 4.404 % (3.4%)
Runs: 121.4012323269293 121.52418417717519 121.52864782427633 121.91345689661549 122.00968084483897 122.49772360123936 122.96476128180674 123.26618019890127 123.28671455450687 123.84496909506763 123.86778189821652 124.15320972669973 124.51428382169567 124.80546394908792 124.85418581465865 124.89924218114187 124.90599698586605 124.92452066250708 124.92750996003188 125.15080218586237 125.25768558848164 125.36131456997103 125.76785185133801 125.76977282409344 125.77594935526025 125.80406994868116 125.87969884676282 125.91752814627138 126.15578664632389 126.18291636557399 126.18853238449351 126.2040598064391 126.31078455076549 126.60057536656771 126.61592015711209 126.87822392631237 127.00379090585923 127.42291656743419 127.63498907287708 128.82554165698477 128.8854214630528 129.2992181416379 129.53410138827294 130.37328705414228 131.05232622835038 131.70593737772506 132.081070874885 132.08553838579073 132.20039692035544 132.24879595418696 132.28616296635363 132.7178251150153 133.52450009228554 134.31479862011923 134.82266630228932 135.0351902353299 135.95090964518056 137.61600166234194 137.6472664964957 138.80084146604494

Current
Mean: 126.425 %
Stdev: 3.952 % (3.1%)
Runs: 119.6304999668439 119.86930836777273 121.42344866691188 121.9549059138856 122.16079636394603 122.21602059573716 122.65378952865049 122.81287088295551 122.8861322524069 122.89201957642406 123.16113824056784 123.23525988728319 123.33416940495427 123.49697404419469 123.83858222488281 123.95032566337395 123.99500539610763 124.08578131862389 124.08870061332904 124.14174140635407 124.62043613432546 124.72543142545837 124.74431523990425 124.96574396177249 124.99446266885204 125.13872563664471 125.15955492719422 125.20480409815497 125.56074350239426 125.5736746658289 125.66834778635967 126.1432745829573 126.26288989695139 126.38544460939914 126.46887237546835 126.49108692387739 126.6154312647699 126.88585446880948 127.0501835951174 127.12335038020555 127.40793295328119 127.68363169782543 127.95588743391657 128.31753125460875 129.1688733989166 129.24468115468142 129.62227493856662 130.04700175049945 130.58080105233955 132.58017038742403 133.13252642101807 133.73600622398413 134.386875070605 134.46232786547975 134.62619692053806 135.73057760102586 135.9311608336941
Linking (FPS) Baseline
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60

Current
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60
Linking (RAM) Baseline
Mean: 440.429 MB
Stdev: 2.275 MB (0.5%)
Runs: 436.28622159090907 436.8140625 436.8480113636364 436.89311079545456 436.99325284090907 437.059375 437.08735795454544 437.2887073863636 437.69140625 437.7921875 437.899609375 438.40376420454544 438.6580255681818 438.71164772727275 438.95241477272725 439.053125 439.07421875 439.609375 439.6129261363636 439.640625 439.6814630681818 439.74893465909093 439.75923295454544 439.7791193181818 439.9396306818182 439.94637784090907 439.94815340909093 440.08735795454544 440.1015625 440.20241477272725 440.22727272727275 440.4002130681818 440.4300426136364 440.50319602272725 440.79765625 441.17720170454544 441.39524147727275 441.60227272727275 441.6384943181818 441.894921875 441.93359375 442.02982954545456 442.05859375 442.1818181818182 442.29375 442.35475852272725 442.38210227272725 442.5330255681818 442.5763494318182 442.6484375 442.78828125 443.06178977272725 443.358984375 443.40767045454544 443.48757102272725 444.586328125 444.6136363636364 446.947265625

Current
Mean: 440.763 MB
Stdev: 2.576 MB (0.6%)
Runs: 434.55752840909093 435.865234375 435.98899147727275 437.2574573863636 437.745703125 437.86434659090907 437.948046875 437.98899147727275 438.04609375 438.20703125 438.3484375 438.6154119318182 438.61860795454544 438.9197443181818 438.92578125 438.9765625 439.08345170454544 439.41796875 439.71022727272725 439.90731534090907 439.93821022727275 439.9453125 439.97975852272725 440.0015625 440.0035511363636 440.09375 440.19673295454544 440.3458806818182 440.3863636363636 440.46484375 440.492578125 440.5255681818182 440.59765625 440.6171875 440.69296875 440.7872869318182 440.96875 441.15518465909093 441.38210227272725 441.39914772727275 441.59907670454544 441.72194602272725 441.81321022727275 442.0933948863636 442.67684659090907 442.73984375 442.791796875 443.0308948863636 443.03196022727275 443.3359375 443.43892045454544 443.5550426136364 443.9200994318182 444.32137784090907 444.5504261363636 444.626171875 445.5703125 446.0171875 446.234375 446.7581676136364
Linking (CPU/JS) Baseline
Mean: 57.917 %
Stdev: 1.717 % (3.0%)
Runs: 54.9 55.4 55.7 55.8 55.9 56 56.1 56.1 56.2 56.3 56.4 56.4 56.6 56.6 56.6 56.6 56.8 56.8 56.9 57 57.4 57.4 57.4 57.5 57.5 57.6 57.6 57.6 57.6 57.7 57.7 57.8 57.8 57.9 57.9 58.1 58.1 58.1 58.2 58.3 58.3 58.3 58.6 58.7 58.9 59 59.1 59.2 59.3 59.6 59.7 60.1 60.7 60.9 61 62.5 62.5 62.5

Current
Mean: 57.818 %
Stdev: 1.550 % (2.7%)
Runs: 54.9 55 55.8 55.9 55.9 56.2 56.4 56.4 56.4 56.5 56.5 56.5 56.5 56.6 56.6 56.6 56.6 56.7 56.8 57 57.1 57.1 57.3 57.5 57.5 57.5 57.5 57.6 57.7 57.7 57.7 57.8 57.8 57.8 57.9 57.9 57.9 58 58.2 58.3 58.5 58.6 58.6 58.8 59.1 59.1 59.1 59.3 59.7 59.8 59.9 60 60.1 60.8 61.1 61.5 62
Linking (CPU/UI) Baseline
Mean: 33.616 %
Stdev: 1.235 % (3.7%)
Runs: 31.2 31.5 31.8 31.9 32 32 32.1 32.1 32.2 32.2 32.2 32.3 32.4 32.5 32.6 32.6 32.7 32.8 32.8 32.9 33 33.2 33.3 33.5 33.5 33.5 33.5 33.6 33.6 33.7 33.8 33.9 33.9 34 34 34.1 34.1 34.1 34.2 34.3 34.3 34.4 34.4 34.4 34.5 34.6 34.6 34.6 34.7 34.7 34.9 34.9 35.3 35.4 35.4 35.6 36.3 37.1

Current
Mean: 33.447 %
Stdev: 1.341 % (4.0%)
Runs: 30.9 31 31.2 31.6 31.8 31.9 31.9 31.9 32.1 32.2 32.3 32.4 32.4 32.4 32.5 32.7 32.7 32.8 32.8 32.8 32.8 32.8 32.8 32.8 32.8 33 33 33 33 33.1 33.3 33.3 33.4 33.4 33.4 33.5 33.5 33.6 33.6 33.8 33.9 34.1 34.1 34.1 34.3 34.4 34.5 34.8 34.9 34.9 35 35 35.1 35.4 35.4 35.7 36 36 36.1 36.9

Copy link
Contributor

@Expensify/mobile-deployers 📣 Please look into this performance regression as it's a deploy blocker.

@blimpich
Copy link
Contributor

blimpich commented Dec 23, 2024

Hmm, I don't think this should be considered a deploy blocker since this should only be affecting internal debugging tools. We intentionally used a less performant method of rendering a list so that we could fix a bug. But maybe it has wider impacts.

Asking internally: https://expensify.slack.com/archives/C03TQ48KC/p1734983936104459

And also asking in open source channel: https://expensify.slack.com/archives/C01GTK53T8Q/p1734984097996759

@blimpich
Copy link
Contributor

I need to be afk for the rest of the day, but I will check in on this tomorrow morning my time (PST). If we still think it might be a legit issue then we should probably just revert. For now I'll give time for other people to come online and take a look at this.

Copy link
Contributor

🚀 Deployed to staging by https://github.com/blimpich in version: 9.0.78-0 🚀

platform result
🤖 android 🤖 cancelled 🔪
🖥 desktop 🖥 cancelled 🔪
🍎 iOS 🍎 cancelled 🔪
🕸 web 🕸 success ✅
🤖🔄 android HybridApp 🤖🔄 cancelled 🔪
🍎🔄 iOS HybridApp 🍎🔄 cancelled 🔪

Copy link
Contributor

🚀 Deployed to staging by https://github.com/blimpich in version: 9.0.78-0 🚀

platform result
🤖 android 🤖 success ✅
🖥 desktop 🖥 success ✅
🍎 iOS 🍎 success ✅
🕸 web 🕸 success ✅
🤖🔄 android HybridApp 🤖🔄 failure ❌
🍎🔄 iOS HybridApp 🍎🔄 success ✅

2 similar comments
Copy link
Contributor

🚀 Deployed to staging by https://github.com/blimpich in version: 9.0.78-0 🚀

platform result
🤖 android 🤖 success ✅
🖥 desktop 🖥 success ✅
🍎 iOS 🍎 success ✅
🕸 web 🕸 success ✅
🤖🔄 android HybridApp 🤖🔄 failure ❌
🍎🔄 iOS HybridApp 🍎🔄 success ✅

Copy link
Contributor

🚀 Deployed to staging by https://github.com/blimpich in version: 9.0.78-0 🚀

platform result
🤖 android 🤖 success ✅
🖥 desktop 🖥 success ✅
🍎 iOS 🍎 success ✅
🕸 web 🕸 success ✅
🤖🔄 android HybridApp 🤖🔄 failure ❌
🍎🔄 iOS HybridApp 🍎🔄 success ✅

Copy link
Contributor

🚀 Deployed to staging by https://github.com/blimpich in version: 9.0.78-0 🚀

platform result
🤖 android 🤖 success ✅
🖥 desktop 🖥 success ✅
🍎 iOS 🍎 success ✅
🕸 web 🕸 success ✅
🤖🔄 android HybridApp 🤖🔄 success ✅
🍎🔄 iOS HybridApp 🍎🔄 success ✅

@blimpich blimpich removed the DeployBlockerCash This issue or pull request should block deployment label Dec 24, 2024
@blimpich
Copy link
Contributor

Removing the deploy blocker label because after running the performance tests again the linking actually took less time than the previous run.

1st performance regression run:

566.861 ms → 669.112 ms (+102.251 ms, +18.0%)

2nd performance regression run:

540.412 ms → 539.824 ms (-0.588 ms, ±0.0%)

Conversation ongoing here, but I think its safe to not block the deploy on this.

Copy link
Contributor

🚀 Deployed to staging by https://github.com/blimpich in version: 9.0.78-0 🚀

platform result
🤖 android 🤖 success ✅
🖥 desktop 🖥 success ✅
🍎 iOS 🍎 success ✅
🕸 web 🕸 success ✅
🤖🔄 android HybridApp 🤖🔄 success ✅
🍎🔄 iOS HybridApp 🍎🔄 success ✅

Copy link
Contributor

🚀 Deployed to staging by https://github.com/blimpich in version: 9.0.78-0 🚀

platform result
🤖 android 🤖 failure ❌
🖥 desktop 🖥 success ✅
🍎 iOS 🍎 success ✅
🕸 web 🕸 success ✅
🤖🔄 android HybridApp 🤖🔄 success ✅
🍎🔄 iOS HybridApp 🍎🔄 success ✅

Copy link
Contributor

🚀 Deployed to production by https://github.com/jasperhuangg in version: 9.0.78-6 🚀

platform result
🤖 android 🤖 true ❌
🖥 desktop 🖥 success ✅
🍎 iOS 🍎 success ✅
🕸 web 🕸 success ✅
🤖🔄 android HybridApp 🤖🔄 failure ❌
🍎🔄 iOS HybridApp 🍎🔄 success ✅

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

7 participants