Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add News "total cards viewed" P3A question #22222

Closed
DJAndries opened this issue Apr 11, 2022 · 8 comments · Fixed by brave/brave-core#12972 or brave/brave-core#13360
Closed

Add News "total cards viewed" P3A question #22222

DJAndries opened this issue Apr 11, 2022 · 8 comments · Fixed by brave/brave-core#12972 or brave/brave-core#13360

Comments

@DJAndries
Copy link
Collaborator

DJAndries commented Apr 11, 2022

Description

Add new News P3A question, for total cards viewed:

How many Brave News cards did you view in the past week?
Brave.Today.WeeklyTotalCardViews

  1. None
  2. 1
  3. 2 to 10
  4. 11 to 20
  5. 21 to 40
  6. 41 to 80
  7. 81 to 100
  8. 101 or more

Miscellaneous Information:

Will raise PR soon.

@DJAndries DJAndries self-assigned this Apr 11, 2022
@DJAndries
Copy link
Collaborator Author

cc @mattmcalister

@GeetaSarvadnya
Copy link

GeetaSarvadnya commented May 6, 2022

Verification PASSED on


Brave | 1.38.103 Chromium: 100.0.4896.127 (Official Build) beta (64-bit)
-- | --
Revision | ff0d0695743e65305d7194f9bd309e5e1c824aa0-refs/branch-heads/4896_88@{#4}
OS | Windows 10 Version 21H2 (Build 19044.1645)

and

Brave | 1.39.109 Chromium: 102.0.5005.50 (Official Build) (64-bit)
-- | --
Revision | f6e2cf8f59ec714bdcff8499991d55898875f287-refs/branch-heads/5005@{#648}
OS | Windows 10 Version 21H2 (Build 19044.1706)

Clean profile

Case 1: Brave.Today.WeeklyTotalCardViews =0_PASSED
  • Confirmed that the metrics Brave.Today.WeeklyTotalCardViews response value is 0 when brave today is not enabled or no cards are viewed
    image
Case 2: Brave.Today.WeeklyTotalCardViews =1_PASSED
  • Confirmed that the metrics Brave.Today.WeeklyTotalCardViews response value is 1 when brave today is enabled and one card is viewed
    image
Case 3: Brave.Today.WeeklyTotalCardViews =(2 to 10)_PASSED

Case 1: View 2 cards

  • Clean profile 1.39.x
  • Enable Brave news and view two cards
  • Open brave://local-state
  • Confirmed that the metrics Brave.Today.WeeklyTotalCardViews response value is 2 when brave today is enabled and two cards are viewed

image

Case 2:

  • Clean profile 1.39.x
  • Enable Brave news and view three cards
  • Open brave://local-state
  • Confirmed that the metrics Brave.Today.WeeklyTotalCardViews response value is 2 when brave today is enabled and three cards are viewed
    image

Case 3:

  • Clean profile 1.39.x
  • Enable Brave news and view two cards
  • Close the browser
  • Set the system date ahead by 7days
  • Open brave://local-state file
  • Confirmed that the metrics Brave.Today.WeeklyTotalCardViews response value is 2 as expected (as still week has not elapsed hence the value is 2)
  • Close the browser
  • Set the system date ahead by 7+1 days
  • Open brave://local-state file
  • Confirmed that the metrics Brave.Today.WeeklyTotalCardViews response value is 0 as expected (as the week has elapsed hence the value is 0)
    image

Case 4: View 10 cards

  • Clean profile 1.39.x
  • Enable Brave news and view 10 cards
  • Open brave://local-state file
  • Confirmed that the metrics Brave.Today.WeeklyTotalCardViews response value is 2 as expected

image

Case 4: Brave.Today.WeeklyTotalCardViews =(11 to 20)_PASSED

Case 1: View 11 cards

  • Clean profile 1.39.x
  • Enable Brave news and view 11 cards
  • Open brave://local-state
  • Confirmed that the metrics Brave.Today.WeeklyTotalCardViews response value is 3 when brave today is enabled and 11 cards are viewed
    image

Case 2:

  • Clean profile 1.39.x
  • Enable Brave news and view 12 cards
  • Open brave://local-state
  • Confirmed that the metrics Brave.Today.WeeklyTotalCardViews response value is 3 when brave today is enabled and 12 cards are viewed

image

Case 3:

  • Clean profile 1.39.x
  • Enable Brave news and view 13 cards
  • Close the browser
  • Set the system date ahead by 7days
  • Open brave://local-state file
  • Confirmed that the metrics Brave.Today.WeeklyTotalCardViews response value is 3 as expected (as still week has not elapsed hence the value is 3)
  • Close the browser
  • Set the system date ahead by 7+1 days
  • Open brave://local-state file
  • Confirmed that the metrics Brave.Today.WeeklyTotalCardViews response value is 0 as expected (as the week has elapsed hence the value is 0)

image

Case 4: View 20 cards

  • Clean profile 1.39.x
  • Enable Brave news and view 10 cards
  • Open brave://local-state file
  • Confirmed that the metrics Brave.Today.WeeklyTotalCardViews response value is 3 as expected

image

Case 5: Brave.Today.WeeklyTotalCardViews =(21 to 40)_PASSED

Case 1:

  • Clean profile 1.39.x
  • Enable Brave news and view 21 cards
  • Confirmed that the metrics Brave.Today.WeeklyTotalCardViews response value is 4 as expected
    image
  • Close the browser
  • Set the system date ahead by 7days
  • Open brave://local-state file
  • Confirmed that the metrics Brave.Today.WeeklyTotalCardViews response value is 4 as expected (as still week has not elapsed hence the value is 4)
  • Close the browser
  • Set the system date ahead by 7+1 days
  • Open brave://local-state file
  • Confirmed that the metrics Brave.Today.WeeklyTotalCardViews response value is 0 as expected (as the week has elapsed hence the value is 0)

image

Case 2: View 40 cards

  • Clean profile 1.39.x
  • Enable Brave news and view 40 cards
  • Open brave://local-state file
  • Confirmed that the metrics Brave.Today.WeeklyTotalCardViews response value is 4 as expected
    image
Case 6: Brave.Today.WeeklyTotalCardViews =(41 to 80)_PASSED

Case 1:

  • Clean profile 1.39.x
  • Enable Brave news and view 41 cards
  • Confirmed that the metrics Brave.Today.WeeklyTotalCardViews response value is 5 as expected
    image
  • Close the browser
  • Set the system date ahead by 7days
  • Open brave://local-state file
  • Confirmed that the metrics Brave.Today.WeeklyTotalCardViews response value is 5 as expected (as still week has not elapsed hence the value is 5)
  • Close the browser
  • Set the system date ahead by 7+1 days
  • Open brave://local-state file
  • Confirmed that the metrics Brave.Today.WeeklyTotalCardViews response value is 0 as expected (as the week has elapsed hence the value is 0)
    image

Case 2: View 80 cards

  • Clean profile 1.39.x
  • Enable Brave news and view 80 cards
  • Open brave://local-state file
  • Confirmed that the metrics Brave.Today.WeeklyTotalCardViews response value is 5 as expected
    image
Case 7: Brave.Today.WeeklyMaxCardViewsCount =(81 to 100)_PASSED

Case 1:

  • Clean profile 1.39.x
  • Enable Brave news and view 81 cards
  • Close the browser
  • Set the system date ahead by 7days
  • Open brave://local-state file
  • Confirmed that the metrics Brave.Today.WeeklyTotalCardViews response value is 6 as expected (as still week has not elapsed hence the value is 6)
  • Close the browser
  • Set the system date ahead by 7+1 days
  • Open brave://local-state file
  • Confirmed that the metrics Brave.Today.WeeklyTotalCardViews response value is 0 as expected (as the week has elapsed hence the value is 0)

Case 2: View 100 cards

  • Clean profile 1.39.x
  • Enable Brave news and view 100 cards
  • Open brave://local-state file
  • Confirmed that the metrics Brave.Today.WeeklyTotalCardViews response value is 6 as expected
    image
Case 8: Brave.Today.WeeklyMaxCardViewsCount =(100 or more)_PASSED

Case 1:

  • Clean profile 1.39.x
  • Enable Brave news and view 100 cards
  • Confirmed that the metrics Brave.Today.WeeklyTotalCardViews response value is 7 as expected
    image
  • Close the browser
  • Set the system date ahead by 7days
  • Open brave://local-state file
  • Confirmed that the metrics Brave.Today.WeeklyTotalCardViews response value is 7 as expected (as still week has not elapsed hence the value is 6)
  • Close the browser
  • Set the system date ahead by 7+1 days
  • Open brave://local-state file
  • Confirmed that the metrics Brave.Today.WeeklyTotalCardViews response value is 0 as expected (as the week has elapsed hence the value is 0)
    image

Upgrade profile

Case 1: Brave.Today.WeeklyTotalCardViews =0_PASSED
  • Instaall 1.38.x
  • Open brave://local-state file
  • Confirmed Brave.Today.WeeklyTotalCardViews metrics is NOT shown
  • Upgrade the profile to 1.39.x
  • Reload brave://local-state and confirmed Brave.Today.WeeklyTotalCardViews metrics response value is 0 when Brave news is NOT enabled
  • Enable brave news but don't view any cards
  • Reload brave://local-state and confirmed Brave.Today.WeeklyTotalCardViews metrics response value is 0 when no cards are viewed
Case 2: Brave.Today.WeeklyTotalCardViews =1_PASSED
Case 3: Brave.Today.WeeklyTotalCardViews =(2 to 10)_PASSED
  • Install 1.38.x and enable brave news
  • View 8 cards
  • Upgrade the profile to 1.39.x
  • Wait until Brave news loads in opened NTP
  • Reload brave://local-state and confirmed that Brave.Today.WeeklyTotalCardViews metrics value is 2 as expected
Case 4: Brave.Today.WeeklyTotalCardViews =(11 to 20)_PASSED
Case 5: Brave.Today.WeeklyTotalCardViews =(21 to 40)_PASSED

@GeetaSarvadnya
Copy link

GeetaSarvadnya commented May 6, 2022

@DJAndries There is no metrics called Brave.Today.WeeklyTotalCardViews looks like it's mapping with the metrics Brave.Today.WeeklyMaxCardViewsCount which is showing up in brave://local-state. Could you update the issue along with the P3A wiki if it's correct? Thanks!

@GeetaSarvadnya
Copy link

GeetaSarvadnya commented May 6, 2022

@DJAndries Logged the issues above. Could you take look at them and update the response values if required so that I can proceed further with issue verification. Thanks!

@LaurenWags
Copy link
Member

Adding QA/Blocked until the above is resolved

@DJAndries
Copy link
Collaborator Author

@DJAndries There is no metrics called Brave.Today.WeeklyTotalCardViews looks like it's mapping with the metrics Brave.Today.WeeklyMaxCardViewsCount which is showing up in brave://local-state. Could you update the issue along with the P3A wiki if it's correct? Thanks!

WeeklyTotalCardViews is the correct metric name, however, I made a mistake by not using that metric name in the code. brave/brave-core#13360 will resolve this once merged. I will also request an uplift to 1.39.x.

@kjozwiak
Copy link
Member

@GeetaSarvadnya brave/brave-core#13373 has been merged into 1.39.x so it should unblock #22222 (comment) once you get 1.39.109 or higher 👍

@GeetaSarvadnya
Copy link

GeetaSarvadnya commented May 20, 2022

Verification PASSED on Samsung Galaxy A52s version 11 running Bravearmx64.apk_1.39.109

Logged #22997

Clean profile

Case 1: Brave.Today.WeeklyTotalCardViews =0_PASSED
  • Confirmed that the metrics Brave.Today.WeeklyTotalCardViews response value is 0 when brave today is not enabled or no cards are viewed

Screenshot_20220520-213249_Brave

Case 2: Brave.Today.WeeklyTotalCardViews =1_PASSED
  • Confirmed that the metrics Brave.Today.WeeklyTotalCardViews response value is 1 when brave today is enabled and one card is viewed
    Screenshot_20220520-213548_Brave
Case 3: Brave.Today.WeeklyTotalCardViews =(2 to 10)_FAILED

Case 1: View 2 cards

  • Clean profile 1.39.x
  • Enable Brave news and view two cards
  • Open brave://local-state
  • Confirmed that the metrics Brave.Today.WeeklyTotalCardViews response value is 2 when brave today is enabled and two cards are viewed

Case 2:

  • Clean profile 1.39.x
  • Enable Brave news and view three cards
  • Open brave://local-state
  • Confirmed that the metrics Brave.Today.WeeklyTotalCardViews response value is 2 when brave today is enabled and three cards are viewed

Case 3:

  • Clean profile 1.39.x
  • Enable Brave news and view two cards
  • Close the browser
  • Set the system date ahead by 7days
  • Open brave://local-state file
  • Confirmed that the metrics Brave.Today.WeeklyTotalCardViews response value is 2 as expected (as still week has not elapsed hence the value is 2)
  • Close the browser
  • Set the system date ahead by 7+1 days
  • Open brave://local-state file
  • Confirmed that the metrics Brave.Today.WeeklyTotalCardViews response value is 0 as expected (as the week has elapsed hence the value is 0)

Case 4: View 10 cards

  • Clean profile 1.39.x
  • Enable Brave news and view 10 cards
  • Open brave://local-state file
  • Confirmed that the metrics Brave.Today.WeeklyTotalCardViews response value is 2 as expected
Case 4: Brave.Today.WeeklyTotalCardViews =(11 to 20)_FAILED

Case 1: View 11 cards

  • Clean profile 1.39.x
  • Enable Brave news and view 11 cards
  • Open brave://local-state
  • Confirmed that the metrics Brave.Today.WeeklyTotalCardViews response value is 3 when brave today is enabled and 11 cards are viewed

Case 2:

  • Clean profile 1.39.x
  • Enable Brave news and view 12 cards
  • Open brave://local-state
  • Confirmed that the metrics Brave.Today.WeeklyTotalCardViews response value is 3 when brave today is enabled and 12 cards are viewed

Case 3:

  • Clean profile 1.39.x
  • Enable Brave news and view 13 cards
  • Close the browser
  • Set the system date ahead by 7days
  • Open brave://local-state file
  • Confirmed that the metrics Brave.Today.WeeklyTotalCardViews response value is 3 as expected (as still week has not elapsed hence the value is 3)
  • Close the browser
  • Set the system date ahead by 7+1 days
  • Open brave://local-state file
  • Confirmed that the metrics Brave.Today.WeeklyTotalCardViews response value is 0 as expected (as the week has elapsed hence the value is 0)

Case 4: View 20 cards

  • Clean profile 1.39.x
  • Enable Brave news and view 10 cards
  • Open brave://local-state file
  • Confirmed that the metrics Brave.Today.WeeklyTotalCardViews response value is 3 as expected
Case 5: Brave.Today.WeeklyTotalCardViews =(21 to 40)_FAILED

Case 1:

  • Clean profile 1.39.x
  • Enable Brave news and view 21 cards
  • Confirmed that the metrics Brave.Today.WeeklyTotalCardViews response value is 4 as expected
    image
  • Close the browser
  • Set the system date ahead by 7days
  • Open brave://local-state file
  • Confirmed that the metrics Brave.Today.WeeklyTotalCardViews response value is 4 as expected (as still week has not elapsed hence the value is 4)
  • Close the browser
  • Set the system date ahead by 7+1 days
  • Open brave://local-state file
  • Confirmed that the metrics Brave.Today.WeeklyTotalCardViews response value is 0 as expected (as the week has elapsed hence the value is 0)

image

Case 2: View 40 cards

  • Clean profile 1.39.x
  • Enable Brave news and view 40 cards
  • Open brave://local-state file
  • Confirmed that the metrics Brave.Today.WeeklyTotalCardViews response value is 4 as expected
    image
Case 6: Brave.Today.WeeklyTotalCardViews =(41 to 80)_FAILED

Case 1:

  • Clean profile 1.39.x
  • Enable Brave news and view 41 cards
  • Confirmed that the metrics Brave.Today.WeeklyTotalCardViews response value is 5 as expected
    image
  • Close the browser
  • Set the system date ahead by 7days
  • Open brave://local-state file
  • Confirmed that the metrics Brave.Today.WeeklyTotalCardViews response value is 5 as expected (as still week has not elapsed hence the value is 5)
  • Close the browser
  • Set the system date ahead by 7+1 days
  • Open brave://local-state file
  • Confirmed that the metrics Brave.Today.WeeklyTotalCardViews response value is 0 as expected (as the week has elapsed hence the value is 0)
    image

Case 2: View 80 cards

  • Clean profile 1.39.x
  • Enable Brave news and view 80 cards
  • Open brave://local-state file
  • Confirmed that the metrics Brave.Today.WeeklyTotalCardViews response value is 5 as expected
    image
Case 7: Brave.Today.WeeklyMaxCardViewsCount =(81 to 100)_FAILED

Case 1:

  • Clean profile 1.39.x
  • Enable Brave news and view 81 cards
  • Close the browser
  • Set the system date ahead by 7days
  • Open brave://local-state file
  • Confirmed that the metrics Brave.Today.WeeklyTotalCardViews response value is 6 as expected (as still week has not elapsed hence the value is 6)
  • Close the browser
  • Set the system date ahead by 7+1 days
  • Open brave://local-state file
  • Confirmed that the metrics Brave.Today.WeeklyTotalCardViews response value is 0 as expected (as the week has elapsed hence the value is 0)

Case 2: View 100 cards

  • Clean profile 1.39.x
  • Enable Brave news and view 100 cards
  • Open brave://local-state file
  • Confirmed that the metrics Brave.Today.WeeklyTotalCardViews response value is 6 as expected
    image
Case 8: Brave.Today.WeeklyMaxCardViewsCount =(100 or more)_FAILED

Case 1:

  • Clean profile 1.39.x
  • Enable Brave news and view 100 cards
  • Confirmed that the metrics Brave.Today.WeeklyTotalCardViews response value is 7 as expected
    image
  • Close the browser
  • Set the system date ahead by 7days
  • Open brave://local-state file
  • Confirmed that the metrics Brave.Today.WeeklyTotalCardViews response value is 7 as expected (as still week has not elapsed hence the value is 6)
  • Close the browser
  • Set the system date ahead by 7+1 days
  • Open brave://local-state file
  • Confirmed that the metrics Brave.Today.WeeklyTotalCardViews response value is 0 as expected (as the week has elapsed hence the value is 0)
    image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment