brave / brave-variations

Resources to compile, publish and inspect the variations seed file
Mozilla Public License 2.0
17 stars 17 forks source link

Enable P3A Nebula for nightly/beta #1100

Closed DJAndries closed 1 week ago

kjozwiak commented 3 days ago

Quick note: The above feature was verified by @GeetaSarvadnya on Nightly via https://github.com/brave/brave-core/pull/22522#issuecomment-2185602726 before being uplifted into 1.68.x (BETA). It was also verified via 1.68.x as per https://github.com/brave/brave-browser/issues/35841#issuecomment-2202338542 & https://github.com/brave/brave-browser/issues/35841#issuecomment-2205141723. So with the following cases, we'll just ensure that users on Nightly & BETA are being added into the BraveP3ANebulaNightlyBeta study.

Win x64 verification

Nightly - BraveP3ANebulaNightlyBeta:Enabled - PASSED

Verification PASSED on Win 11 x64 using the following build(s):

Brave | 1.69.73 Chromium: 127.0.6533.26 (Official Build) nightly (64-bit)
-- | --
Revision | ebfe046ab1178f2195d83704420ed1ffa0370804
OS | Windows 11 Version 23H2 (Build 22631.3810)

image

Release - BraveP3ANebulaNightlyBeta not being applied - PASSED

Verification PASSED on Win 11 x64 using the following build(s):

Brave | 1.67.123 Chromium: 126.0.6478.126 (Official Build) (64-bit)
-- | --
Revision | fc7619ef621fe4e6a0fa8b16c718f78ffc97a861
OS | Windows 11 Version 23H2 (Build 22631.3810)

image

Android verification

Quick note: Ensured that Android is pointing to https://variations.bravesoftware.com/seed before launching Brave.

Nightly - BraveP3ANebulaNightlyBeta:Enabled - PASSED

Verification PASSED on Pixel 6 Pro running Android 15 using the following build(s):

Brave | 1.69.76 Chromium: 127.0.6533.26 (Official Build) canary (64-bit)
--- | ---
Revision | 4107ae75ca3c5250fe11689a40d3cc3e35c22cac
OS | Android 15; Build/AP31.240517.022; 35; REL

Screenshot_20240703-130615

BETA - BraveP3ANebulaNightlyBeta:Enabled - PASSED

Verification PASSED on Pixel 6 Pro running Android 15 using the following build(s):

Brave | 1.68.107 Chromium: 127.0.6533.26 (Official Build) beta (64-bit)
--- | ---
Revision | 131a9beda9f0aea74f948286e5e8c63153d9f7f8
OS | Android 15; Build/AP31.240517.022; 35; REL

Screenshot_20240703-130851

Release - BraveP3ANebulaNightlyBeta not being applied - PASSED

Verification PASSED on Pixel 6 Pro running Android 15 using the following build(s):

Brave | 1.67.123 Chromium: 126.0.6478.126 (Official Build) (64-bit)
--- | ---
Revision | fc7619ef621fe4e6a0fa8b16c718f78ffc97a861
OS | Android 15; Build/AP31.240517.022; 35; REL

Screenshot_20240703-133111

iOS verification

Nightly - BraveP3ANebulaNightlyBeta:Enabled - PASSED

Verification PASSED on iPhone 11 running iOS 17.5.1 using the following build(s):

Brave | 1.69.76 Chromium: 127.0.6533.26 (Official Build) nightly (64-bit)
--- | ---
Revision | 4107ae75ca3c...
OS | iOS

IMG_0334

BETA - BraveP3ANebulaNightlyBeta:Enabled - PASSED

Verification PASSED on iPhone 11 running iOS 17.5.1 using the following build(s):

Brave | 1.68.106 Chromium: 126.0.6478.126 (Official Build) beta (64-bit)
--- | --- 
Revision | 8d682ca0cb83...
OS | iOS

IMG_0335

Release - BraveP3ANebulaNightlyBeta not being applied - PASSED

Verification PASSED on iPhone 11 running iOS 17.5.1 using the following build(s):

Brave | 1.67.127 Chromium: 126.0.6478.126 (Official Build) stable (64-bit) 
--- | ---
Revision | c681f72abc72...
OS | iOS

IMG_0336