GeetaSarvadnya
commented
1 year ago Verification PASSED on
Brave | 1.44.73 Chromium: 105.0.5195.68 (Official Build) beta (64-bit)
-- | --
Revision | ad13e82529051bac6a0e65f455e6d7a1e5fd7938-refs/branch-heads/5195@{#903}
OS | Windows 10 Version 21H2 (Build 19044.1889)
India Region
Brave.Search.Promo.NewTabPage
Case 1: Brave.Search.Promo.NewTabPage = 0_PASSED
**0 No, No** - "Did the participant in Group C click on the promo - No" and "did they switch their default engine to Brave Search? - No" 1. Clean profile 1.44.x 2. Launch the browser using the cmd line flag `brave.exe --enable-features="BraveSearchNTP"` 3. Open brave://local-state file and ensure the metrics `Brave.Search.Promo.NewTabPage` is not shown 4. Open a NTP and ensured NTP search promo appears 5. Open brave://local-state file and ensured that the metrics `Brave.Search.Promo.NewTabPage` response value is `0` as expected Case 2: Brave.Search.Promo.NewTabPage = 1_PASSED
**1 Yes, No** - "Did the participant in Group C click on the promo - Yes" and "did they switch their default engine to Brave Search? - No" 1. Clean profile 1.44.x 2. Launch the browser using the cmd line flag `brave.exe --enable-features="BraveSearchNTP"` 3. Open brave://local-state file and ensure the metrics `Brave.Search.Promo.NewTabPage` is not shown 4. Open a NTP and ensured NTP search promo appears 5. Make search query via NTP promo 6. Open brave://local-state file and ensured that the metrics `Brave.Search.Promo.NewTabPage` response value is `1` as expected Case 3: Brave.Search.Promo.NewTabPage = 2_PASSED
**2 No, Yes** - "Did the participant in Group C click on the promo - No" and "did they switch their default engine to Brave Search? - Yes" 1. Clean profile 1.44.x 2. Launch the browser using the cmd line flag `brave.exe --enable-features="BraveSearchNTP"` 3. Open brave://local-state file and ensure the metrics `Brave.Search.Promo.NewTabPage` is not shown 4. Open a NTP and ensured NTP search promo appears 5. Change the default search engine to Brave via brave://settings/search 6. Open brave://local-state file and ensured that the metrics `Brave.Search.Promo.NewTabPage` response value is `2` as expected Example | Example -- | --  | Case 4: Brave.Search.Promo.NewTabPage = 3_PASSED
**3 Yes, Yes** -"Did the participant in Group C click on the promo - Yes" and "did they switch their default engine to Brave Search? - Yes" 1. Clean profile 1.44.x 2. Launch the browser using the cmd line flag `brave.exe --enable-features="BraveSearchNTP"` 3. Open brave://local-state file and ensure the metrics `Brave.Search.Promo.NewTabPage` is not shown 4. Open a NTP and ensured NTP search promo appears 5. Make search query via NTP promo 6. Change the default search engine to Brave by either clicking on the prompt that appears on the search engine results page 7. Open brave://local-state file and ensured that the metrics `Brave.Search.Promo.NewTabPage` response value is `3` as expected Example | Example | Example -- | -- | --  |  | US Region
Brave.Search.Promo.NewTabPage
Case 1: Brave.Search.Promo.NewTabPage = 0_PASSED
**0 No, No** - "Did the participant in Group C click on the promo - No" and "did they switch their default engine to Brave Search? - No" 1. Clean profile 1.44.x 2. Launch the browser using the cmd line flag `brave.exe --enable-features="BraveSearchNTP"` 3. Open brave://local-state file and ensure the metrics `Brave.Search.Promo.NewTabPage` is not shown 4. Open a NTP and ensured NTP search promo isn't appear as `Brave` is the default SE for US 5. Change the default SE to something other than Brave 6. Open a NTP and ensured NTP search promo appears 7. Open brave://local-state file and ensured that the metrics `Brave.Search.Promo.NewTabPage` response value is `0` as expected Example | Example | Example -- | -- | --  |  | Case 2: Brave.Search.Promo.NewTabPage = 1_PASSED
**1 Yes, No** - "Did the participant in Group C click on the promo - Yes" and "did they switch their default engine to Brave Search? - No" 1. Clean profile 1.44.x 2. Launch the browser using the cmd line flag `brave.exe --enable-features="BraveSearchNTP"` 3. Open brave://local-state file and ensure the metrics `Brave.Search.Promo.NewTabPage` is not shown 4. Open a NTP and ensured NTP search promo isn't appear as `Brave` is the default SE for US 5. Change the default SE to something other than Brave 6. Open a NTP and ensured NTP search promo appears 7. Make search query via NTP promo 8. Open brave://local-state file and ensured that the metrics `Brave.Search.Promo.NewTabPage` response value is `1` as expected Example | Example | Example -- | -- | --  |  | Case 3: Brave.Search.Promo.NewTabPage = 2_PASSED
**2 No, Yes** - "Did the participant in Group C click on the promo - No" and "did they switch their default engine to Brave Search? - Yes" 1. Clean profile 1.44.x 2. Launch the browser using the cmd line flag `brave.exe --enable-features="BraveSearchNTP"` 3. Open brave://local-state file and ensure the metrics `Brave.Search.Promo.NewTabPage` is not shown 4. Open a NTP and ensured NTP search promo isn't appear as `Brave` is the default SE for US 5. Change the default SE to something other than Brave 6. Open a NTP and ensured NTP search promo appears 7. Change the default search engine to Brave via brave://settings/search 8. Open brave://local-state file and ensured that the metrics `Brave.Search.Promo.NewTabPage` response value is `2` as expected Example | Example -- | --  | Case 4: Brave.Search.Promo.NewTabPage = 3_PASSED
**3 Yes, Yes** - "Did the participant in Group C click on the promo - Yes" and "did they switch their default engine to Brave Search? - Yes" 1. Clean profile 1.44.x 2. Launch the browser using the cmd line flag `brave.exe --enable-features="BraveSearchNTP"` 3. Open brave://local-state file and ensure the metrics `Brave.Search.Promo.NewTabPage` is not shown 4. Open a NTP and ensured NTP search promo isn't appear as `Brave` is the default SE for US 5. Change the default SE to something other than Brave 6. Open a NTP and ensured NTP search promo appears 7. Make search query via NTP promo 8. Change the default search engine to Brave by by clicking on the prompt that appears on the search engine results page 9. Open brave://local-state file and ensured that the metrics `Brave.Search.Promo.NewTabPage` response value is `3` as expected Example | Example | Example | Example -- | -- | -- | --  |  |  | Regression on https://github.com/brave/brave-browser/issues/23191
US Region
1. Brave.Search.Promo.Button
Case 1: Brave.Search.Promo.Button=0_PASSED
**0. No, No** - "No, I have not clicked on the promo" and "No, I have not changed my default engine to Brave" 1. Clean profile 1.42.x , launch brave using `brave.exe --enable-logging=stderr --enable-features="BraveSearchOmniboxButton` 2. Open brave://local-state file 3. Search for the metric `Brave.Search.Promo.Button` 4. Ensured metric is not shown in the brave://local-state file 5. Navigate to brave://settings/search 6. Change the search engine to something other than Brave 7. Enter some random text in the Omnibox and ensured the button promo appears in the suggestion 8. Reload the brave://local-state file 9. Ensured that the metrics `Brave.Search.Promo.Button` is shown in the local state file 10. Ensured that the metrics response value is `0` as expectedCase 2: Brave.Search.Promo.Button=1_PASSED
**1. Yes, No** - "Yes, I have clicked on the promo" and "No, I have not changed my default engine to Brave" 1. Follow the steps 1 to 7 from case 1 2. Click on the promo 3. Reload the brave://local-state file 4. Confirmed that the metric `Brave.Search.Promo.Banner` response value is `1` as expectedCase 3: Brave.Search.Promo.Button=2_PASSED
**2. No, Yes** - "No, I have not clicked on the promo" and "Yes, I have changed my default engine to Brave" **Case 1:** Change the default SE to `Brave` via brave://settings/search - PASSED 1. Follow the steps 1 to 7 from case 1 2. Do not click on the promo 3. Navigate to brave://settings/search 4. Change the search engine to `Brave` 5. Confirmed that the metric `Brave.Search.Promo.Button` response value is `2` as expected **Case 2:** Change the default SE to `Brave` by clicking on the prompt that appears on the search engine results page - PASSED 1. Follow the steps 1 to 7 from case 1 2. Open the link https://search.brave.com/search?q=test&action=makeDefault 3. Change the default SE to brave by clicking on the prompt that appears on the search engine results page 4. Reload the brave://local-state page 5. Confirmed that the metric `Brave.Search.Promo.Button` response value is `2` as expectedCase 4: Brave.Search.Promo.Button=3_PASSED
**3. Yes, Yes** - "Yes, I have clicked on the promo" and "Yes, I have changed my default engine to Brave" **Case 1:** change the default SE via search engine results page - PASSED 1. Follow the steps 1 to 7 from case 1 2. Click on the promo 3. Change the default SE to brave by clicking on the prompt that appears on the search engine results page 4. Reload the brave://local-state page 5. Confirmed that the metric `Brave.Search.Promo.Button` response value is `3` as expected **Case 2:** change the default SE via search engine results page - PASSED 1. Follow the steps 1 to 7 from case 1 2. Click on the promo 3. Change the default SE to brave via brave://settings/search 4. Reload the brave://local-state page 5. Confirmed that the metric `Brave.Search.Promo.Button` response value is `3` as expected2. Brave.Search.Promo.Banner
Case 1: Brave.Search.Promo.Banner=0_PASSED
**0. No, No** - "No, I have not clicked on the promo" and "No, I have not changed my default engine to Brave" 1. Clean profile 1.42.x , launch brave using `brave.exe --enable-logging=stderr --enable-features="BraveSearchOmniboxBanner"` 2. Open brave://local-state file 3. Search for the metric `Brave.Search.Promo.Banner` 4. Ensured metric is not shown in the brave://local-state file 5. Navigate to brave://settings/search 6. Change the search engine to something other than Brave 7. Enter some random text in the Omnibox and ensured the button promo appears in the suggestions 8. Reload the brave://local-state file 9. Ensured that the metrics `Brave.Search.Promo.Button` is shown in the local state file 10. Ensured that the metrics response value is `0` as expected Case 2: Brave.Search.Promo.Banner=1_PASSED
**1. Yes, No** - "Yes, I have clicked on the promo" and "No, I have not changed my default engine to Brave" 1. Follow the steps 1 to 7 from case 1 2. Click on the promo 3. Reload the brave://local-state file 4. Confirmed that the metric `Brave.Search.Promo.Banner` response value is `1` as expectedCase 3: Brave.Search.Promo.Banner=2_PASSED
**2. No, Yes** - "No, I have not clicked on the promo" and "Yes, I have changed my default engine to Brave" **Case 1:** Change the default SE to `Brave` via brave://settings/search - PASSED 1. Follow the steps 1 to 7 from case 1 2. Do not click on the promo 3. Navigate to brave://settings/search 4. Change the search engine to `Brave` 5. Confirmed that the metric `Brave.Search.Promo.Banner` response value is `2` as expected **Case 2:** Change the default SE to `Brave` by clicking on the prompt that appears on the search engine results page - PASSED 1. Follow the steps 1 to 7 from case 1 2. Open the link https://search.brave.com/search?q=test&action=makeDefault 3. Change the default SE to brave by clicking on the prompt that appears on the search engine results page 4. Reload the brave://local-state page 5. Confirmed that the metric `Brave.Search.Promo.Banner` response value is `2` as expectedCase 4: Brave.Search.Promo.Banner=3_PASSED
**3. Yes, Yes** - "Yes, I have clicked on the promo" and "Yes, I have changed my default engine to Brave" **Case 1:** change the default SE via search engine results page - PASSED 1. Follow the steps 1 to 7 from case 1 2. Click on the promo 3. Change the default SE to brave by clicking on the prompt that appears on the search engine results page 4. Reload the brave://local-state page 5. Confirmed that the metric `Brave.Search.Promo.Banner` response value is `3` as expected **Case 2:** change the default SE via search engine results page - PASSED 1. Follow the steps 1 to 7 from case 1 2. Click on the promo 3. Change the default SE to brave via brave://settings/search 4. Reload the brave://local-state page 5. Confirmed that the metric `Brave.Search.Promo.Banner` response value is `3` as expected- Omnibox search promo button or banner is supported for
INalso now, earlier it was supported for only 5 countries (US, CA, GB, FR, and DE). But this got changed with the PR https://github.com/brave/brave-core/pull/14935 and now it's supported for 8 countries confirmed with @simonhong via https://bravesoftware.slack.com/archives/C7VLGSR55/p1662548797048609?thread_ts=1662548057.404549&cid=C7VLGSR55
kjozwiak
Description
Adding P3A question for the new tab page search promo (promo added in #23724):
Did the participant in Group C click on the promo and did they switch their default engine to Brave Search?
Brave.Search.Promo.NewTabPage0) No, No 1) Yes, No 2) No, Yes 3) Yes, Yes
Will raise PR soon.