stephendonner
commented
3 months ago Verification PASSED using
Brave | 1.68.92 Chromium: 126.0.6478.71 (Official Build) beta (64-bit)
-- | --
Revision | 393b9968e233540a48f04d74bc4601a05d3a0169
OS | Windows 10 Version 22H2 (Build 19045.4529)Purchases - PASSED
### purchase `Leo Premium` - `PASSED`
### Steps:
1. install `1.68.92`
2. launch Brave using `--env-leo=staging --env-ai-chat.bsg=dev --env-ai-chat-premium.bsg=dev`
3. load `account.bravesoftware.com`
4. enter basic auth username/password
5. enter `issue39132-leo@mailinator.com` test address
6. click `Get login link`
7. click on the `Log in to Brave` link in the resulting email
8. click on `Browse plans`
9. click on `Start free trial` button
10. complete Stripe checkout
11. confirm `You have active credentials loaded!` green banner and messaging
12. clicked to open `Leo` in the sidebar
13. clicked on `Summarize this page`
14. clicked on `I understand`
### Confirmed page summarization over `Premium` via `Mixtral`
example | example
----------|---------
 | 
### purchase `VPN` + `Leo` - `PASSED`
### Steps:
1. install `1.68.92`
2. launch Brave using `--env-leo=staging --env-ai-chat.bsg=dev --env-ai-chat-premium.bsg=dev`
3. load `account.bravesoftware.com`
4. enter basic auth username/password
5. enter `issue39132-vpnleo@mailinator.com` test address
6. click `Get login link`
7. click on the `Log in to Brave` link in the resulting email
8. click on `Browse plans`
9. click on `Start free trial` button on the `Brave VPN` section
10. complete Stripe checkout
11. confirm `You have active credentials loaded!` green banner and messaging
12. click on `Plans`
13. click on `Start free trial` on the `Leo Premium` section
14. complete Stripe checkout
### Confirmed page summarization over `Premium` using `Mixtral`
### Confirmed `Brave VPN` successfully connected to a POP in `Canada`
example | example | example
----------|-----------|----------
 |  | 
### purchase `Brave Talk Premium` - `PASSED`
### Steps:
1. install `1.68.92`
2. load `account.bravesoftware.com`
3. enter basic auth username/password
4. enter `issue39132-talk@mailinator.com` test address
5. click `Get login link`
6. click on the `Log in to Brave` link in the resulting email
7. click on `Browse plans`
8. click on `Start free trial` button for the `Brave Talk Premium` product
8. complete Stripe checkout
10. confirm `Brave Talk Premium` page, with `Start Premium call` button
### Confirmed `Brave Talk Premium` experience (including recording)
example | example | example
---------|-----------|-----------
 |  | 
### purchase `Brave Search Premium` - `PASSED`
### Steps:
1. install `1.68.92`
2. load `account.brave.software.com`
3. enter basic auth username/password
4. enter `issue39132-search@mailinator.com` test address
5. click `Get login link`
6. click on the `Log in to Brave` link in the resulting email
7. click on `Browse plans`
8. click on `Buy now` button for the `Brave Search Premium` product
8. complete Stripe checkout
### Confirmed `Thanks for supporting independent search! You now have full access to Brave Search Premium, and ad-free search results. Enjoy!` messaging
**NOTE**: Search was also purchased via `account.bravesoftware.com` (`staging`) but there is no `search` env. on `staging`, so `development` was used for the above
example | example
----------|----------
 | 
### purchase all Premium products - `PASSED`
1. install `1.68.92`
2. launch Brave using `--env-leo=staging --env-ai-chat.bsg=dev --env-ai-chat-premium.bsg=dev`
3. load `account.bravesoftware.com`
4. enter basic auth username/password
5. enter `issue39132-all@mailinator.com` test address
6. click `Get login link`
7. click on the `Log in to Brave` link in the resulting email
8. click on `Browse plans`
9. click on `Start free trial` button on the `Brave VPN` section
10. complete Stripe checkout
11. confirm `You have active credentials loaded!` green banner and messaging
12. click on `Plans`
13. click on `Start free trial` on the `Leo Premium` section
14. complete Stripe checkout
19. click on `Plans`
20. click on `Start free trial` on the `Brave Talk Premium` section
21. complete Stripe checkout
22. click on `Plans`
23. click on `Buy now` on the `Brave Search Premium` section
### Confirmed working credentials for `Leo`, `Brave VPN`, and `Brave Talk Premium` (search has no staging; verified separately on `account.brave.software.com` (`dev`)
`Leo Premium` | `Brave VPN` | `Brave Talk Premium` | `Brave Search Premium`
----------|-----------|----------|----------
 |  |  | 
`Leo Premium` | `Brave VPN` | `Brave Talk Premium`
-----------------|--------------|-----------------------
 |  | 
### purchase (a) specific combination(s) of the above - `PENDING`
Refresh (redeem) credentials - PASSED
### Steps:
1. install `1.68.94`
2. launch Brave on `device A`
3. load `account.bravesoftware.com`
4. enter basic auth username/password
5. enter `issue39132-creds@mailinator.com` test address
6. click `Get login link`
7. click on the `Log in to Brave` link in the resulting email
8. click on `Browse plans`
9. click on `Start free trial` for `Brave VPN`
10. complete Stripe checkout
11. confirm working `Brave VPN`
12. quit Brave
13. switch to a new device, `device B` (`Android 9, same `beta` build)
14. launch Brave
15. log in to `account.bravesoftware.com` using the same @mailinator.com address you used for `device A`
16. click on `Refresh Brave VPN`
### Expected Results:
The credentials on `device B` should be valid (`ActiveCredentials`) and mirror those of `device A` (same `expires_at`)
### `device A`
`issue39132-creds@...` | `ActiveCredentials`| `expires_at`
----------|-----------|----------
 |  | 
### `device B`
`issue39132-creds@...` | `ActiveCredentials`| `expires_at`
----------|-----------|----------
 |  | 
`Brave VPN`
example | example | example | example | example
----------|-----------|----------|-----------|-----------
 |  |  |  | 
Max limit # of actively-linked/recovered devices, 1.68.x - PASSED
### Steps:
* run `Refresh (redeem) credentials` testcase
* repeat for `9` more devices (totaling `10`)
* confirm no errors linking
* attempt redeeming `device A` credentials on device # `11`
### Expected Results:
Confirm visible, logical error message (`exceeded recovery limit for subscription` from https://github.com/brave-intl/subscriptions/pull/570/files#diff-a5ce247e55d5a20707517e34bef620f2eb369b4f9b8fa44fdfb2c18a702418e8R29)?
`issue39132-linking@...` | `1st` link | `2nd` link | `3rd` link | `4th` link | `5th` link
--------------------------|---------|----------|----------|----------|---------
 | 
| 
| 
|  | 
`6th` link | `7th` link | `8th` link | `9th` link | `10th` link | `mailinator inbox`
---------|----------|---------|---------|------------|----------
 | 
| 
| 
|  | 
1 - `macOS-x64` (work laptop)
2 - `macOS-x64` (personal laptop)
3 - `macOS-arm64` (work laptop)
4 - Android 9, Google Pixel XL (work phone)
5 - `Win11-x64` (personal desktop)
6 - `Win10-x64` (work laptop; **original device**)
7 - `macOS-x64` (personal laptop, _new profile_)
8 - `macOS-x64` (work laptop, _new profile_)
9 - `macOS-arm64` (work laptop, _new profile_)
10 - Android 9, Google Pixel XL (work phone)
Max limit # of actively-linked/recovered devices, 1.61.120 - PASSED
### Steps:
* run `Refresh (redeem) credentials` testcase
* repeat for `9` more devices (totaling `10`)
* confirm no errors linking
* attempt redeeming `device A` credentials on device # `11`
### Expected Results:
Confirm visible, logical error message (`exceeded recovery limit for subscription` from https://github.com/brave-intl/subscriptions/pull/570/files#diff-a5ce247e55d5a20707517e34bef620f2eb369b4f9b8fa44fdfb2c18a702418e8R29)?
`issue39132-link161@...` | `1st` link | `2nd` link | `3rd` link | `4th` link | `5th` link
--------------------------|---------|----------|----------|----------|---------
 | 
| 
|  |  | 
`6th` link | `7th` link | `8th` link | `9th` link | `10th` link | `mailinator inbox`
---------|----------|---------|---------|------------|----------
| 
|  | 
|  | 
1 - `macOS-x64` (work laptop)
2 - `macOS-arm64` (work laptop)
3 - Android 9, Google Pixel XL (work phone)
4 - `Win11-x64` (personal desktop)
5 - `Win10-x64` (work laptop; **original device**)
6 - `macOS-x64` (work laptop, _new profile_)
7 - `macOS-arm64` (work laptop, _new profile_)
8 - Android 9, Google Pixel XL (work phone)
9 - `macOS-x64` (work laptop, _new profile_)
10 - `Win10-x64` (work laptop, _new profile_)
Auto-renew (within 5 days of exp.), 1.68x - PASSED
### Steps:
1. install `1.68.94`
2. launch Brave using `--env-leo=staging --env-ai-chat.bsg=dev --env-ai-chat-premium.bsg=dev`
3. load `account.bravesoftware.com`
4. enter basic-auth username/password
5. enter `leo-autorenew@mailinator.com` test address
6. click `Get login link`
7. click on the `Log in to Brave` link in the resulting email
8. click on `Browse plans`
9. click on `Start free trial` for `Leo Premium`
10. complete Stripe checkout
11. open `brave://skus-internals`
12. confirm `created_at` and `expires_at` are 1 month apart
13. quit Brave
14. open `Local State.json` in a text editor
15. set all credentials' dates (`valid_from`, `valid_to`, `expires_at`, etc.) to be in the past
16. relaunch Brave
17. wait a couple minutes
18. check `brave://skus-internals`
### `Original launch`:
example | example | example | example | example
----------|-----------|----------|-----------|----------
 |  |  |  | 
### `Edited "Local State.json"`: (set all `valid_from`, `valid_to`, and `expires_at` dates to be in the past)
### `After relaunch`:
example | example | example | example | example
-----------|----------|-----------|----------|----------
 |  |  |  | 
### Confirmed:
* `Leo Premium` shows as `ActiveCredentials` in `brave://skus-internals` with a valid, extended `expires_at` value, which is 1 month past the initial `expires_at`
* `Leo Premium` summarized a `vox.com` article via `Claude 3 Sonnet` over the `Premium` endpoint
Auto-renew (within 5 days of exp.), 1.61.120 - PASSED
### Steps:
1. install `1.61.120`
2. launch Brave using `--env-leo=staging --env-ai-chat.bsg=dev --env-ai-chat-premium.bsg=dev`
3. load `account.bravesoftware.com`
4. enter basic-auth username/password
5. enter `leo-autorenew-old@mailinator.com` test address
6. click `Get login link`
7. click on the `Log in to Brave` link in the resulting email
8. click on `Browse plans`
9. click on `Start free trial` for `Leo Premium`
10. complete Stripe checkout
11. open `brave://skus-internals`
12. confirm `created_at` and `expires_at` are 1 month apart
13. quit Brave
14. open `Local State.json` in a text editor
15. set all credentials' dates (`valid_from`, `valid_to`, `expires_at`, etc.) to be in the past
16. relaunch Brave
17. wait a couple minutes
18. check `brave://skus-internals`
### `Original launch`:
example | example | example | example | example
----------|-----------|----------|-----------|----------
 |  |  |  | 
### `Edited "Local State.json"`: (set all `valid_from`, `valid_to`, and `expires_at` dates to be in the past)
### `After relaunch`:
example | example | example | example | example
-----------|----------|-----------|----------|----------
 |  |  |  | 
### Confirmed:
* `Leo Premium` shows as `ActiveCredentials` in `brave://skus-internals` with a valid, extended `expires_at` value, which is 1 month past the initial `expires_at`
* `Leo Premium` summarized a `vox.com` article via `Claude 3 Sonnet` over the `Premium` endpoint
Cancellation - PASSED
### Steps:
1. install `1.68.94`
2. launch Brave using `--env-leo=staging --env-ai-chat.bsg=dev --env-ai-chat-premium.bsg=dev`
3. load `account.bravesoftware.com`
4. enter basic-auth username/password
5. enter `issue39132-cancel@mailinator.com` test address
6. click `Get login link`
7. click on the `Log in to Brave` link in the resulting email
8. click on `Browse plans`
9. click on `Start free trial` button
10. complete Stripe checkout
11. confirm `You have active credentials loaded!` green banner and messaging* cancel VPN
12. click on `Cancel plan`
13. click on `Cancel subscription`
14. confirm `Your plan has been canceled.` message
15. click on `Return to account`
### Confirmed:
* Product shows as `Canceled` in `brave://skus-internals`, with an appropriate `expires_at` value 1 month from the original `created_at` date
* `Leo Premium` still works
example | example | example | example | example | example | example
----------|----------|-----------|-----------|-----------|----------|----------
 |  |  |  |  |  | 
Renewal - PASSED
### Steps:
1. run `Cancellation` test, above
2. click on `Renew plan`
3. finish `Stripe` checkout
### Confirmed:
* Product shows as `ActiveCredentials` in `brave://skus-internals` with a valid, extended `expires_at` value
* `Leo Premium` works
example | example | example | example | example
----------|-----------|----------|-----------|----------
 |  |  |  | 
MadhaviSeelam
mattmcalister
Uni-verse
kjozwiak
See test plan https://github.com/brave/qa-resources/wiki/Multi%E2%80%90device-Refresh-(MDR)-Test-Plan-(desktop)