mozilla-services / merino-py

Web Service for Firefox Suggest
Mozilla Public License 2.0
9 stars 9 forks source link

[HNT-207] Include older curated items as an experiment #689

Closed mmiermans closed 2 weeks ago

mmiermans commented 2 weeks ago

References

Description

Return eligible content that was scheduled during the past 3 days, for users in the treatment branch of the extended content duration experiment.

QA

Steps:

  1. gcloud auth application-default login to get access to GCP.
  2. Create merino/configs/development.local.toml:

    [development]
    dynaconf_merge = true
    
    [development.curated_recommendations.gcs]
    bucket_name = "merino-airflow-data-prodpy"
    gcp_project = "moz-fx-merino-prod-1c2f"
  3. Make a control request and save the response to a file (I used Postman):
    curl --location 'http://localhost:8000/api/v1/curated-recommendations' \
    --header 'Content-Type: application/json' \
    --data '{
        "locale": "en-US",
        "experimentName":"new-tab-extended-expiration-experiment",
        "experimentBranch":"control",
        "count": 500
    }'
  4. Repeat previous step, but with "experimentBranch":"treatment"
  5. Ask ChatGPT to find the differences between the two JSON response files:

    Find the scheduledCorpusItemId that occur in treatment but not in control, and list their receivedRank and title in a table.

Result: receivedRank title
0 17 Phrases Great Leaders Never Say to Employees
1 The Richest Black Girl in America
2 3D Scans Reveal Secrets of a 3,000-Year-Old Egyptian Mummy’s Coffin
3 This Is What Happened When I Had A Keratin Treatment
10 How To Roast Any Vegetable
14 The Definitive Superfood Ranking
30 What in Tarnation Is ‘Tarnation’?
34 The Lost Girl of Vermont’s ‘Bennington Triangle’
58 English Is Not Normal
71 7 Poisonous Mushrooms and What Happens if You Eat Them
135 7 Countries Where You Can Get a Passport Through Ancestry

PR Review Checklist

Put an x in the boxes that apply