facebookexperimental / Robyn

Robyn is an experimental, AI/ML-powered and open sourced Marketing Mix Modeling (MMM) package from Meta Marketing Science. Our mission is to democratise modeling knowledge, inspire the industry through innovation, reduce human bias in the modeling process & build a strong open source marketing science community.
https://facebookexperimental.github.io/Robyn/
MIT License
1.07k stars 323 forks source link

Budget Allocation Outcomes in Robyn #982

Open stdp95 opened 1 month ago

stdp95 commented 1 month ago

I’m encountering some unexpected behavior with the Robyn Budget Allocator and need your assistance to understand what might be going wrong. Here are the details of my issue:

  1. With Max_Response:

    • Spend: $1M
    • Response: $5.42M
    • ROAS: 5.42
  2. With target_efficiency (target variable ROAS = 3):

    • Spend: $2.38M
    • Response: $7.14M
    • ROAS: 3

For the same time period, my initial values before allocation were:

Additionally, when using Max_Response, the budget allocator suggests a few channels, which seem to be based on mROAS. However, when I switch to target_efficiency, it significantly decreases the budget for these initially suggested channels and instead recommends a different channel, allocating 75% of the budget to it. The channels suggested under Max_Response align well with the business team's insights, making this shift even more puzzling.

Issues observed:

This behavior is confusing and seems counterintuitive based on my initial values and business insights. Any guidance or explanation for this issue would be greatly appreciated.

Thanks!