Bukit-Vista / roadmap

0 stars 0 forks source link

Reliability / Increase in month revenue achievement from potential revenue to 75% and Atlas embedding revenue contribution #14

Open Vidiskiu opened 2 weeks ago

Vidiskiu commented 2 weeks ago

Description

We previously measured that revenue management efforts are able to achieve around 64.23% of the in month revenue potential for the month of April 2024.

There is a big difference in decision count between RandomForest and ATLAS Embedding DNN v2, this is because ATLAS Embedding DNN always get restricted due to price change threshold of 15% or 20%, and below minimum rate price. This caused a lot of revenue to be directed to ATLAS RandomForest just because it gets more chances and executions.

This is also applicable to MARS since price prediction beyond treshold is also not logged in pricing_decision table.

Problem

Root Causes:

Solutions

  1. If pricing prediction > treshold, we can adjust final price to be exactly the treshold value, ensuring pricing decisions to be updated and more contribution from respective models.
    • Move validation of pricing such as minimum rate and out of bound treshold to process stage instead of model/send stage.
    • Ensure that data logging in pricing_decision table has been completed in the process stage.
    • Ensure that we are able to log how many pricing decisions ave been pushed through this method.
  2. Update feature collection for MA ADR to accomodate the following
    • Recognize the seasonality of the NAB dates and get the ADR from the same seasonality group.
    • SUM the ADR according to the uint type aand quantity to get a better MA ADR value
  3. Reduce cases of gateway timeout that causes inference to be empty and no decision made.
  4. After the number of pricing prediction > treshold as been significantly reduced to <50/day, we can make escalation status = 1 to avoid it being sent, but it requires manual intervention from pricing ops.

Measurement metrics

Current measurements:

Period of 2024-04-01 - 2024-04-29

SLA

RM:

ATLAS:

MARS:


Updates: