Use .cppSimulateKey to calculate difficulty

[Eve-ning]

This thread will host the updates of difficulty formula and discussion using .cppSimulateKey

[Eve-ning]

Current formula is

  model %<>% 
    mutate(
      dns.new = (dns.vals + 1) ** 1.2,
      mtn.new = (mtn.vals + 1) ** 0.9,
      lng.new = (lng.vals + 1) ** 1 ,
      jck.new = (jck.vals + 1) ** 175,
      mnp.new = (mnp.vals + 1) ** 0.4 ,
      values = dns.new * mtn.new * lng.new * jck.new * mnp.new)

.cppSimulateKey(model$offsets, model$values, decay_perc_s = 0.1)

Works quite well in sorting the difficulty right Problem is that Jumptrillable maps aren't as heavily affect by MNP as expected.

[Eve-ning]

  model %<>% 
    mutate(
      dns.new = (dns.vals + 1) ** 1.2,
      mtn.new = (mtn.vals + 1) ** 0.9,
      lng.new = (lng.vals + 1) ** 0.9 ,
      jck.new = (jck.vals + 1) ** 175,
      mnp.new = (1 - mnp.vals) ** 0.35,
      values = (dns.new * mtn.new * lng.new * jck.new * mnp.new) / 100000)

  final.sim <- .cppSimulateKey(model$offsets, model$values,
                               decay_perc_s = 0.1)

|file.name | dns | mtn | mnp | lng | jck | final

--|-- | -- | -- | -- | -- | -- | -- 1|src/r/osu/custom/4/Various Artists - Dan ~ REFORM ~ 2nd Pack (DDMythical) [~ EXTRA-EPSILON ~ (Marathon)].osu | 57.70881 | 1.598961 | 0.5769164 | 1.000000 | 26.899399 | 17.4573807 26 | src/r/osu/custom/4/Various Artists - Dan ~ REFORM ~ 2nd Pack (DDMythical) [~ EXTRA-DELTA ~ (Marathon)].osu | 54.47682 | 1.613233 | 0.5210218 | 1.002607 | 16.717706 | 8.0674686 29 | src/r/osu/custom/4/Various Artists - ELPIS V (ELPIS) [YELL! [Insane]].osu | 44.90957 | 1.589912 | 0.6612559 | 1.177666 | 13.428843 | 7.1188538 6 | src/r/osu/custom/4/DJ Myosuke & Noizenecio - Architecture (Mat) [Mat's 4k DEATH].osu | 47.37208 | 1.612480 | 0.5577975 | 1.073856 | 19.132998 | 7.0953311 14 | src/r/osu/custom/4/Studio EIM - Crescent Moon Island Boss Theme (Shoegazer) [Kuro].osu | 48.91843 | 1.572698 | 0.5818085 | 1.009235 | 14.863566 | 6.3081568 31 | src/r/osu/custom/4/Yuyoyuppe - AiAe (Fullerene-) [Wafles' SHD].osu | 37.58524 | 1.540351 | 0.6382408 | 1.128570 | 18.270562 | 6.0951951 4 | src/r/osu/custom/4/Camellia as Bang Riot - Blastix Riotz (Fresh Chicken) [GRAVITY].osu | 46.55656 | 1.657993 | 0.5424801 | 1.046590 | 17.934209 | 6.0520992 16 | src/r/osu/custom/4/UNDEAD CORPORATION - MEGALOMANIA (hansuyo) [GOD].osu | 46.44382 | 1.607708 | 0.5877760 | 1.036145 | 13.045914 | 5.6256363 28 | src/r/osu/custom/4/Various Artists - Dan ~ REFORM ~ 2nd Pack (DDMythical) [~ EXTRA-GAMMA ~ (Marathon)].osu | 48.58761 | 1.604906 | 0.5565974 | 1.046688 | 13.983703 | 5.5403234 8 | src/r/osu/custom/4/DJKurara - Japanese Transformation (XeoStyle) [Fullerene's Shift].osu | 43.57462 | 1.581370 | 0.6031539 | 1.089132 | 11.547782 | 5.4254984 25 | src/r/osu/custom/4/Various Artists - Dan ~ REFORM ~ 2nd Pack (DDMythical) [~ EXTRA-BETA ~ (Marathon)].osu | 42.50189 | 1.557594 | 0.5880985 | 1.027690 | 12.232164 | 4.3159853 24 | src/r/osu/custom/4/Various Artists - Dan ~ REFORM ~ 2nd Pack (DDMythical) [~ EXTRA-ALPHA ~ (Marathon)].osu | 43.21789 | 1.544181 | 0.6186953 | 1.009478 | 11.068250 | 4.2680107 19 | src/r/osu/custom/4/Various Artists - Dan ~ REFORM ~ 2nd Pack (DDMythical) [~ 10th ~ (Marathon)].osu | 38.16637 | 1.486686 | 0.5978022 | 1.072254 | 9.949998 | 3.3501792 18 | src/r/osu/custom/4/UNDEAD CORPORATION - The Empress scream off ver (TheZiemniax) [Zenx's SHD].osu | 38.64374 | 1.515762 | 0.5973053 | 1.055772 | 9.416922 | 3.3417087 30 | src/r/osu/custom/4/YST - The Lost Dedicated (Zyph) [4K].osu | 38.02633 | 1.573324 | 0.5851809 | 1.000000 | 13.329632 | 2.9651303 7 | src/r/osu/custom/4/DJKurara - Japanese Transformation (XeoStyle) [Expert].osu | 37.79397 | 1.504057 | 0.6054204 | 1.000000 | 8.328493 | 2.6389273 23 | src/r/osu/custom/4/Various Artists - Dan ~ REFORM ~ 2nd Pack (DDMythical) [~ 9th ~ (Marathon)].osu | 35.60545 | 1.456669 | 0.5569181 | 1.013813 | 8.318174 | 2.2702391 12 | src/r/osu/custom/4/Kaneko Chiharu - Kai Dan (Tofu1222) [Daitatsujin].osu | 31.16070 | 1.535155 | 0.5604864 | 1.227177 | 10.707548 | 2.2518137 22 | src/r/osu/custom/4/Various Artists - Dan ~ REFORM ~ 2nd Pack (DDMythical) [~ 8th ~ (Marathon)].osu | 34.40436 | 1.457859 | 0.5914520 | 1.006616 | 8.107717 | 2.0632588 13 | src/r/osu/custom/4/Sore wa Mahiru no Suisei (Chroma gochapon remix).osu | 35.30536 | 1.564282 | 0.5563787 | 1.066608 | 8.410457 | 1.8028573 21 | src/r/osu/custom/4/Various Artists - Dan ~ REFORM ~ 2nd Pack (DDMythical) [~ 7th ~ (Marathon)].osu | 32.93537 | 1.443052 | 0.5732146 | 1.030765 | 7.379763 | 1.7827855 11 | src/r/osu/custom/4/Igorrr & Ruby My Dear - Figue Folle (Parachor) [Grotesque [Lv.18]].osu | 28.21344 | 1.529796 | 0.6263021 | 1.344549 | 10.468083 | 1.7606160 17 | src/r/osu/custom/4/UNDEAD CORPORATION - The Empress scream off ver (TheZiemniax) [SC].osu | 31.36475 | 1.376252 | 0.4681727 | 1.062001 | 9.104916 | 1.7434755 9 | src/r/osu/custom/4/Feryquitous - Vend (SitekX) [...].osu | 30.82607 | 1.395530 | 0.5555851 | 1.000000 | 11.331004 | 1.7360736 20 | src/r/osu/custom/4/Various Artists - Dan ~ REFORM ~ 2nd Pack (DDMythical) [~ 6th ~ (Marathon)].osu | 31.29645 | 1.418063 | 0.5989537 | 1.014807 | 6.559023 | 1.5136604 5 | src/r/osu/custom/4/DJ'TEKINASOMETHING - Palette GAMMA (Cadmium-113) [Affection].osu | 32.29597 | 1.425743 | 0.5538488 | 1.010156 | 6.281893 | 1.3830088 1 | src/r/osu/custom/4/Betwixt & Between - out of Blue (Shoegazer) [Abyss].osu | 25.03997 | 1.311823 | 0.5932102 | 1.218700 | 10.471163 | 1.2958387 32 | src/r/osu/custom/4/ZUN remix by 44teru-k - Harutoman no Youkai Shoujo~VirusV (Wh1teh) [k].osu | 31.78957 | 1.452658 | 0.6318994 | 1.000000 | 8.139055 | 1.2237919 2 | src/r/osu/custom/4/Camellia - Bassline Yatteru w (Lude) [w].osu | 26.10965 | 1.453239 | 0.5842812 | 1.288803 | 6.749173 | 1.1245541 15 | src/r/osu/custom/4/typeMARS - Triumph & Regret ([ A v a l o n ]) [Regret].osu | 26.61274 | 1.379320 | 0.5652065 | 1.016107 | 4.834453 | 0.7494742 10 | src/r/osu/custom/4/ginkiha - Anemoi ([ A v a l o n ]) [Daybreak].osu | 26.28433 | 1.391042 | 0.6019792 | 1.479301 | 4.686579 | 0.6605591 3 | src/r/osu/custom/4/Camellia - Light It Up (Hiranaka) [Lightning].osu | 21.43532 | 1.327352 | 0.5502369 | 1.193140 | 3.908978 | 0.4795502

[Eve-ning]

Problem is that it overfit the training data, performed horribly on test data. Refer to Google Sheet for issue. I will not pursue .cppSimulateKey Difficulty until I can figure out the anomaly of inflated maps