mlr-org / ParamHelpers

Helpers for parameters in black-box optimization, tuning and machine learning.
https://paramhelpers.mlr-org.com
Other
25 stars 9 forks source link

Simple Question: What does "prop" mean in the plots? #225

Closed bryanhanson closed 4 years ago

bryanhanson commented 4 years ago

I see in the code that the final point in an optimization is labeled "prop". What does this stand for?

mb706 commented 4 years ago

Best I can think of is "proposition", maybe someone else here knows better.

bryanhanson commented 4 years ago

I was thinking "proposed" as in a final answer, but at least in my use case the last one has never been the best answer, which is part of what led me to ask.

jakob-r commented 4 years ago

Can you give me some context?

bryanhanson commented 4 years ago

It’s the label given to the last dob point and marked in green on plots.

Sent from an undisclosed location - check with the NSA.

On Mar 6, 2020, at 9:29 AM, Jakob Richter notifications@github.com wrote:

 Can you give me some context?

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub, or unsubscribe.

jakob-r commented 4 years ago

Are you talking about plotOptPath() and 'renderOptPathPlot()`? In this case the newest point will always be marked as proposal. As such is it is not the proposal of the best point but the point that is proposed by the optimization algorithm in the most recent iteration. Do you think we should document this better?

bryanhanson commented 4 years ago

Thank you Jakob-r, yes, the newest point. I understand how you are using the term now. I can see how in code one would keep track of the current or proposed point. Is it important to mark it in the plot though? It is always the most recent point (if I understand correctly) if plotting against DOB.

You have developed a great set of packages that I am finding very useful, and one of the strengths is the diverse set of learners and parameters one can use. I only know reasonably well the little piece I am using (see my blog post about one application). Given the range of applications I don't know if marking the proposed point in plots is generally useful or not. So my question is answered, I leave it to you to think about the value in marking the point or not.

I do think it should be documented -- a very short vignette about the plots would be a nice addition. I had to look through your code to figure out what DOB was (very clever name though!).

Thanks for your time and effort on this. I'll let you close the issue unless there is more to say.

jakob-r commented 4 years ago

I will close this issue. I hope we make plots more clear in our future packages.