search

Kattis / problem-package-format

Kattis problem package format specification
https://www.kattis.com/problem-package-format
9 stars 14 forks source link

Allow marking "model solutions" #317

Open niemela opened 3 months ago

niemela commented 3 months ago

This is a bit of a fringe feature. Most systems would ignore it, but it would not be much work to support.

A model solution is a solution that the authors would be happy to publish as a "good correct solution." It's probably a bit polished, possibly even commented.

I would suggest adding model_solution: true in submissions.yaml.

eldering commented 3 months ago

I have a feeling it would barely or not all be used to select submissions for publication (also because typically the package would get published as a whole), so even though I agree it's very cheap to add, I'd lean to not do so. No objections though if others indeed feel it's useful.

Tagl commented 3 months ago

I guess this is more of an educational feature that allows systems to identify these solutions with ease.

evouga commented 2 months ago

I agree with eldering; this feature would have been useful when contest directors needed to manually extract test data and judge solutions to post on contest web sites. It’s less useful if full packages are now on a centralized archive.

niemela commented 2 months ago

It is still useful in an educational setting. The difference between a "model solution" and any other "accepted" solution is that the former is intended to be polished, commented, and idiomatic , whereas the latter is just expected to work.

When publishing solutions after a contest we don't really care about polished, commented, and idiomatic, and contest code is seldom those things, but in an educational setting we do.

In any case, I'm not hearing any strong opposition to this?

eldering commented 2 months ago

I feel a bit that this is feature creep. If this is not used to publish a selected set of model submissions, will this then first of all be used by authors to mark these model solutions, and secondly by students to see which ones are? I doubt that.

niemela commented 2 months ago

I feel a bit that this is feature creep. If this is not used to publish a selected set of model submissions, will this then first of all be used by authors to mark these model solutions, and secondly by students to see which ones are? I doubt that.

We already use something similar for education, so I would argue that I know that it would be used. Again, I don't think it will be used at contests much or at all.