search

ramp-kits / autism

Data Challenge on Autism Spectrum Disorder detection
https://paris-saclay-cds.github.io/autism_challenge/
67 stars 43 forks source link

Pre-requisite: ramp_test_workflow #23

Closed ncordier closed 6 years ago

ncordier commented 6 years ago

On the webpage, ramp_test_workflow is mentioned.

ramp test workflow

However, I am not sure whether executing this workflow is actually running the Jupyter notebook, executing ramp_test_submission at the end of the notebook, or executing something else which would be found in the Ramp-Worflow repository.

ncordier commented 6 years ago

It has to be ramp_test_submission since the auto-completion only suggests these:

autocompletion

kegl commented 6 years ago

ramp_test_submission is a standalone script that tests your python files in submissions/starting_kit/. It's a "unit test" that you should use to check that your submission files are correct.

kegl commented 6 years ago

You can read about what happens behind the scene in the ramp-workflow wiki https://github.com/paris-saclay-cds/ramp-workflow/wiki/Build-your-own-workflow

ncordier commented 6 years ago

Typical workflows are a single classifier or a feature extractor followed by a classifier used here, but we have more complex workflows.

I I understand it right, a submission is expected to contain a workflow, i.e. a feature extractor and a classifier.

So, to come back to my initial question, ramp_test_workflow, which is mentioned in the Prerequisites section on this webpage, is actually a typo: it should be ramp_test_submission, right?

kegl commented 6 years ago

Yes, it was a typo, thanks for spotting this, I corrected it.