Code Release - Githubissues

brain-research / realistic-ssl-evaluation

Open source release of the evaluation benchmark suite described in "Realistic Evaluation of Deep Semi-Supervised Learning Algorithms"

Apache License 2.0

460 stars 98 forks source link

Code Release #1

Closed avital closed 6 years ago

avital commented 6 years ago

Subscribe to this issue to get notified when the code is released and pushed to this repository.

srp33 commented 6 years ago

Even if you could just release a preliminary version of the code for applying SSL methods, that would be helpful...

yanshuaicao commented 6 years ago

Is the code going to be a set of standalone tools/library or a framework? How easy would it be to try out models in pytorch with this evaluation codebase?

avital commented 6 years ago

The code is in TensorFlow, and uses tf.data.Dataset for the data loading pipeline for all of the experiments.

Unfortunately, the code was not designed with other machine learning frameworks in mind.

AhmedAyad89 commented 6 years ago

Do you have an ETA on the release?

avital commented 6 years ago

I want to say 2 weeks.

wenli-vision commented 6 years ago

Look forward to the release...

Anierin commented 6 years ago

Do you have an new ETA on the release?

avital commented 6 years ago

Sadly, there have been some internal challenges with the open source release. I am currently unable to estimate the time to release.

srp33 commented 6 years ago

In my opinion, you should update your preprint accordingly. It should not indicate that the code is available when it is not. Perhaps it even makes sense to withdraw the preprint until this is worked out.

avital commented 6 years ago

I will update the preprint to say that the open source release is pending, rather than that is is available.

To clarify, the delay is not due to any doubts we have on the validity of our results -- it is entirely due to internal procedural issues.

Anierin commented 6 years ago

Thank you for answering