iterative / dataset-registry

Dataset registry DVC project
67 stars 39 forks source link

get-started: replace with R-lang labeled posts #28

Closed shcheklein closed 2 years ago

shcheklein commented 2 years ago

I'm migrating get started to a better dataset. A bit more balanced + all posts are labeled + I'll be using R tag, not Python since it makes the problem a bit more interesting and results less predictable.

Also there will be now two datasets 10K and 40K + we'll change the number of features in the get started itself to 100-200. All these things will make the project more stable, metrics make more sense, memory footprint goes significantly down (need to test on docker to what is the minimum now).

This PR should be rebased to keep the sequence 40k, 10K (HEAD). 40K will be fetched using tags.