codalab / chalab

1 stars 4 forks source link

Test/Debug September Staging Server #66

Closed Tthomas63 closed 7 years ago

Tthomas63 commented 7 years ago

Currently I have setup a Heroku server with the progress on all p1 issues.

URL: https://chalab.herokuapp.com/

Known issues

Acceptance criteria

madclam commented 7 years ago

When I signed up, I got immediately logged in: I did not have to use the confirmation email: image

madclam commented 7 years ago

I uploaded a TIFF file as logo: I received no complaint, but then the logo did not get displayed.

madclam commented 7 years ago

Documentation pages: We still have the variables displayed with a $ sign in the rendering. image

Once we edit and save, then it's fine:

image

madclam commented 7 years ago

I clicked on PROFILE and got an error https://chalab.herokuapp.com/user/profile image

I tried it again after a big file upload was finished. Then it worked.

madclam commented 7 years ago

Download from front page works fine. Bundle tested on Codalab http://docker-server.lri.fr/competitions/1479.

Can you add the FILE SIZE so people know how big the download will be. Thanks.

madclam commented 7 years ago

Large dataset upload is all fine (383 MB). I got an error because my zip file did not include a directory with the files in it: Expected a single file/folder in path, got multiple: ['lothlorian_feat.name', 'lothlorian_test.data', 'lothlorian_label.name', 'lothlorian_train.solution', 'lothlorian_train.data', 'lothlorian_valid.data']

Would be nice to accept both a "flat" archive (not directory structure) and lothlorian/ lothlorian_feat.name lothlorian_test.data lothlorian_label.name lothlorian_train.solution lothlorian_train.data lothlorian_valid.data

madclam commented 7 years ago

Not sure what this is: Build competitions several times and verify that the latest Bundle downloaded from the homepage matches the one in the bundler

madclam commented 7 years ago

I tried to create a "group" and this worked fine. BUT, I could not create a challenge using the template of that group.

image

madclam commented 7 years ago

For each default dataset:

Set your competition to use it Build your competition Verify build success, and make sure the zip has the correct files

I did not check for each dataset, but did it for one.

Tthomas63 commented 7 years ago

1) The debug logic has been re-done again. I just tested after clearing the database, and mandatory email confirmation is working at the time of writing this.

2) Documentation now auto-updates when viewing the page, these templates should automatically be rendered now.

3) The profiles too many connection error is specific to the staging environment. I'll make a script to reset connections when the branch pushes to Heroku.

This occurs on Hobby Tier (hobby-dev and hobby-basic) plans, which have a max connection limit of 20 per user. To resolve this error, close some connections to your database by stopping background workers, reducing the number of dynos, or restarting your application in case it has created connection leaks over time. A discussion on handling connections in a Rails application can be found here.

4) File size added to download button!

5) I have not started the metadata task, or the issues regarding the structure of datasets. This is next within my priorities along with kill bad tasks/restart bad tasks.

6) Groups should be working now! This was an issue with code still referencing local storage vs azure storage.

The staging server database has been reset and is ready for some more testing!

---- Screenshots ----

screen shot 2017-09-19 at 12 20 29 pm

Tthomas63 commented 7 years ago

In order to hit the Chalab Sept release deadline, I think we'll need to review this probably by the end of the week.

madclam commented 7 years ago

Create datasets:

screen shot 2017-09-26 at 5 47 16 pm

The adult dataset is found multiple times in the default menu.

madclam commented 7 years ago

It is still not possible to upload datasets without a directory structure: image I think we had an issue for that, I cannot find it.

madclam commented 7 years ago

Load large dataset: https://www.dropbox.com/s/t1a83sfwj9cnq41/lothlorian.zip?dl=0 383 MB image The second time I tried it worked but then I got this error: image When in fact my dataset contained: image So what is missing is: lothlorian_valid.solution and lothlorian_test.solution. Also can we add a link to go back the previous page after we get this error message?

madclam commented 7 years ago

I uploaded https://www.dropbox.com/s/q0ktl6p8sis1zt6/robert.zip?dl=0 and got again the error: image I tried twice.

madclam commented 7 years ago

I tried even smaller datasets: https://www.dropbox.com/s/eqgspfawads2bc6/gina.zip?dl=0 dis not go through: only 19 MB image

So the heroku server cannot take anything. There is no point in continuing with it. Let's switch to Azure.

madclam commented 7 years ago

BTW https://www.dropbox.com/s/eqgspfawads2bc6/gina.zip?dl=0 19 MB uploaded fine on https://chalab.lri.fr

madclam commented 7 years ago

However on https://chalab.lri.fr https://www.dropbox.com/s/q0ktl6p8sis1zt6/robert.zip?dl=0 191 MB gave me the error:

image

Tthomas63 commented 7 years ago

Closing this for now. We have moved away from this branch and it's changes.