search

mmisw / orr-portal

ORR Frontend component
Apache License 2.0
8 stars 5 forks source link

Increase size of upload data > 10MB #126

Closed lewismc closed 5 years ago

lewismc commented 5 years ago

I have been working on generating RDF manifestations of the NASA Global Reservoir and Dam Database (GRanD v1.01) which results in a two fairly large datasets. One is ~20MB and the other ~130MB. @carueda what are the chances of us increasing the maximum 10MB for datasets ? Thanks

carueda commented 5 years ago

@lewismc @graybeal

Those are large datasets.

Anyway, I can increase the size limit for the upload (this restriction is performed on the backend).

What limit should I set?

carueda commented 5 years ago

BTW, because it's specially relevant, I'll try to also address https://github.com/mmisw/orr-ont/issues/68 for the resulting new ORR version.

lewismc commented 5 years ago

For the LDaaS initiative we would be looking to facilitate large RDF datasets with possibly hundreds of thousands if not millions of statements. The hydrography datasets I a working with now will reflect that. For the time being if we could set it at 150MB it would be excellent. Thank you for the quick reply @carueda

carueda commented 5 years ago

@lewismc I've just implemented this (with 150M as size limit for uploads -- but this is now configurable), created new docker image, and updated the COR instance. I'm marking this as resolved. Please give it a try when you have a chance and let me know.

NOTE: The docker image is v3.8.0, but the frontend component is 3.7.3, which is the version you should now see on the UI. (Will try to "resync" the versions next time.)

(btw, https://github.com/mmisw/orr-ont/issues/68 not addressed yet.)

lewismc commented 5 years ago

@carueda thanks for acting on this. When I try to use the frontend WebUI, it still indicates 10MB is upper limit.

screen shot 2019-01-15 at 1 21 12 pm
carueda commented 5 years ago

Unexpected, perhaps I missed some step in my build process (it's been a while since I last touched this code)... In the mean time, please try a hard-reload of the page in your browser (even clearing the cache). Also open the dev console while you are retrying and attach any output there if the problem persists.

carueda commented 5 years ago

@lewismc Can you email me that 21MB file (compressed) so I can do some local tests?

carueda commented 5 years ago

Found the problem. Will create a new release.

carueda commented 5 years ago

Fixed. The new version is now 3.8.1 (in the docker image and reflected in the UI).

COR just updated.

3.8.1 also includes resolution of https://github.com/mmisw/orr-ont/issues/68