search

DigitalGlobe / GGD-OpenSpaceNet

General CLI for DeepCore
Apache License 2.0
15 stars 5 forks source link

Add option to read gbdxm file over http #67

Open geodawg opened 8 years ago

geodawg commented 8 years ago

Now that we have the ability to generate gbdxm files on the fly, we need to be able to read in those files via HTTP where they sit in our model zoo in S3. Also makes sense because the full path of that file gets email to the end user.

avitebskiy commented 8 years ago

We need to think about this one a bit. Model files are HUGE. Maybe getting them from S-3 and caching them locally somehow or something would be better. We certainly need the option, but I would really hesitate to just download the model file into memory and then throw it away

geodawg commented 8 years ago

Understood. Maybe create a model cache folder in the OSN root directory with a hash of the file to reference. It could even be a hidden folder that the users can't see? At any rate, I think this option is going to be mandatory for those users running the tool over and over again.

Maybe have a --nocache option too for those tasks that run over and over again using the same parameters?

avitebskiy commented 8 years ago

We'll see. We just need to get together and explore some options. The actual mechanics of this shouldn't be hard to implement, we just need to hash out the details.

geodawg commented 8 years ago

This will be really good for the GUI users as well!

avitebskiy commented 8 years ago

This may become a small epic actually. Maybe we're getting to the point where we need to think about persistent OSN configuration with cache locations, etc.