holoviz-topics / EarthSim

Tools for working with and visualizing environmental simulations.
https://earthsim.holoviz.org
BSD 3-Clause "New" or "Revised" License
65 stars 21 forks source link

Quest updates #301

Closed sdc50 closed 5 years ago

sdc50 commented 5 years ago

I'm working on release a new version on Quest that this PR depends on. I'll mark it as ready once I get that released.

philippjfr commented 5 years ago

Going to try to get this merged today.

philippjfr commented 5 years ago

I'm seeing a number of issues, on the CI the quest.api.get_data call errors like this and locally I'm getting an some database error in pony on the same call:

~/miniconda3/envs/earthsim/lib/python3.6/site-packages/quest/api/workflows.py in get_data(service_uri, search_filters, search_queries, download_options, collection_name, expand, use_cache, max_catalog_entries, as_open_datasets, raise_on_error)
     57          the quest dataset name, or an python data structure if open_dataset=True.
     58     """
---> 59     new_collection(collection_name, exists_ok=True)
     60 
     61     # download the features (i.e. locations) and metadata for the given web service
...
~/miniconda3/envs/earthsim/lib/python3.6/site-packages/pony/orm/dbapiprovider.py in wrap_dbapi_exceptions(func, provider, *args, **kwargs)
     59     except dbapi_module.OperationalError as e:
     60         if provider.dialect == 'SQLite': provider.restore_exception()
---> 61         raise OperationalError(e)
     62     except dbapi_module.DataError as e: raise DataError(e)
     63     except dbapi_module.DatabaseError as e: raise DatabaseError(e)

OperationalError: no such column: Dataset.collection

Do I need to do something to reset my local caches/databases when updating quest?

sdc50 commented 5 years ago

@philippjfr The local error you're getting is because there is a change in the structure of the database. The easiest way to fix it is to delete your ~/Quest/projects dir (note: that will delete all of your projects and data).

I am baffled by the CI error. I'm not sure what is causing it, but I haven't had time to really dig in yet.

philippjfr commented 5 years ago

The local error you're getting is because there is a change in the structure of the database. The easiest way to fix it is to delete your ~/Quest/projects dir (note: that will delete all of your projects and data).

That fixed it. I'll dig into the CI error a bit.

philippjfr commented 5 years ago

Haven't had any luck trying to figure out the CI error unfortunately.

sdc50 commented 5 years ago

I think I figured out the CI error. It was a result of generating the Quest cache. I'm pushing a new version of Quest now. Once that's released I will update this PR and see if things pass.

philippjfr commented 5 years ago

Great to hear!

philippjfr commented 5 years ago

Latest errors are probably some issue with opencv.