seeing one existing example regression from current tdatacube deployment

[shus2018]

per email threads,

I will add the regression to the issue lists for you to prioritize your time. 

Not sure if there are any schema changes, so I can alter examples accordingly for Oct. release.

Let me know if you want more debug info, thanks.

From: Shu Shi Sent: Monday, September 03, 2018 9:10 PM To: Chris Barber chrisba@alleninstitute.org; Nathaniel Middleton nathanielm@alleninstitute.org Subject: RE: More MEM needed for tdatacube in order to host human mtg service

No problem, I did see one regression from latest deployment. It was always working. Can you take a quick look? Do you have any schema changes?

curl -H "Content-Type:application/json" -d '{"procedure": "org.brain-map.api.datacube.conn_spatial_search", "args": [{"anterior_posterior": 7100, "superior_inferior": 3700, "left_right": 7800}], "kwargs": {"fields": ["experiment", "transgenic_line", "product_id"], "filters": [{"field": "volume", "coords": {"structure": 354, "injection": false, "hemisphere": "bilateral"}, "op": ">=", "value": 0.2}]}}' http://tdatacube:8080/call

Errors:

raise ValueError(\'index must be monotonic increasing or decreasing\')\nValueError: index must be monotonic increasing or decreasing\n\nDuring handling of the above exception, another exception occurred:\n\nTraceback (most recent call last):\n File "server.py", line 141, in conn_spatial_search\n res = yield threads.deferToThread(_ensure_computed, conn_datacube.raw, select=select, coords=coords, fields=fields, filters=filters)\n File "/local1/miniconda3/envs/datacube/lib/python3.6/site-packages/twisted/python/threadpool.py", line 250, in inContext\n result = inContext.theWork()\n File "/local1/miniconda3/envs/datacube/lib/python3.6/site-packages/twisted/python/threadpool.py", line 266, in \n inContext.theWork = lambda: context.call(ctx, func, *args, kw)\n File "/local1/miniconda3/envs/datacube/lib/python3.6/site-packages/twisted/python/context.py", line 122, in callWithContext\n return self.currentContext().callWithContext(ctx, func, *args, *kw)\n File "/local1/miniconda3/envs/datacube/lib/python3.6/site-packages/twisted/python/context.py", line 85, in callWithContext\n return func(args,kw)\n File "server.py", line 56, in _ensure_computed\n res = f(*args, kwargs)\n File "/local1/apps/datacube-builds/DataCube--223/services/pandas/datacube/datacube.py", line 547, in raw\n res = self._get_data(select, coords, fields, filters, dim_order)\n File "/local1/apps/datacube-builds/DataCube--223/services/pandas/datacube/datacube.py", line 502, in _get_data\n res = res.sel({dim: coord}, drop=drop)\n File "/local1/miniconda3/envs/datacube/lib/python3.6/site-packages/xarray/core/dataset.py", line 1509, in sel\n self, indexers=indexers, method=method, tolerance=tolerance)\n File "/local1/miniconda3/envs/datacube/lib/python3.6/site-packages/xarray/core/coordinates.py", line 355, in remap_label_indexers\n obj, v_indexers, method=method, tolerance=tolerance\n File "/local1/miniconda3/envs/datacube/lib/python3.6/site-packages/xarray/core/indexing.py", line 250, in remap_label_indexers\n dim, method, tolerance)\n File "/local1/miniconda3/envs/datacube/lib/python3.6/site-packages/xarray/core/indexing.py", line 189, in convert_label_indexer\n % index_name)\nKeyError: "not all values found in index \'ex

From: Chris Barber Sent: Monday, September 03, 2018 9:06 PM To: Nathaniel Middleton nathanielm@alleninstitute.org; Shu Shi shus@alleninstitute.org Subject: Re: More MEM needed for tdatacube in order to host human mtg service

Hi Shu, Sorry, forgot to mention that. I should disable human MTG for DATACUBE_ENV=test as well. I'm aware of the insufficient memory; David said not to prioritize it for now. Get Outlook for Android

---

From: Shu Shi Sent: Monday, September 3, 2018 8:51:46 PM To: Nathaniel Middleton Cc: Chris Barber Subject: More MEM needed for tdatacube in order to host human mtg service

Hi Nathaniel and Chris,

We need to add More MEM needed for tdatacube in order to host human mtg service.

I can’t get all the services running on tdatacube, I can get either conn or human mtg running not both together, I disabled human mtg for now.

Thanks,

Shu

[chrisbarber]

@shus2018 Thanks for catching and reporting this. Looks like this was broken by https://github.com/AllenInstitute/datacube/commit/26c6cc83b7d65ffc91af37263ba90731d6f1ceca which was committed in May but not made part of the external release.

[chrisbarber]

Fixed and merged to release.