NSLS-II / eiger-io

I/O tools for the Eiger detector
BSD 3-Clause "New" or "Revised" License
1 stars 9 forks source link

LazyEigerHandler for eiger data #4

Closed sameera2004 closed 8 years ago

sameera2004 commented 8 years ago

@danielballan Here I am adding the function you wrote to handle eiger data. @ericdill added a part to get the metadata from hdf5

sameera2004 commented 8 years ago

@danielballan ready for review

sameera2004 commented 8 years ago

@danielballan fixed it ready for review

sameera2004 commented 8 years ago

@ericdill fixed it

danielballan commented 8 years ago

@sameera2004 Almost ready. See one last comment.

It looks like we have converged around "True is a good pixel, False is a bad pixel." Unless anyone is pushing back, I will merge when Sameera fixes the syntax error.

sameera2004 commented 8 years ago

Sure, @danielballan I fixed it ready to review

sameera2004 commented 8 years ago

Thanks please let me know when you install new version in CHX then I can update the pipelines

danielballan commented 8 years ago

@tacaswell Any idea about this issue uploading a conda package to the internal binstar?

Uploading file dallan/eiger-io/v0.0.4/linux-64/eiger-io-v0.0.4-np19_0.tar.bz2 ... 
[ConnectionError] HTTPSConnectionPool(host='alexandria.cs.nsls2.local', port=8443): Max retries exceeded with url: /api/upload (Caused by ProxyError('Cannot connect to proxy.', error('Tunnel connection failed: 403 Access violation',))) 
Traceback (most recent call last):
  File "/home/dallan/mc/bin/binstar", line 6, in <module>
    sys.exit(main())
  File "/home/dallan/mc/lib/python2.7/site-packages/binstar_client/scripts/cli.py", line 94, in main
    description=__doc__, version=version)
  File "/home/dallan/mc/lib/python2.7/site-packages/binstar_client/scripts/cli.py", line 76, in binstar_main
    return args.main(args)
  File "/home/dallan/mc/lib/python2.7/site-packages/binstar_client/commands/upload.py", line 202, in main
    callback=upload_print_callback(args))
  File "/home/dallan/mc/lib/python2.7/site-packages/binstar_client/__init__.py", line 423, in upload
    s3res = requests.post(s3url, data=data_stream, verify=self.session.verify, timeout=10 * 60 * 60, headers=headers)
  File "/home/dallan/mc/lib/python2.7/site-packages/requests/api.py", line 109, in post
    return request('post', url, data=data, json=json, **kwargs)
  File "/home/dallan/mc/lib/python2.7/site-packages/requests/api.py", line 50, in request
    response = session.request(method=method, url=url, **kwargs)
  File "/home/dallan/mc/lib/python2.7/site-packages/requests/sessions.py", line 465, in request
    resp = self.send(prep, **send_kwargs)
  File "/home/dallan/mc/lib/python2.7/site-packages/requests/sessions.py", line 573, in send
    r = adapter.send(request, **kwargs)
  File "/home/dallan/mc/lib/python2.7/site-packages/requests/adapters.py", line 424, in send
    raise ConnectionError(e, request=request)
ConnectionError: HTTPSConnectionPool(host='alexandria.cs.nsls2.local', port=8443): Max retries exceeded with url: /api/upload (Caused by ProxyError('Cannot connect to proxy.', error('Tunnel connection failed: 403 Access violation',)))
ericdill commented 8 years ago

What machine are you trying to upload from?

On Tue, Nov 17, 2015, 7:30 AM Dan Allan notifications@github.com wrote:

@tacaswell https://github.com/tacaswell Any idea about this issue uploading a conda package to the internal binstar?

Uploading file dallan/eiger-io/v0.0.4/linux-64/eiger-io-v0.0.4-np19_0.tar.bz2 ... [ConnectionError] HTTPSConnectionPool(host='alexandria.cs.nsls2.local', port=8443): Max retries exceeded with url: /api/upload (Caused by ProxyError('Cannot connect to proxy.', error('Tunnel connection failed: 403 Access violation',))) Traceback (most recent call last): File "/home/dallan/mc/bin/binstar", line 6, in sys.exit(main()) File "/home/dallan/mc/lib/python2.7/site-packages/binstar_client/scripts/cli.py", line 94, in main description=doc, version=version) File "/home/dallan/mc/lib/python2.7/site-packages/binstar_client/scripts/cli.py", line 76, in binstar_main return args.main(args) File "/home/dallan/mc/lib/python2.7/site-packages/binstar_client/commands/upload.py", line 202, in main callback=upload_print_callback(args)) File "/home/dallan/mc/lib/python2.7/site-packages/binstar_client/init.py", line 423, in upload s3res = requests.post(s3url, data=data_stream, verify=self.session.verify, timeout=10 * 60 * 60, headers=headers) File "/home/dallan/mc/lib/python2.7/site-packages/requests/api.py", line 109, in post return request('post', url, data=data, json=json, _kwargs) File "/home/dallan/mc/lib/python2.7/site-packages/requests/api.py", line 50, in request response = session.request(method=method, url=url, _kwargs) File "/home/dallan/mc/lib/python2.7/site-packages/requests/sessions.py", line 465, in request resp = self.send(prep, _send_kwargs) File "/home/dallan/mc/lib/python2.7/site-packages/requests/sessions.py", line 573, in send r = adapter.send(request, _kwargs) File "/home/dallan/mc/lib/python2.7/site-packages/requests/adapters.py", line 424, in send raise ConnectionError(e, request=request) ConnectionError: HTTPSConnectionPool(host='alexandria.cs.nsls2.local', port=8443): Max retries exceeded with url: /api/upload (Caused by ProxyError('Cannot connect to proxy.', error('Tunnel connection failed: 403 Access violation',)))

— Reply to this email directly or view it on GitHub https://github.com/NSLS-II-CHX/eiger-io/pull/4#issuecomment-157357934.

tacaswell commented 8 years ago

That is a new one...

danielballan commented 8 years ago

@ericdill box64-1. I started on xf23id1-srv1 (remembering our discussion a week ago or so) but conda build failed on an even scarier error. I decided it was safer to switch to my user-installed conda installation on box64-1 rather than tinker with root conda on that production machine.

ericdill commented 8 years ago

Ok, I was thinking that thsi might be the issue where xf11id-srv1 has difficulty seeing our internal anaconda server, but the problem you are encountering is clearly different. I can also confirm that the error you reported above is happening to me too on xf23id-srv1 and xf11id-ws1.