Failure fetching SDSS fpM image.

[wmwv]

Downloaded and installed latest LensTractor as of 2013/03/15.

I encountered running the sdss test that looks like an image couldn't be found. Error message follows:

---

[serenity tractor] python tractor-sdss-synth.py

Demo mode: grabbing Run/Camcol/Field/Band 1752/3/164/r Using SDSS DR9 data

cmd: gunzip -cd fpM-001752-r3-0164.fit.gz > fpM-001752-r3-0164.fit Command failed: command gunzip -cd fpM-001752-r3-0164.fit.gz > fpM-001752-r3-0164.fit Output: Error: gzip: fpM-001752-r3-0164.fit.gz: not in gzip format

Return val: -100 cmd: bunzip2 -cd frame-r-001752-3-0164.fits.bz2 > frame-r-001752-3-0164.fits cmd: gunzip -cd fpM-001752-r3-0164.fit.gz > fpM-001752-r3-0164.fit Command failed: command gunzip -cd fpM-001752-r3-0164.fit.gz > fpM-001752-r3-0164.fit Output: Error: gzip: fpM-001752-r3-0164.fit.gz: not in gzip format

Return val: -100 cmd: bunzip2 -cd frame-r-001752-3-0164.fits.bz2 > frame-r-001752-3-0164.fits Traceback (most recent call last): File "tractor-sdss-synth.py", line 470, in cProfile.run('main()', 'prof-%s.dat' % (datetime.now().isoformat())) File "/sw/lib/python2.7/cProfile.py", line 29, in run prof = prof.run(statement) File "/sw/lib/python2.7/cProfile.py", line 135, in run return self.runctx(cmd, dict, dict) File "/sw/lib/python2.7/cProfile.py", line 140, in runctx exec cmd in globals, locals File "", line 1, in File "tractor-sdss-synth.py", line 312, in main tim,tinf = getim(run, camcol, field, bandname, curl=opt.curl, roi=opt.roi, _imkw) File "/Users/wwoodvas/local/src/tractor/tractor/sdss.py", line 1011, in get_tractor_image_dr9 return get_tractor_image_dr8(_args, _kwargs) File "/Users/wwoodvas/local/src/tractor/tractor/sdss.py", line 779, in get_tractor_image_dr8 return _get_tractor_image_dr8(_args, _kwargs) File "/Users/wwoodvas/local/src/tractor/tractor/sdss.py", line 944, in _get_tractor_image_dr8 fpM = sdss.readFpM(run, camcol, field, bandname) File "/Users/wwoodvas/local/src/tractor/astrometry/sdss/dr7.py", line 97, in readFpM p = self._open(fn) File "/Users/wwoodvas/local/src/tractor/astrometry/sdss/common.py", line 223, in _open return pyfits.open(path) File "/sw/lib/python2.7/site-packages/pyfits-3.0.8-py2.7-macosx-10.7-x86_64.egg/pyfits/util.py", line 206, in _with_extensions_wrapper return func(_args, _kwargs) File "/sw/lib/python2.7/site-packages/pyfits-3.0.8-py2.7-macosx-10.7-x86_64.egg/pyfits/hdu/hdulist.py", line 106, in fitsopen return HDUList.fromfile(name, mode, memmap, *_kwargs) File "/sw/lib/python2.7/site-packages/pyfits-3.0.8-py2.7-macosx-10.7-x86_64.egg/pyfits/hdu/hdulist.py", line 278, in fromfile raise IOError('Empty or corrupt FITS file') IOError: Empty or corrupt FITS file

[serenity tractor] ls -l fpM-001752-r3-0164.fit.gz -rw-rw-r-- 1 wwoodvas staff 168 Mar 15 14:09 fpM-001752-r3-0164.fit.gz [serenity tractor] cat fpM-001752-r3-0164.fit.gz

404 Not Found

---

nginx/1.2.7

[drphilmarshall]

This looks like a Tractor test case, not a LensTractor test! Have you tried running LensTractor on the fits files in examples/? What made you think this was a recommended LT example?

On Fri, Mar 15, 2013 at 6:18 PM, wmwv notifications@github.com wrote:

Downloaded and installed latest LensTractor as of 2013/03/15.

I encountered running the sdss test that looks like an image couldn't be

found. Error message follows:

[serenity tractor] python tractor-sdss-synth.py

Demo mode: grabbing Run/Camcol/Field/Band 1752/3/164/r Using SDSS DR9 data

cmd: gunzip -cd fpM-001752-r3-0164.fit.gz > fpM-001752-r3-0164.fit Command failed: command gunzip -cd fpM-001752-r3-0164.fit.gz > fpM-001752-r3-0164.fit Output: Error: gzip: fpM-001752-r3-0164.fit.gz: not in gzip format

Return val: -100 cmd: bunzip2 -cd frame-r-001752-3-0164.fits.bz2 > frame-r-001752-3-0164.fits cmd: gunzip -cd fpM-001752-r3-0164.fit.gz > fpM-001752-r3-0164.fit Command failed: command gunzip -cd fpM-001752-r3-0164.fit.gz > fpM-001752-r3-0164.fit Output: Error: gzip: fpM-001752-r3-0164.fit.gz: not in gzip format

Return val: -100 cmd: bunzip2 -cd frame-r-001752-3-0164.fits.bz2 > frame-r-001752-3-0164.fits Traceback (most recent call last): File "tractor-sdss-synth.py", line 470, in cProfile.run('main()', 'prof-%s.dat' % (datetime.now().isoformat())) File "/sw/lib/python2.7/cProfile.py", line 29, in run prof = prof.run(statement) File "/sw/lib/python2.7/cProfile.py", line 135, in run return self.runctx(cmd, dict, dict) File "/sw/lib/python2.7/cProfile.py", line 140, in runctx exec cmd in globals, locals File "", line 1, in File "tractor-sdss-synth.py", line 312, in main tim,tinf = getim(run, camcol, field, bandname, curl=opt.curl, roi=opt.roi, _imkw) File "/Users/wwoodvas/local/src/tractor/tractor/sdss.py", line 1011, in get_tractor_image_dr9 return get_tractor_image_dr8(_args, _kwargs) File "/Users/wwoodvas/local/src/tractor/tractor/sdss.py", line 779, in get_tractor_image_dr8 return _get_tractor_image_dr8(_args, _kwargs) File "/Users/wwoodvas/local/src/tractor/tractor/sdss.py", line 944, in _get_tractor_image_dr8 fpM = sdss.readFpM(run, camcol, field, bandname) File "/Users/wwoodvas/local/src/tractor/astrometry/sdss/dr7.py", line 97, in readFpM p = self._open(fn) File "/Users/wwoodvas/local/src/tractor/astrometry/sdss/common.py", line 223, in _open return pyfits.open(path) File "/sw/lib/python2.7/site-packages/pyfits-3.0.8-py2.7-macosx-10.7-x86_64.egg/pyfits/util.py", line 206, in _with_extensions_wrapper return func(_args, _kwargs) File "/sw/lib/python2.7/site-packages/pyfits-3.0.8-py2.7-macosx-10.7-x86_64.egg/pyfits/hdu/hdulist.py", line 106, in fitsopen return HDUList.fromfile(name, mode, memmap, *_kwargs) File "/sw/lib/python2.7/site-packages/pyfits-3.0.8-py2.7-macosx-10.7-x86_64.egg/pyfits/hdu/hdulist.py", line 278, in fromfile raise IOError('Empty or corrupt FITS file') IOError: Empty or corrupt FITS file

[serenity tractor] ls -l fpM-001752-r3-0164.fit.gz -rw-rw-r-- 1 wwoodvas staff 168 Mar 15 14:09 fpM-001752-r3-0164.fit.gz [serenity tractor] cat fpM-001752-r3-0164.fit.gz

404 Not Found

404 Not Found

nginx/1.2.7

— Reply to this email directly or view it on GitHubhttps://github.com/davidwhogg/LensTractor/issues/10 .

[wmwv]

On Mar 15, 2013, at 11:28 , Phil Marshall notifications@github.com wrote:

This looks like a Tractor test case, not a LensTractor test! Have you tried running LensTractor on the fits files in examples/? What made you think this was a recommended LT example?

The Readme.md on

https://github.com/davidwhogg/LensTractor

• Michael

[drphilmarshall]

Ah yes, Dustin did recommend that.

On Fri, Mar 15, 2013 at 6:30 PM, wmwv notifications@github.com wrote:

On Mar 15, 2013, at 11:28 , Phil Marshall notifications@github.com wrote:

This looks like a Tractor test case, not a LensTractor test! Have you tried running LensTractor on the fits files in examples/? What made you think this was a recommended LT example?

The Readme.md on

https://github.com/davidwhogg/LensTractor

• Michael

— Reply to this email directly or view it on GitHubhttps://github.com/davidwhogg/LensTractor/issues/10#issuecomment-14977399 .

[dstndstn]

Yep, and it's a bona fide failure in the astrometry.net SDSS code, I think related to the recent nginx transition on data.sdss3.org. Aren't the problems we encounter in modern computing amazing?

That being said, this doesn't directly affect your use of the Tractor for LensTractor purposes, so you should be able to proceed to run any LensTractor test cases that exist.

[dstndstn]

Ok, I think I fixed that problem. Since that "install script" pulled down a live svn checkout, you should be able to update by going into the directory containing tractor-sdss-synth.py, and doing:

svn up
cd astrometry
svn up

cheers, dstn

[wmwv]

Hi Dustin,

Thanks. I tried it, but am not quite getting it to work. It may actually be an issue with data.sdss3.org. How can I switch to mirror.sdss3.org?

• Michael

[serenity tractor] svn up U tractor/sdss.py Updated to revision 22416. [serenity tractor] cd astrometry/ [serenity astrometry] svn up U sdss/dr8.py U util/index.c U util/index.h Updated to revision 22416. [serenity astrometry] cd ../ [serenity tractor] python tractor-sdss-synth.py

Demo mode: grabbing Run/Camcol/Field/Band 1752/3/164/r Using SDSS DR9 data

Looking for file photoObj-001752-3-0164.fits Failed to open file photoObj-001752-3-0164.fits as FITS file: maybe corrupt. Retrieving photoObj-001752-3-0164.fits

On Mar 15, 2013, at 12:29 , Dustin Lang notifications@github.com wrote:

Ok, I think I fixed that problem. Since that "install script" pulled down a live svn checkout, you should be able to update by going into the directory containing tractor-sdss-synth.py, and doing:

svn up cd astrometry svn up

cheers, dstn

— Reply to this email directly or view it on GitHub.

[wmwv]

Ah, found it. Changed

astrometry/sdss/dr9.py

self.dasurl = 'http://data.sdss3.org/sas/dr9/boss/'

    self.dasurl = 'http://mirror.sdss3.org/sas/dr9/boss/'

And now the test tractor script is running.

• Michael

On Mar 15, 2013, at 14:39 , Michael Wood-Vasey wmwv@pitt.edu wrote:

Hi Dustin,

Thanks. I tried it, but am not quite getting it to work. It may actually be an issue with data.sdss3.org. How can I switch to mirror.sdss3.org?

• Michael

[serenity tractor] svn up U tractor/sdss.py Updated to revision 22416. [serenity tractor] cd astrometry/ [serenity astrometry] svn up U sdss/dr8.py U util/index.c U util/index.h Updated to revision 22416. [serenity astrometry] cd ../ [serenity tractor] python tractor-sdss-synth.py

Demo mode: grabbing Run/Camcol/Field/Band 1752/3/164/r Using SDSS DR9 data

Looking for file photoObj-001752-3-0164.fits Failed to open file photoObj-001752-3-0164.fits as FITS file: maybe corrupt. Retrieving photoObj-001752-3-0164.fits

On Mar 15, 2013, at 12:29 , Dustin Lang notifications@github.com wrote:

Ok, I think I fixed that problem. Since that "install script" pulled down a live svn checkout, you should be able to update by going into the directory containing tractor-sdss-synth.py, and doing:

svn up cd astrometry svn up

cheers, dstn

— Reply to this email directly or view it on GitHub.