Pipeline Installation Manual

genghisken commented 9 years ago

Update the Pipeline installation manual to include all MacOSX flavours (>= Lion), Ubuntu 12.04 & 14.04, CentOS 6.6.

genghisken commented 9 years ago

These updates are now done. Now executing the tests. Note that the test data tarball is currently in a stupid place. It's also not obvious which tarball the user is supposed to download. They have to guess that it's the raw data one.

http://www.pessto.org/pessto/private/nightly_tarballs/2012.04/nightly_tarballs.html

Let's move it to somewhere sensible, or at least link the tarball directly.

Here's the output from PESSTOFASTSPEC. Seems OK to me...

PESSTOFASTSPEC EFOSC.2012-04-12T00:21:13.429.fits

####  image name = EFOSC.2012-04-12T00:21:13.429.fits

EFOSC.2012-04-12T00:21:13.429.fits -> tLSQ12btn_20120411_Gr13_Free_slit1.0_1.fits
cp: ./arc_20120825_Gr13_Free_slit1.0_56442_1.fits and arc_20120825_Gr13_Free_slit1.0_56442_1.fits are identical (not copied).

###     check in wavelengh performed ...... spectrum shifted of  14.4 Angstrom 

###      EXTRACTION USING IRAF TASK APALL 

tLSQ12btn_20120411_Gr13_Free_slit1.0_1_f.fits: LSQ12btn
  Extinction correction applied
  Flux calibration applied

#######################################
### end of reduction 
### output files:
tLSQ12btn_20120411_Gr13_Free_slit1.0_1_ex.fits
tLSQ12btn_20120411_Gr13_Free_slit1.0_1_f.fits
tLSQ12btn_20120411_Gr13_Free_slit1.0_1_2df.fits
tLSQ12btn_20120411_Gr13_Free_slit1.0_1_f.asci

Here's the output from PESSTOEFOSCPHOT. Is this right??

PESSTOEFOSCPHOT EFOSC.2012-04-21T01:53:28.893.fits

#####################################################################

### input EFOSC.2012-04-21T01:53:28.893.fits snunt121_20120420_B639
### bias  yes masterbias_20120121.fits
### flat  yes flat_20120411_B639.fits
### name  snunt121_20120420_B639_56982_1.fits

### bad pixel mask correction ..... done
Card is too long, comment will be truncated.
----- SExtractor 2.8.6 started on 2014-11-21 at 13:02:39 with 8 threads

Measuring from: "snunt121"  / 1008 x 1015 / 0 bits FLOATING POINT data
(M+D) Background: 337.218    RMS: 14.4783    / Threshold: 21.7175    
Objects: detected 259      / sextracted 172                    
> All done (in 1 s)
guess astrometry before starting 
#...ASU parameters being sent to vizier
#...ASU parameters being sent to vizier
#...ASU parameters being sent to vizier
9999
990 999 0 9999 9999 9999 999 999 -35.1736387458
guess astrometry before starting 
#...ASU parameters being sent to vizier
#...ASU parameters being sent to vizier
#...ASU parameters being sent to vizier
9999
990 999 0 9999 9999 9999 999 999 -35.1736387458
guess astrometry before starting 
#...ASU parameters being sent to vizier
#...ASU parameters being sent to vizier
#...ASU parameters being sent to vizier
9999
990 999 0 9999 9999 9999 999 999 -35.1736387458
guess astrometry before starting 
#...ASU parameters being sent to vizier
#...ASU parameters being sent to vizier
#...ASU parameters being sent to vizier
9999
990 999 0 9999 9999 9999 999 999 -35.1736387458
guess astrometry before starting 
#...ASU parameters being sent to vizier
#...ASU parameters being sent to vizier
#...ASU parameters being sent to vizier
9999
990 999 0 9999 9999 9999 999 999 -35.1736387458
guess astrometry before starting 
#...ASU parameters being sent to vizier
#...ASU parameters being sent to vizier
#...ASU parameters being sent to vizier
9999
990 999 0 9999 9999 9999 999 999 -35.1736387458
guess astrometry before starting 
#...ASU parameters being sent to vizier
#...ASU parameters being sent to vizier
#...ASU parameters being sent to vizier
9999
990 999 0 9999 9999 9999 999 999 -35.1736387458
guess astrometry before starting 
#...ASU parameters being sent to vizier
#...ASU parameters being sent to vizier
#...ASU parameters being sent to vizier
9999
990 999 0 9999 9999 9999 999 999 -35.1736387458
guess astrometry before starting 
#...ASU parameters being sent to vizier
#...ASU parameters being sent to vizier
#...ASU parameters being sent to vizier
9999
990 999 0 9999 9999 9999 999 999 -35.1736387458

### check astrometry: fine 
### rmsx rmsy nstars: 990 999 0
100.67729 -27.44717
calibration from default zero point
['snunt121_20120420_B639_56982_1.fits']

### adding keywords for phase 3 ........
Keyword name 'ESO DET OUT1 GAIN' is greater than 8 characters or or contains spaces; a HIERARCH card will be created.
Keyword name 'ESO DET OUT1 RON' is greater than 8 characters or or contains spaces; a HIERARCH card will be created.

### making a tar with pre-reduced frames ........ please wait

### tar file: logfile_phot_apr12_d20to20_efosc_201411211302.tar.gz
runnning time 60.8697941303

genghisken commented 9 years ago

I also suggest that we make the PESSTOFASTPEC task interactive (-i) in the tests so we can get an immediate idea of whether or not the Matplotlib graphics / IRAF screens are behaving correctly. (User just accepts the default answers or 'q')

genghisken commented 9 years ago

Try running the PESSTOEFOSCPHOT program again from work - just in case there were internet issues running this from home. Otherwise find an alternative file that works!
For PESSTOFASTSPEC change the instructions to run in interactive mode. No screenshots required for the manual - users should be familiar with IRAF!
Ditch the download link and upload the two test files to the wiki (assuming they definitely work).

genghisken commented 9 years ago

OK - I ran PESSTOEFOSCPHOT again - this time from WORK. It looks like EITHER

I can't contact vizier service from home

OR

The vizier service was down when I ran it last time.

I'll try again from home tonight. We may need to make users aware that only (e.g.) academic networks have access to the vizier service.

PESSTOEFOSCPHOT EFOSC.2012-04-21T01:53:28.893.fits

#####################################################################

### input EFOSC.2012-04-21T01:53:28.893.fits snunt121_20120420_B639
### bias  yes masterbias_20120121.fits
### flat  yes flat_20120411_B639.fits
### name  snunt121_20120420_B639_56985_1.fits

### bad pixel mask correction ..... done
Card is too long, comment will be truncated.
----- SExtractor 2.8.6 started on 2014-11-24 at 17:01:07 with 8 threads

Measuring from: "snunt121"  / 1008 x 1015 / 0 bits FLOATING POINT data
(M+D) Background: 337.218    RMS: 14.4783    / Threshold: 21.7175
Objects: detected 259      / sextracted 172                
> All done (in 0 s)
guess astrometry before starting
#...ASU parameters being sent to vizier

### update astrometry with non linear order
1.51758864
0.104 0.174 26 1.51758864 0.0885 9999 2.78e-05 2.78e-05 -16.0796262386

### check astrometry: fine
### rmsx rmsy nstars: 0.104 0.174 26
100.67729 -27.44717
calibration from default zero point
['snunt121_20120420_B639_56985_1.fits']

### adding keywords for phase 3 ........
Keyword name 'ESO DET OUT1 GAIN' is greater than 8 characters or or contains spaces; a HIERARCH card will be created.
Keyword name 'ESO DET OUT1 RON' is greater than 8 characters or or contains spaces; a HIERARCH card will be created.

### making a tar with pre-reduced frames ........ please wait

### tar file: logfile_phot_apr12_d20to20_efosc_201411241701.tar.gz
runnning time 9.71355295181

genghisken commented 9 years ago

I checked PESSTOEFOSCPHOT again from home. This time it worked OK, so I was probably just unlucky and the vizier service was probably down.

genghisken commented 9 years ago

Updates are now done. Will need to make a minor modification once the final release number is agreed.

svalenti / pessto

Pipeline Installation Manual #16