search

google-code-export / ccc-gistemp

Automatically exported from code.google.com/p/ccc-gistemp
Other
0 stars 0 forks source link

Failure fetching 9641C_201002_F52.avg on Mac 10.5.8 using python 2.6.4 #46

Closed GoogleCodeExporter closed 9 years ago

GoogleCodeExporter commented 9 years ago 
What steps will reproduce the problem?
1. Run python ./tool/run.py where python --version = 2.6.4
2.
3.

What is the expected output? What do you see instead?
MISSING: input/9641C_201002_F52.avg
Attempting to fetch missing files: 9641C_201002_F52.avg
9641C_201002_F52.avg.gz
ftp://ftp.ncdc.noaa.gov/pub/data/ushcn/v2/monthly/9641C_201002_F52.avg.gz
Traceback (most recent call last):
  File "./tool/run.py", line 225, in <module>
    sys.exit(main())
  File "./tool/run.py", line 172, in main
    preflight.checkit(sys.stderr)
  File
"/Users/brian/SourceCode/ccc-gistemp-ro-2010-03-05/tool/preflight.py", line
98, in checkit
    fetch.main(argv=['fetch'] + missing)
  File "/Users/brian/SourceCode/ccc-gistemp-ro-2010-03-05/tool/fetch.py",
line 357, in main
    fetch(args)
  File "/Users/brian/SourceCode/ccc-gistemp-ro-2010-03-05/tool/fetch.py",
line 210, in fetch
    handler[hname](group, prefix, output)
  File "/Users/brian/SourceCode/ccc-gistemp-ro-2010-03-05/tool/fetch.py",
line 226, in fetch_url
    urllib.urlretrieve(place, local, progress_hook(output))
  File
"/Library/Frameworks/Python.framework/Versions/2.6/lib/python2.6/urllib.py", 
line
94, in urlretrieve
    return _urlopener.retrieve(url, filename, reporthook, data)
  File
"/Library/Frameworks/Python.framework/Versions/2.6/lib/python2.6/urllib.py", 
line
238, in retrieve
    fp = self.open(url, data)
  File
"/Library/Frameworks/Python.framework/Versions/2.6/lib/python2.6/urllib.py", 
line
206, in open
    return getattr(self, name)(url)
  File
"/Library/Frameworks/Python.framework/Versions/2.6/lib/python2.6/urllib.py", 
line
555, in open_ftp
    (fp, retrlen) = self.ftpcache[key].retrfile(file, type)
  File
"/Library/Frameworks/Python.framework/Versions/2.6/lib/python2.6/urllib.py", 
line
893, in retrfile
    self.ftp.cwd(file)
  File
"/Library/Frameworks/Python.framework/Versions/2.6/lib/python2.6/ftplib.py", 
line
537, in cwd
    return self.voidcmd(cmd)
  File
"/Library/Frameworks/Python.framework/Versions/2.6/lib/python2.6/ftplib.py", 
line
248, in voidcmd
    return self.voidresp()
  File
"/Library/Frameworks/Python.framework/Versions/2.6/lib/python2.6/ftplib.py", 
line
223, in voidresp
    resp = self.getresp()
  File
"/Library/Frameworks/Python.framework/Versions/2.6/lib/python2.6/ftplib.py", 
line
218, in getresp
    raise error_perm, resp
IOError: [Errno ftp error] [Errno ftp error] 550 9641C_201002_F52.avg.gz:
No such file or directory

What version of the product are you using? On what operating system?
svn checkout on 2010-03-05 on OS X 10.5.8 with Python 2.6.4

Please provide any additional information below.

Original issue reported on code.google.com by bcrou...@gmail.com on 6 Mar 2010 at 2:54

GoogleCodeExporter commented 9 years ago 
(Code works fine when I run it on Python 2.5.1)

Original comment by bcrou...@gmail.com on 6 Mar 2010 at 2:55

GoogleCodeExporter commented 9 years ago 
Same as issue 44.  Please try again with revision 350.

Original comment by nick.bar...@gmail.com on 6 Mar 2010 at 3:32

GoogleCodeExporter commented 9 years ago 
Sorry for the dupe- will try again-

Original comment by bcrou...@gmail.com on 6 Mar 2010 at 4:29

GoogleCodeExporter commented 9 years ago 
@bcrounse: Are you sure it worked with Python 2.5.1?  That seems very 
surprising.

Original comment by d...@ravenbrook.com on 8 Mar 2010 at 2:21

GoogleCodeExporter commented 9 years ago 
Yes- I went back through the history and verified that I did indeed run it with
2.5.1.  It worked; here's the google-chart.url:

$ cat google-chart.url 

http://chart.apis.google.com/chart?cht=lc&chds=-100,100&chd=t:-28,-21,-26,-28,-3
2,-32,-29,-36,-27,-17,-39,-27,-31,-33,-33,-25,-15,-11,-25,-15,-7,-14,-24,-30,-35
,-24,-18,-39,-33,-35,-33,-34,-32,-30,-15,-9,-30,-39,-33,-19,-19,-15,-26,-22,-21,
-17,-2,-15,-12,-26,-8,-2,-8,-19,-7,-12,-5,7,10,1,5,10,3,9,20,6,-5,1,-4,-7,-16,-3
,3,11,-10,-10,-17,8,9,6,0,8,4,8,-21,-11,-3,-1,-4,8,3,-10,0,14,-8,-5,-16,12,1,9,1
8,26,5,26,9,5,12,26,31,19,37,34,12,13,23,37,29,39,56,31,32,47,55,54,47,62,54,56,
44,57,-999&chxt=x,y,r&chxl=0:|1880||||||||||1890||||||||||1900||||||||||1910||||
||||||1920||||||||||1930||||||||||1940||||||||||1950||||||||||1960||||||||||1970
||||||||||1980||||||||||1990||||||||||2000||||||||||2010|1:||-0.5|+0.0|+0.5||2:|
|-0.5|+0.0|+0.5|&chco=ff0000,000000&chs=600x500

The funny thing is that it won't run now- 

$ /usr/bin/python ./tool/run.py 
MISSING: input/mcdw.tbl
MISSING: input/sumofday.tbl
MISSING: input/v2.inv
MISSING: input/oisstv2_mod4.clim.gz
MISSING: input/9641C_201002_F52.avg
Attempting to fetch missing files: mcdw.tbl sumofday.tbl v2.inv 
oisstv2_mod4.clim.gz
9641C_201002_F52.avg
Extracting members from
http://data.giss.nasa.gov/gistemp/sources/GISTEMP_sources.tar.gz ...
  ... finished extracting
9641C_201002_F52.avg.gz
ftp://ftp.ncdc.noaa.gov/pub/data/ushcn/v2/monthly/9641C_201002_F52.avg.gz
  0
MISSING: input/mcdw.tbl
MISSING: input/sumofday.tbl
MISSING: input/v2.inv
MISSING: input/oisstv2_mod4.clim.gz
MISSING: input/9641C_201002_F52.avg
PROBLEM: Tried fetching missing files but it didn't work.
====> STEPS 0 to 5  ====
Traceback (most recent call last):
  File "./tool/run.py", line 225, in <module>
    sys.exit(main())
  File "./tool/run.py", line 206, in main
    data = step_fn[step](data)
  File "./tool/run.py", line 56, in run_step0
    data = giss_io.step0_input()
  File "/Users/brian/SourceCode/ccc-gistemp-ro-2010-03-05/tool/giss_io.py", line 655,
in step0_input
    "input/t_hohenpeissenberg_200306.txt_as_received_July17_2003")
  File "/Users/brian/SourceCode/ccc-gistemp-ro-2010-03-05/tool/giss_io.py", line 606,
in read_hohenpeissenberg
    record = code.giss_data.StationRecord('617109620002')
  File "/Users/brian/SourceCode/ccc-gistemp-ro-2010-03-05/code/giss_data.py", line
584, in __init__
    self.source = v2_sources().get(uid, "UNKNOWN")
  File "/Users/brian/SourceCode/ccc-gistemp-ro-2010-03-05/code/giss_data.py", line
185, in v2_sources
    _v2_sources = read_config.v2_get_sources()
  File "/Users/brian/SourceCode/ccc-gistemp-ro-2010-03-05/code/read_config.py", line
23, in v2_get_sources
    for line in open('input/%s.tbl' % source.lower()):
IOError: [Errno 2] No such file or directory: 'input/mcdw.tbl'

Rather than being a time sink for you all, I'm going to lay low for awhile and 
try
again in a few more revs...

Original comment by bcrou...@gmail.com on 9 Mar 2010 at 3:26

GoogleCodeExporter commented 9 years ago 
Looks like you deleted your inputs at some point, and when you came to try the 
second time, NOAA had 
renamed the USHCN v2 file, so we couldn't fetch it.  It really should work with 
a current SVN version, or you can 
wait only a very short time for our 0.4.0 release.  Or you can fetch the USHCN 
file by hand and rename it.

Original comment by d...@pobox.com on 9 Mar 2010 at 11:01

GoogleCodeExporter commented 9 years ago 
I'll keep plugging away.  At some point I'll move beyond being a time-sucking 
n00b-

Original comment by bcrou...@gmail.com on 9 Mar 2010 at 2:29

GoogleCodeExporter commented 9 years ago 
The underlying issue was never fully resolved but I believe that ccc-gistemp 
works on all reasonable Python versions, and that it correctly finds and 
downloads USHCN data.

I'm closing this as WontFix, please raise another issue if it strikes again.

Original comment by d...@ravenbrook.com on 18 Aug 2010 at 9:51