search

google-code-export / ccc-gistemp

Automatically exported from code.google.com/p/ccc-gistemp
Other
0 stars 0 forks source link

Cannot use USHCN min/max temperature data. #82

Closed GoogleCodeExporter closed 9 years ago

GoogleCodeExporter commented 9 years ago 
The USHCN dataset has mean minimum and mean maximum temperature.  It's not 
possible to process these data using ccc-gistemp because of a mostly gratuitous 
check:

$ nice python tool/run.py -p data_sources=ushcn -s 0-2
====> STEPS 0, 1, 2  ====
Load USHCN records
Traceback (most recent call last):
  File "tool/run.py", line 280, in <module>
    sys.exit(main())
  File "tool/run.py", line 265, in main
    for _ in data:
  File "/Users/drj/ccc-gistemp/tool/giss_io.py", line 844, in step2_output
    for thing in data:
  File "/Users/drj/ccc-gistemp/code/step2.py", line 688, in step2
    for record in adjusted:
  File "/Users/drj/ccc-gistemp/code/step2.py", line 67, in urban_adjustments
    rural_stations, urban_stations, all = annotate_records(record_stream)
  File "/Users/drj/ccc-gistemp/code/step2.py", line 115, in annotate_records
    for record in stream:
  File "/Users/drj/ccc-gistemp/code/step2.py", line 678, in drop_short_records
    for record in record_source:
  File "/Users/drj/ccc-gistemp/tool/giss_io.py", line 833, in step1_output
    for thing in data:
  File "/Users/drj/ccc-gistemp/code/step1.py", line 636, in step1
    for record in alter_discont(without_strange):
  File "/Users/drj/ccc-gistemp/code/step1.py", line 606, in alter_discont
    for record in data:
  File "/Users/drj/ccc-gistemp/code/step1.py", line 559, in drop_strange
    for record in data:
  File "/Users/drj/ccc-gistemp/code/step1.py", line 512, in do_combine
    for id11, record_set in itertools.groupby(stream, lambda r: r.station_uid):
  File "/Users/drj/ccc-gistemp/code/step1.py", line 326, in adjust_helena
    for record in stream:
  File "/Users/drj/ccc-gistemp/code/step1.py", line 512, in do_combine
    for id11, record_set in itertools.groupby(stream, lambda r: r.station_uid):
  File "/Users/drj/ccc-gistemp/tool/giss_io.py", line 822, in step0_output
    for thing in data:
  File "/Users/drj/ccc-gistemp/code/step0.py", line 186, in step0
    data[source] = asdict(getattr(input, source))
  File "/Users/drj/ccc-gistemp/code/step0.py", line 169, in asdict
    return dict((record.uid, record) for record in records)
  File "/Users/drj/ccc-gistemp/code/step0.py", line 169, in <genexpr>
    return dict((record.uid, record) for record in records)
  File "/Users/drj/ccc-gistemp/tool/giss_io.py", line 661, in convert_USHCN_id
    for record in record_stream:
  File "/Users/drj/ccc-gistemp/tool/giss_io.py", line 676, in convert_F_to_C
    for record in record_stream:
  File "/Users/drj/ccc-gistemp/tool/giss_io.py", line 699, in read_USHCN
    assert line[6] == '3'
AssertionError

Original issue reported on code.google.com by d...@ravenbrook.com on 24 Aug 2010 at 9:28

GoogleCodeExporter commented 9 years ago 
This issue was closed by revision r514.

Original comment by d...@pobox.com on 24 Aug 2010 at 9:30