search

VertNet / gulo

Shredding Darwin Core Archives with ferocity, strength, and Cascalog.
7 stars 5 forks source link

update harvest with new gcs #108

Closed tucotuco closed 10 years ago

tucotuco commented 10 years ago

Write harvested files to new Google Cloud Storage account.

eightysteele commented 10 years ago

Yep, so send a PR editing this line: https://github.com/VertNet/gulo/blob/develop/src/clj/gulo/harvest.clj#L47

Change:

(def GS-PATH "gs://vn-staging/data")

to...

(def GS-PATH "gs://vn-harvest/data")

Also modify this line in the same PR: https://github.com/VertNet/gulo/blob/develop/resources/send_to_gcs.py#L64

Change:

cmd = "gsutil -m cp -R %s %s" % (local_base_dir, gs_base_path)

to...

cmd = "gsutil -p vertnet-portal -m cp -R %s %s" % (local_base_dir, gs_base_path)
tucotuco commented 10 years ago

Not sure of the commit that addressed this, but it has been working for months.