search

socrata / datasync

Desktop / Console application for updating Socrata datasets automatically.
http://socrata.github.io/datasync/
MIT License
80 stars 33 forks source link

Logging for GIS Jobs #167

Closed levyj closed 7 years ago

levyj commented 7 years ago

I am not seeing logging for GIS jobs, as exists for Standard (tabular) jobs. Does it work differently or is there none visible to us?

I do see the jobs in https://data.cityofchicago.org/admin/activity_feed and that is of some help but really mostly just shows whether they succeeded at all. Also, that log is not (yet) enabled with many features to find jobs.

I was thinking more of https://data.cityofchicago.org/datasync/id/[4x4]/log/index, https://data.cityofchicago.org/datasync/id/[4x4]/status/index, and the Data Sync Log dataset we specify in the Data Sync preferences. I use these fairly frequently for Standard jobs but nothing was present for my GIS job.

If logging is not yet implemented, please take this issue as a request to add it.

Thanks!

Jon

CC @tomschenkjr @shua123

treycausey commented 7 years ago

Hi Jon,

Thanks for the question. I'm the new product manager on the publishing team here at Socrata. Unfortunately, GIS jobs will not appear is the DataSync logs as they do not use the same import API as standard jobs. We hope to add additional logging in the future. As GIS jobs are only full replaces for the time being, hopefully failures are not too difficult to diagnose, but if your jobs are failing, a job id is logged to the console by DataSync that you can provide to support.

Trey

levyj commented 7 years ago

Thanks, Trey. That makes sense. Adding logging would be nice. Among other things, it is a good record even of successful jobs. Nonetheless, I get not making the perfect the enemy of the good. Better to have the GIS job at all and build from there than hold off until everything is ready.

Jon

From: Trey Causey [mailto:notifications@github.com] Sent: Friday, January 13, 2017 3:56 PM To: socrata/datasync datasync@noreply.github.com Cc: Levy, Jonathan Jonathan.Levy@cityofchicago.org; Author author@noreply.github.com Subject: Re: [socrata/datasync] Logging for GIS Jobs (#167)

Hi Jon,

Thanks for the question. I'm the new product manager on the publishing team here at Socrata. Unfortunately, GIS jobs will not appear is the DataSync logs as they do not use the same import API as standard jobs. We hope to add additional logging in the future. As GIS jobs are only full replaces for the time being, hopefully failures are not too difficult to diagnose, but if your jobs are failing, a job id is logged to the console by DataSync that you can provide to support.

Trey

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHubhttps://github.com/socrata/datasync/issues/167#issuecomment-272558618, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AFQ6V0CK3jp7f8a2jZEE28nADolHte2Pks5rR_LxgaJpZM4LhIdm.

This e-mail, and any attachments thereto, is intended only for use by the addressee(s) named herein and may contain legally privileged and/or confidential information. If you are not the intended recipient of this e-mail (or the person responsible for delivering this document to the intended recipient), you are hereby notified that any dissemination, distribution, printing or copying of this e-mail, and any attachment thereto, is strictly prohibited. If you have received this e-mail in error, please respond to the individual sending the message, and permanently delete the original and any copy of any e-mail and printout thereof.