search

GSA / catalog.data.gov

Development environment for catalog.data.gov
https://catalog.data.gov
50 stars 15 forks source link

Stuck Harvest Jobs #802

Closed nickumia-reisys closed 1 year ago

nickumia-reisys commented 1 year ago

Workflow with Issue: Check Stuck Harvest Jobs on Schedule Job Failed: check-stuck-jobs Last Commit: 0937d2726809cf10f23f392eeffceae0fc8c2763 Number of times run: 1 Last run by: nickumia-reisys Github Action Run: https://github.com/GSA/catalog.data.gov/actions/runs/4220236219

nickumia-reisys commented 1 year ago 
total 12 stuck harvest jobs
source_id: 2303c37a-be67-4cbd-aa45-0dd34039b1ce | created_time: 2023-02-18 04:37:40.874999 | current_time: 2023-02-19 05:06:24.378868+00:00 | gather_started: None | gather_finished: None | running_length: 1 day, 0:28:43.503869 | source_title: NRC Data.json Harvest Source | organization: Nuclear Regulatory Commission
source_id: 89e2516b-042a-49e5-a7ff-601050456810 | created_time: 2023-02-18 04:49:16.644680 | current_time: 2023-02-19 05:06:24.378868+00:00 | gather_started: None | gather_finished: None | running_length: 1 day, 0:17:07.734188 | source_title: NARA Data.json | organization: National Archives and Records Administration
source_id: 38f3722d-48ce-4dbf-abde-941b707e5ad5 | created_time: 2023-02-18 04:58:32.588095 | current_time: 2023-02-19 05:06:24.378868+00:00 | gather_started: None | gather_finished: None | running_length: 1 day, 0:07:51.790773 | source_title: NEH Data.json | organization: National Endowment for the Humanities
source_id: 803bdba9-bfcb-453c-ae2a-ed81f240ff5a | created_time: 2023-02-18 04:58:32.774408 | current_time: 2023-02-19 05:06:24.378868+00:00 | gather_started: None | gather_finished: None | running_length: 1 day, 0:07:51.604460 | source_title: DHS datajson source | organization: Department of Homeland Security
source_id: 28b33837-be63-4613-b4d9-452b032fc031 | created_time: 2023-02-18 04:58:32.958645 | current_time: 2023-02-19 05:06:24.378868+00:00 | gather_started: None | gather_finished: None | running_length: 1 day, 0:07:51.420223 | source_title: SBA JSON | organization: Small Business Administration
source_id: dd483763-d1b3-4694-85ac-dd9398643efc | created_time: 2023-02-18 04:58:33.145811 | current_time: 2023-02-19 05:06:24.378868+00:00 | gather_started: None | gather_finished: None | running_length: 1 day, 0:07:51.233057 | source_title: NSF JSON | organization: National Science Foundation
source_id: 8cb0201c-9ee6-4d34-8f00-db0015b5d7e0 | created_time: 2023-02-18 04:58:33.326407 | current_time: 2023-02-19 05:06:24.378868+00:00 | gather_started: None | gather_finished: None | running_length: 1 day, 0:07:51.052461 | source_title: GSA JSON | organization: General Services Administration
source_id: c7055fc0-1a9a-4d45-82fb-b016b705ba89 | created_time: 2023-02-18 04:58:33.504958 | current_time: 2023-02-19 05:06:24.378868+00:00 | gather_started: None | gather_finished: None | running_length: 1 day, 0:07:50.873910 | source_title: RRB JSON | organization: Railroad Retirement Board
source_id: 81f6ae6e-c0d0-4e98-bb1b-04e323ef429e | created_time: 2023-02-18 04:58:33.697833 | current_time: 2023-02-19 05:06:24.378868+00:00 | gather_started: None | gather_finished: None | running_length: 1 day, 0:07:50.681035 | source_title: DOL JSON | organization: Department of Labor
source_id: 2a5c4dd8-eda9-4f03-abc3-fff8cfb80fc6 | created_time: 2023-02-18 04:58:33.981502 | current_time: 2023-02-19 05:06:24.378868+00:00 | gather_started: None | gather_finished: None | running_length: 1 day, 0:07:50.397366 | source_title: Education JSON | organization: Department of Education
source_id: 3290e90a-116f-42fc-86ac-e65521ef3b68 | created_time: 2023-02-18 04:58:34.183191 | current_time: 2023-02-19 05:06:24.378868+00:00 | gather_started: None | gather_finished: None | running_length: 1 day, 0:07:50.195677 | source_title: DOJ JSON | organization: Department of Justice
source_id: f77dd4c2-ab3d-4bc7-8b3f-2aaa2e411d70 | created_time: 2023-02-18 04:58:34.403065 | current_time: 2023-02-19 05:06:24.378868+00:00 | gather_started: None | gather_finished: None | running_length: 1 day, 0:07:49.975803 | source_title: Energy JSON | organization: Department of Energy
nickumia-reisys commented 1 year ago 
total 38 stuck harvest jobs
source_id: fcd1f625-1c2e-4663-95cf-1b0eb053cce1 | created_time: 2023-02-18 08:58:10.259934 | current_time: 2023-02-20 05:07:09.611909+00:00 | gather_started: None | gather_finished: None | running_length: 1 day, 20:08:59.351975 | source_title: VA JSON | organization: Department of Veterans Affairs
source_id: 2303c37a-be67-4cbd-aa45-0dd34039b1ce | created_time: 2023-02-18 04:37:40.874999 | current_time: 2023-02-20 05:07:09.611909+00:00 | gather_started: None | gather_finished: None | running_length: 2 days, 0:29:28.736910 | source_title: NRC Data.json Harvest Source | organization: Nuclear Regulatory Commission
source_id: bce99b55-29c1-47be-b214-b8e71e9180b1 | created_time: 2023-02-18 23:43:05.159888 | current_time: 2023-02-20 05:07:09.611909+00:00 | gather_started: None | gather_finished: None | running_length: 1 day, 5:24:04.452021 | source_title: Commerce Non Spatial Data.json Harvest Source | organization: Department of Commerce
source_id: 2762624f-7498-4ed8-a1cf-1c010ca6b6ea | created_time: 2023-02-19 02:43:42.699620 | current_time: 2023-02-20 05:07:09.611909+00:00 | gather_started: None | gather_finished: None | running_length: 1 day, 2:23:26.912289 | source_title: BLS Data | organization: U.S. Department of Labor Bureau of Labor Statistics
source_id: 89e2516b-042a-49e5-a7ff-601050456810 | created_time: 2023-02-18 04:49:16.644680 | current_time: 2023-02-20 05:07:09.611909+00:00 | gather_started: None | gather_finished: None | running_length: 2 days, 0:17:52.967229 | source_title: NARA Data.json | organization: National Archives and Records Administration
source_id: 38f3722d-48ce-4dbf-abde-941b707e5ad5 | created_time: 2023-02-18 04:58:32.588095 | current_time: 2023-02-20 05:07:09.611909+00:00 | gather_started: None | gather_finished: None | running_length: 2 days, 0:08:37.023814 | source_title: NEH Data.json | organization: National Endowment for the Humanities
source_id: 803bdba9-bfcb-453c-ae2a-ed81f240ff5a | created_time: 2023-02-18 04:58:32.774408 | current_time: 2023-02-20 05:07:09.611909+00:00 | gather_started: None | gather_finished: None | running_length: 2 days, 0:08:36.837501 | source_title: DHS datajson source | organization: Department of Homeland Security
source_id: 28b33837-be63-4613-b4d9-452b032fc031 | created_time: 2023-02-18 04:58:32.958645 | current_time: 2023-02-20 05:07:09.611909+00:00 | gather_started: None | gather_finished: None | running_length: 2 days, 0:08:36.653264 | source_title: SBA JSON | organization: Small Business Administration
source_id: dd483763-d1b3-4694-85ac-dd9398643efc | created_time: 2023-02-18 04:58:33.145811 | current_time: 2023-02-20 05:07:09.611909+00:00 | gather_started: None | gather_finished: None | running_length: 2 days, 0:08:36.466098 | source_title: NSF JSON | organization: National Science Foundation
source_id: 8cb0201c-9ee6-4d34-8f00-db0015b5d7e0 | created_time: 2023-02-18 04:58:33.326407 | current_time: 2023-02-20 05:07:09.611909+00:00 | gather_started: None | gather_finished: None | running_length: 2 days, 0:08:36.285502 | source_title: GSA JSON | organization: General Services Administration
source_id: c7055fc0-1a9a-4d45-82fb-b016b705ba89 | created_time: 2023-02-18 04:58:33.504958 | current_time: 2023-02-20 05:07:09.611909+00:00 | gather_started: None | gather_finished: None | running_length: 2 days, 0:08:36.106951 | source_title: RRB JSON | organization: Railroad Retirement Board
source_id: 81f6ae6e-c0d0-4e98-bb1b-04e323ef429e | created_time: 2023-02-18 04:58:33.697833 | current_time: 2023-02-20 05:07:09.611909+00:00 | gather_started: None | gather_finished: None | running_length: 2 days, 0:08:35.914076 | source_title: DOL JSON | organization: Department of Labor
source_id: 2a5c4dd8-eda9-4f03-abc3-fff8cfb80fc6 | created_time: 2023-02-18 04:58:33.981502 | current_time: 2023-02-20 05:07:09.611909+00:00 | gather_started: None | gather_finished: None | running_length: 2 days, 0:08:35.630407 | source_title: Education JSON | organization: Department of Education
source_id: 3290e90a-116f-42fc-86ac-e65521ef3b68 | created_time: 2023-02-18 04:58:34.183191 | current_time: 2023-02-20 05:07:09.611909+00:00 | gather_started: None | gather_finished: None | running_length: 2 days, 0:08:35.428718 | source_title: DOJ JSON | organization: Department of Justice
source_id: f77dd4c2-ab3d-4bc7-8b3f-2aaa2e411d70 | created_time: 2023-02-18 04:58:34.403065 | current_time: 2023-02-20 05:07:09.611909+00:00 | gather_started: None | gather_finished: None | running_length: 2 days, 0:08:35.208844 | source_title: Energy JSON | organization: Department of Energy
source_id: 05bfd86e-53da-4b07-a5b4-0693e88a7364 | created_time: 2023-02-18 05:58:17.763322 | current_time: 2023-02-20 05:07:09.611909+00:00 | gather_started: None | gather_finished: None | running_length: 1 day, 23:08:51.848587 | source_title: USDOT Geospatial Metadata | organization: Department of Transportation
source_id: d3fafa34-0cb9-48f1-ab1d-5b5fdc783806 | created_time: 2023-02-18 05:58:17.949071 | current_time: 2023-02-20 05:07:09.611909+00:00 | gather_started: None | gather_finished: None | running_length: 1 day, 23:08:51.662838 | source_title: USDA JSON | organization: Department of Agriculture
source_id: c98ee13b-1e1a-4350-a47e-1bf13aaa35d6 | created_time: 2023-02-18 05:58:18.172173 | current_time: 2023-02-20 05:07:09.611909+00:00 | gather_started: None | gather_finished: None | running_length: 1 day, 23:08:51.439736 | source_title: HUD JSON | organization: Department of Housing and Urban Development
source_id: 78a822a5-6dab-49bc-b983-acc830ad142a | created_time: 2023-02-18 05:58:18.391343 | current_time: 2023-02-20 05:07:09.611909+00:00 | gather_started: None | gather_finished: None | running_length: 1 day, 23:08:51.220566 | source_title: IMLS JSON | organization: Institute of Museum and Library Services
source_id: 0aeddf52-9cb0-4ab6-bc1f-b53172fe5348 | created_time: 2023-02-18 05:58:18.576089 | current_time: 2023-02-20 05:07:09.611909+00:00 | gather_started: None | gather_finished: None | running_length: 1 day, 23:08:51.035820 | source_title: USAID JSON | organization: US Agency for International Development
source_id: 9386406b-a7b0-4834-a267-0f912b6340db | created_time: 2023-02-18 05:58:18.816675 | current_time: 2023-02-20 05:07:09.611909+00:00 | gather_started: None | gather_finished: None | running_length: 1 day, 23:08:50.795234 | source_title: SSA JSON | organization: Social Security Administration
source_id: 4fea7182-f3b9-4158-b48c-f4bf6c230380 | created_time: 2023-02-18 05:58:19.074107 | current_time: 2023-02-20 05:07:09.611909+00:00 | gather_started: None | gather_finished: None | running_length: 1 day, 23:08:50.537802 | source_title: State JSON | organization: Department of State
source_id: eacdc0c3-6ae0-4b8b-b653-cbcb32fc9b71 | created_time: 2023-02-18 05:58:19.368514 | current_time: 2023-02-20 05:07:09.611909+00:00 | gather_started: None | gather_finished: None | running_length: 1 day, 23:08:50.243395 | source_title: Treasury JSON | organization: Department of the Treasury
source_id: 651e43b2-321c-4e4c-b86a-835cfc342cb0 | created_time: 2023-02-18 05:58:19.570602 | current_time: 2023-02-20 05:07:09.611909+00:00 | gather_started: None | gather_finished: None | running_length: 1 day, 23:08:50.041307 | source_title: Healthdata.gov | organization: U.S. Department of Health & Human Services
source_id: ee45e034-47c1-4a61-a3ec-de75031e6865 | created_time: 2023-02-18 05:58:19.879110 | current_time: 2023-02-20 05:07:09.611909+00:00 | gather_started: None | gather_finished: None | running_length: 1 day, 23:08:49.732799 | source_title: National Transportation Atlas Database (NTAD) Metadata | organization: Department of Transportation
source_id: 74e175d9-66b3-4323-ac98-e2a90eeb93c0 | created_time: 2023-02-19 03:04:18.046982 | current_time: 2023-02-20 05:07:09.611909+00:00 | gather_started: None | gather_finished: None | running_length: 1 day, 2:02:51.564927 | source_title: NIST | organization: National Institute of Standards and Technology
source_id: fa17348a-aa9f-4a73-b6b3-76dd0242ddb3 | created_time: 2023-02-19 03:04:18.265344 | current_time: 2023-02-20 05:07:09.611909+00:00 | gather_started: None | gather_finished: None | running_length: 1 day, 2:02:51.346565 | source_title: NIRTD JSON | organization: Networking and Information Technology Research and Development, Executive Office of the President
source_id: 7cbf9085-0290-4e9f-bec1-91653baeddfd | created_time: 2023-02-19 03:04:18.449856 | current_time: 2023-02-20 05:07:09.611909+00:00 | gather_started: None | gather_finished: None | running_length: 1 day, 2:02:51.162053 | source_title: OpenEI data.json | organization: Department of Energy
source_id: f475bc82-df84-4d61-a79e-59763f76c5a8 | created_time: 2023-02-19 03:04:18.720995 | current_time: 2023-02-20 05:07:09.611909+00:00 | gather_started: None | gather_finished: None | running_length: 1 day, 2:02:50.890914 | source_title: ARM data.json | organization: Department of Energy
source_id: f1a1d3f5-1041-4489-b24f-82e225c3a204 | created_time: 2023-02-19 03:04:18.935996 | current_time: 2023-02-20 05:07:09.611909+00:00 | gather_started: None | gather_finished: None | running_length: 1 day, 2:02:50.675913 | source_title: SEC data.json | organization: Securities and Exchange Commission
source_id: e492d010-f13c-424b-955a-01d737ae7e2d | created_time: 2023-02-19 03:04:19.137868 | current_time: 2023-02-20 05:07:09.611909+00:00 | gather_started: None | gather_finished: None | running_length: 1 day, 2:02:50.474041 | source_title: data.json | organization: Federal Trade Commission
source_id: a776e4b7-8221-443c-85ed-c5ee5db0c360 | created_time: 2023-02-19 03:04:19.335353 | current_time: 2023-02-20 05:07:09.611909+00:00 | gather_started: None | gather_finished: None | running_length: 1 day, 2:02:50.276556 | source_title: DOT Socrata Data.json | organization: Department of Transportation
source_id: 2228b51b-f6ea-4e22-88d0-3dca800a0246 | created_time: 2023-02-19 03:04:19.636060 | current_time: 2023-02-20 05:07:09.611909+00:00 | gather_started: None | gather_finished: None | running_length: 1 day, 2:02:49.975849 | source_title: FCC Data.json | organization: Federal Communications Commission
source_id: 04b59eaf-ae53-4066-93db-80f2ed0df446 | created_time: 2023-02-19 04:44:00.994647 | current_time: 2023-02-20 05:07:09.611909+00:00 | gather_started: None | gather_finished: None | running_length: 1 day, 0:23:08.617262 | source_title: EPA ScienceHub | organization: U.S. Environmental Protection Agency
source_id: 23cd936b-e509-46f3-af7f-71c4ab01a514 | created_time: 2023-02-19 04:44:01.229222 | current_time: 2023-02-20 05:07:09.611909+00:00 | gather_started: None | gather_finished: None | running_length: 1 day, 0:23:08.382687 | source_title: MCC Data.json | organization: Millennium Challenge Corporation
source_id: 1555b6f0-f7f7-4936-bc8e-5803b8c692c3 | created_time: 2023-02-19 04:44:01.423142 | current_time: 2023-02-20 05:07:09.611909+00:00 | gather_started: None | gather_finished: None | running_length: 1 day, 0:23:08.188767 | source_title: USITC Data.json Source | organization: US International Trade Commission
source_id: f96df1c6-6e98-4b72-beda-344021aa1270 | created_time: 2023-02-19 04:44:01.613958 | current_time: 2023-02-20 05:07:09.611909+00:00 | gather_started: None | gather_finished: None | running_length: 1 day, 0:23:07.997951 | source_title: PBGC Data.json Source | organization: Pension Benefit Guaranty Corporation
source_id: 3527fbdb-543e-447d-b062-54ef7c90041c | created_time: 2023-02-19 04:44:01.798095 | current_time: 2023-02-20 05:07:09.611909+00:00 | gather_started: None | gather_finished: None | running_length: 1 day, 0:23:07.813814 | source_title: GeoNode State CSW | organization: Department of State

Note: these are primarily due to the harvester being stuck.. the historical workaround has been to restart them, but it was broken, it is currently being worked on with,

nickumia-reisys commented 1 year ago

Thanks to @FuhuXia For getting the harvesting process going and allowing these jobs to complete

image

(Implied result: there were no real "stuck" jobs.)