GetDKAN / dkan

DKAN Open Data Portal
https://dkan.readthedocs.io/en/latest/index.html
GNU General Public License v2.0
365 stars 170 forks source link

Drush dkan-datastore:import Waiting #3652

Open mahmudinashar opened 2 years ago

mahmudinashar commented 2 years ago

Hi all, im new in dkan (and drupal). I just use dkan for a goverment to provide some open data and information to public.

I face some difficulties to check the progress of dkan import datastore.

What i do is :

  1. drush dkan-datastore:list, it say "waiting". But it's to long.
  2. I check through database, it say : status : error
  3. 1 check in drush queue:list , there is no queue in list.
`The same file tested in my local, running well and csv success parse to the database, but why not in prod`.
  1. I compare through drush core:status, both production and local is same (use same php 7.4, drupal 9.1.1 and same drush 10.5).

  2. I do drush dkan-datastore:import, no output/no error, but the status l of importing is still waiting.

this is the file https://filebin.net/5yh0ezwvaicf6dk5 this is the json that send to insert dataset via API : { "@type": "dcat:Dataset", "identifier": "3f64265aa-31b47f27e-82db489ec-144d5", "title": "Lorem Ipsum", "description": "Neque porro quisquam est qui dolorem ipsum quia dolor sit amet, consectetur, adipisci velit", "keyword": [ "PDPB", "TPS" ], "theme": [ "Adhoc" ], "accessLevel": "public", "issued": "2021-09-02", "modified": "2021-09-02", "publisher": { "@type": "org:Organization", "name": "Tekmas" }, "distribution": [ { "@type": "dcat:Distribution", "name": "test_csv", "status": "done", "downloadURL": "https://opendatadev.kpu.go.id/sites/default/files/files/1077dac30d8ba676b8960c6a62aea742.csv", "mediaType": "text/csv", "format": "csv", "title": "test_csv", "url": "https://opendatadev.kpu.go.id/sites/default/files/files/1077dac30d8ba676b8960c6a62aea742.csv" } ] }

Ask,

  1. What's the problem ?
  2. Correct way to check or step to trace the process of import data(csv).
  3. For example datastore name is datastore_6862ggsjHgj72837383, where does the name come from, and where (table) that show connection between dataset - query - datastore

Thanks for all your help! @fmizzell @dharizza

dafeder commented 1 year ago

Sorry @mahmudinashar I must have missed this. Is this still an issue?