linked-swissbib / mfWorkflows

linked-swissbib workflows based on Metafacture
1 stars 0 forks source link

verbessertes logging im linking workflow #19

Open guenterh opened 6 years ago

guenterh commented 6 years ago

Aus dem Logging der aktuell genutzten Shellscripte ist häufig schlecht verständlich, wo und in welchem Kontext der Prozess sich befunden hat (und was die message damit genau bedeutet)

Mache die Messages aussagekräfiger und damit auch nachvollziehbarer für Dritte:

Beispiel für das aktuelle Logging: 2017-12-21 22:07:47,003 Tranformation and indexing finished. Took 0h 37m 41.571s 2017-12-21 22:07:47,003 Starting linking process 2017-12-21 22:07:47,003 Checking if file /swissbib_index/lsbPlatform/data/enrichedLineInput exists... OK 2017-12-21 22:07:47,003 Checking if file /swissbib_index/linking exists... OK 2017-12-21 22:32:12,643 Using settings for productive environment Importing data Importing ok. Filtering unwanted statements Filtering unwanted statements ok. Sort Sorting ok. Remove duplicate statements Remove duplicate statements ok. Extract persons Extract persons ok. Extract Organizations Extracting organizations ok. Filter persons 4 linking Filtering persons for linking ok. Block persons by last name Blocking persons by last name ok. Block persons by gnd identifier Blocking persons by gnd identifier ok. Preprocessing Swissbib ok. done Generating configuration files for interlinking whith DBpedia ok. Using settings for productive environment Waiting for processes