search

doris-ffessm / doris-android

Other
1 stars 0 forks source link

créer un fichier log à part des erreur de prefectch #161

Open dvojtise opened 2 years ago

dvojtise commented 2 years ago

au bout des essais, certaines infos sont ignorées

ex: invalid classification

21-12-26 13:34:02 DEBUG - Fiche Daphnia longispina/76765 NOT in the db, modificationDate=1537789757 - at fr.ffessm.doris.prefetch.AbstractNodePrefetch.prefetch(AbstractNodePrefetch.java:155)
21-12-26 13:34:02 DEBUG - getSpecieFieldsFromNodeId - specieNodeId : 74243             - at fr.ffessm.doris.prefetch.ezpublish.DorisAPI_JSONDATABindingHelper.getEspeceFieldsFromNodeId(DorisAPI_JSONDATABindingHelper.java:121)
21-12-26 13:34:02 DEBUG - getSpecieFieldsFromNodeId - uri : https://doris.ffessm.fr/api/ezp/v1/content/node/74243/fields - at fr.ffessm.doris.prefetch.ezpublish.DorisAPI_JSONDATABindingHelper.getEspeceFieldsFromNodeId(DorisAPI_JSONDATABindingHelper.java:125)

     Référence : 1922
     Espece : longispina
21-12-26 13:34:02 DEBUG - add 11 SectionFiche related to this Fiche                    - at fr.ffessm.doris.prefetch.PrefetchFiches.updateSectionFicheForFiche(PrefetchFiches.java:154)
21-12-26 13:34:02 DEBUG - add 2 AutreDenomination related to this Fiche                - at fr.ffessm.doris.prefetch.PrefetchFiches.updateAutreDenominationForFiche(PrefetchFiches.java:185)
21-12-26 13:34:02 DEBUG - add 7 ClassificationFiche related to this Fiche              - at fr.ffessm.doris.prefetch.PrefetchFiches.updateClassificationForFiche(PrefetchFiches.java:243)
21-12-26 13:34:03 DEBUG - full uri : https://doris.ffessm.fr/api/ezx/v1/object/1767?oauth_token=c977aaf12f519c53081d70edd3010b3961bbfcc4 - at fr.ffessm.doris.prefetch.ezpublish.DorisAPIHTTPHelper.getHttpResponse(DorisAPIHTTPHelper.java:51)
21-12-26 13:34:03  WARN - HTTP/1.1 500 Internal Server Error : Retrying after 20s      - at fr.ffessm.doris.prefetch.ezpublish.DorisAPIHTTPHelper.getHttpResponse(DorisAPIHTTPHelper.java:53)

21-12-26 13:34:23 DEBUG - full uri : https://doris.ffessm.fr/api/ezx/v1/object/1767?oauth_token=c977aaf12f519c53081d70edd3010b3961bbfcc4 - at fr.ffessm.doris.prefetch.ezpublish.DorisAPIHTTPHelper.getHttpResponse(DorisAPIHTTPHelper.java:51)
21-12-26 13:34:23  WARN - HTTP/1.1 500 Internal Server Error : Retrying after 20s      - at fr.ffessm.doris.prefetch.ezpublish.DorisAPIHTTPHelper.getHttpResponse(DorisAPIHTTPHelper.java:53)

21-12-26 13:34:43 DEBUG - full uri : https://doris.ffessm.fr/api/ezx/v1/object/1767?oauth_token=c977aaf12f519c53081d70edd3010b3961bbfcc4 - at fr.ffessm.doris.prefetch.ezpublish.DorisAPIHTTPHelper.getHttpResponse(DorisAPIHTTPHelper.java:51)
21-12-26 13:34:43  WARN - HTTP/1.1 500 Internal Server Error : Retrying after 20s      - at fr.ffessm.doris.prefetch.ezpublish.DorisAPIHTTPHelper.getHttpResponse(DorisAPIHTTPHelper.java:53)

21-12-26 13:35:04 DEBUG - full uri : https://doris.ffessm.fr/api/ezx/v1/object/1767?oauth_token=c977aaf12f519c53081d70edd3010b3961bbfcc4 - at fr.ffessm.doris.prefetch.ezpublish.DorisAPIHTTPHelper.getHttpResponse(DorisAPIHTTPHelper.java:51)
21-12-26 13:35:04  WARN - HTTP/1.1 500 Internal Server Error : Retrying after 20s      - at fr.ffessm.doris.prefetch.ezpublish.DorisAPIHTTPHelper.getHttpResponse(DorisAPIHTTPHelper.java:53)

21-12-26 13:35:25 DEBUG - full uri : https://doris.ffessm.fr/api/ezx/v1/object/1767?oauth_token=c977aaf12f519c53081d70edd3010b3961bbfcc4 - at fr.ffessm.doris.prefetch.ezpublish.DorisAPIHTTPHelper.getHttpResponse(DorisAPIHTTPHelper.java:51)
21-12-26 13:35:25  WARN - HTTP/1.1 500 Internal Server Error : Retrying after 20s      - at fr.ffessm.doris.prefetch.ezpublish.DorisAPIHTTPHelper.getHttpResponse(DorisAPIHTTPHelper.java:53)

21-12-26 13:35:45 DEBUG - full uri : https://doris.ffessm.fr/api/ezx/v1/object/1767?oauth_token=c977aaf12f519c53081d70edd3010b3961bbfcc4 - at fr.ffessm.doris.prefetch.ezpublish.DorisAPIHTTPHelper.getHttpResponse(DorisAPIHTTPHelper.java:66)
21-12-26 13:35:45  WARN - HTTP/1.1 500 Internal Server Error : nbTries=5               - at fr.ffessm.doris.prefetch.ezpublish.DorisAPIHTTPHelper.getHttpResponse(DorisAPIHTTPHelper.java:67)
21-12-26 13:35:45  WARN - Ignoring invalid classification 1767 on the server https://doris.ffessm.fr/api/ezx/v1/object/1767 - at fr.ffessm.doris.prefetch.ezpublish.DorisAPI_JSONDATABindingHelper.getClassificationFieldsFromObjectId(DorisAPI_JSONDATABindingHelper.java:176)
fr.ffessm.doris.prefetch.WebSiteNotAvailableException: HTTP/1.1 500 Internal Server Error
    at fr.ffessm.doris.prefetch.ezpublish.DorisAPIHTTPHelper.getHttpResponse(DorisAPIHTTPHelper.java:68)
    at fr.ffessm.doris.prefetch.ezpublish.DorisAPI_JSONDATABindingHelper.getFieldsFromObjectId(DorisAPI_JSONDATABindingHelper.java:241)
    at fr.ffessm.doris.prefetch.ezpublish.DorisAPI_JSONDATABindingHelper.getClassificationFieldsFromObjectId(DorisAPI_JSONDATABindingHelper.java:160)
    at fr.ffessm.doris.prefetch.PrefetchFiches.updateClassificationForFiche(PrefetchFiches.java:258)
    at fr.ffessm.doris.prefetch.PrefetchFiches.postNodeCreation(PrefetchFiches.java:107)
    at fr.ffessm.doris.prefetch.PrefetchFiches.postNodeCreation(PrefetchFiches.java:37)
    at fr.ffessm.doris.prefetch.AbstractNodePrefetch.prefetch(AbstractNodePrefetch.java:178)
    at fr.ffessm.doris.prefetch.PrefetchDorisWebSite.webToDBAction(PrefetchDorisWebSite.java:339)
    at fr.ffessm.doris.prefetch.PrefetchDorisWebSite.doMain(PrefetchDorisWebSite.java:135)
    at fr.ffessm.doris.prefetch.PrefetchDorisWebSite.main(PrefetchDorisWebSite.java:108)

il serai préférable de les logguer à part dans un fichier facile à relire pour les traiter plus tard si besoin

Cela pourrai être fait facilement avec un logguer log4J qui sauve les warning dans un fichier ne plus de la console (nécessite aussi d'améliorer les messages warning pour retrouver plus facilement le contexte ex: la fiche qui référence la classification manquante/invalide). avec un archivage jenkins

dvojtise commented 2 years ago

mentioned in commit 55864e60709cad4093662582a9a2971567c7637e