Mises à jour de données manquantes #169

Open dthonon opened 3 years ago

In GitLab by @fred.lpo07 on Aug 17, 2021, 14:25

Certains mises à jour de données sont manquantes en bdd, alors qu'elles semblent bien avoir été transférées depuis l'API:

En exemple cette donnée de faune-auvergne.

Source:

https://www.faune-auvergne.org/index.php?m_id=54&id=5470288

Log:

transfer_vn.log.2021-08-11:2021-08-11 16:00:02,693 - DEBUG - transfer_vn.download_vn - Observation 5470288 was updated

en BDD:

SELECT
    id
  , site
  , to_timestamp(update_ts)
  , jsonb_pretty(item)
    FROM
        import_vn.observations_json
    WHERE
        id = 5470288
;

id : 5470288
site : vnauv
update_ts: 2021-05-06 13:01:49.000000 +00:00

item:

""date"": {
    ""@notime"": ""1"",
    ""@offset"": ""7200"",
    ""@timestamp"": ""1597615200""
},
""place"": {
    ""@id"": ""152271"",
    ""lat"": ""44.754888565784"",
    ""lon"": ""2.9354476885083"",
    ""name"": ""Puech de la Mousque"",
    ""place_type"": ""place"",
    ""id_universal"": ""65_94100606"",
    ""loc_precision"": ""0""
},
""species"": {
    ""@id"": ""397"",
    ""rarity"": ""common"",
    ""category"": ""H"",
    ""taxonomy"": ""1""
},
""observers"": [
    {
        ""@id"": ""32"",
        ""@uid"": ""15827"",
        ""count"": ""1"",
        ""traid"": ""32"",
        ""source"": ""MOBILE_LIVE"",
        ""timing"": {
            ""@notime"": ""0"",
            ""@offset"": ""7200"",
            ""@timestamp"": ""1597670956""
        },
        ""comment"": ""ABT Est cantal – SYTEC"",
        ""project"": ""34"",
        ""version"": ""0"",
        ""altitude"": ""1182"",
        ""coord_lat"": ""44.756803"",
        ""coord_lon"": ""2.935925"",
        ""precision"": ""precise"",
        ""id_sighting"": ""5470288"",
        ""insert_date"": ""1597673758"",
        ""update_date"": ""1620306109"",
        ""id_universal"": ""65_94100606"",
        ""project_code"": ""Pub"",
        ""coord_x_local"": 694929.0117102771,
        ""coord_y_local"": 6406409.400413934,
        ""flight_number"": ""1"",
        ""hidden_comment"": ""{\""updated\"": \""2021-05-06 13:04:39\"", \""op\"": \""replace\"", \""path\"": \""$['data']['sightings'][0]['observers'][0]['comment']\"", \""old\"": null, \""new\"": \""'ABT Est cantal – SYTEC'\""}"",
        ""estimation_code"": ""EXACT_VALUE""
    }
]
}

Pour être sûr de bien comprendre : la mise à jour de la table observations_json n'est pas effective (il manque le changement de code projet), alors que le message de DEBUG indique qu'elle a bien été mise à jour. Est-ce bien ça ?

dthonon / Client_API_VN

Mises à jour de données manquantes #169