FIWARE / context.Orion-LD

Context Broker and CEF building block for context data management which supports both the NGSI-LD and the NGSI-v2 APIs
https://www.etsi.org/deliver/etsi_gs/CIM/001_099/009/01.06.01_60/gs_CIM009v010601p.pdf
GNU Affero General Public License v3.0
50 stars 43 forks source link

there is a problem with the timestamp "creDate: -1.0" in Orion-LD version 1.15 #457

Open FR-ADDIX opened 4 years ago

FR-ADDIX commented 4 years ago

When creating data as array as "/entityOperations/upsert" request there are some errors:

creDate: -1.0 is wrong

root@orion-ld:/tmp# tail -f orionld.log | grep lvl=ERROR
time=2020-04-20T16:50:44.798Z | lvl=ERROR | corr=N/A | trans=N/A | from=N/A | srv=N/A | subsrv=N/A | comp=Orion | op=safeMongo.cpp[265]:getIntOrLongFieldAsLong | msg=Runtime Error (field 'creDate' was supposed to be int or long but type=1 in BSONObj <{ _id: { id: "urn:ngsi-ld:WeatherObserved:BMP180:14851", type: "https://uri.fiware.org/ns/data-models#WeatherObserved", servicePath: "/" }, creDate: -1.0 }> from caller mongoCppLegacyEntityListLookupWithIdTypeCreDate:111)

kzangeli commented 4 years ago

This is a bug. I am half-aware of this. Could you please give me the exact request used when creating/updating the entity (entities)?

FR-ADDIX commented 4 years ago

This query triggers the error. Unfortunately I cannot directly access the appropriate logs for this query

The Request:

curl --location --request POST 'https://contextld.2019.smartmaas.services/ngsi-ld/v1/entityOperations/upsert' \ --header 'fiware-service: smartmaas001' \ --header 'fiware-servicepath: /' \ --header 'Content-Type: application/json' \ --header 'Accept: application/ld+json' \ --header 'Link: https://schema.lab.fiware.org/ld/context; rel="http://www.w3.org/ns/json-ld#context"; type="application/ld+json"' \ --header 'Content-Type: application/json' \ --data-raw '[{"type":"WeatherObserved","dataProvider":{"type":"Property","value":"sensor.community"},"source":{"type":"Property","value":"https://data.sensor.community/airrohr/v1/filter/country=DE&type=BMP180"},"stationName":{"type":"Property","value":"BMP180:15845"},"location":{"type":"GeoProperty","value":{"type":"Point","coordinates":[13.466,52.498]}},"id":"urn:ngsi-ld:WeatherObserved:BMP180:15845","temperature":{"observedAt":"2020-04-29T15:12:04Z","type":"Property","value":23.9},"atmosphericPressure":{"observedAt":"2020-04-29T15:12:04Z","type":"Property","value":1000.94}},{"type":"WeatherObserved","dataProvider":{"type":"Property","value":"sensor.community"},"source":{"type":"Property","value":"https://data.sensor.community/airrohr/v1/filter/country=DE&type=BMP180"},"stationName":{"type":"Property","value":"BMP180:3076"},"location":{"type":"GeoProperty","value":{"type":"Point","coordinates":[12.344,51.326]}},"id":"urn:ngsi-ld:WeatherObserved:BMP180:3076","temperature":{"observedAt":"2020-04-29T15:12:04Z","type":"Property","value":20.0},"atmosphericPressure":{"observedAt":"2020-04-29T15:12:04Z","type":"Property","value":991.4}},{"type":"WeatherObserved","dataProvider":{"type":"Property","value":"sensor.community"},"source":{"type":"Property","value":"https://data.sensor.community/airrohr/v1/filter/country=DE&type=BMP180"},"stationName":{"type":"Property","value":"BMP180:16956"},"location":{"type":"GeoProperty","value":{"type":"Point","coordinates":[8.354,52.052]}},"id":"urn:ngsi-ld:WeatherObserved:BMP180:16956","temperature":{"observedAt":"2020-04-29T15:12:04Z","type":"Property","value":18.6},"atmosphericPressure":{"observedAt":"2020-04-29T15:12:04Z","type":"Property","value":995.72}},{"type":"WeatherObserved","dataProvider":{"type":"Property","value":"sensor.community"},"source":{"type":"Property","value":"https://data.sensor.community/airrohr/v1/filter/country=DE&type=BMP180"},"stationName":{"type":"Property","value":"BMP180:10058"},"location":{"type":"GeoProperty","value":{"type":"Point","coordinates":[7.518,51.286]}},"id":"urn:ngsi-ld:WeatherObserved:BMP180:10058","temperature":{"observedAt":"2020-04-29T15:12:04Z","type":"Property","value":20.0},"atmosphericPressure":{"observedAt":"2020-04-29T15:12:04Z","type":"Property","value":983.72}},{"type":"WeatherObserved","dataProvider":{"type":"Property","value":"sensor.community"},"source":{"type":"Property","value":"https://data.sensor.community/airrohr/v1/filter/country=DE&type=BMP180"},"stationName":{"type":"Property","value":"BMP180:9985"},"location":{"type":"GeoProperty","value":{"type":"Point","coordinates":[6.78,50.932]}},"id":"urn:ngsi-ld:WeatherObserved:BMP180:9985","temperature":{"observedAt":"2020-04-29T15:12:04Z","type":"Property","value":21.3},"atmosphericPressure":{"observedAt":"2020-04-29T15:12:04Z","type":"Property","value":992.89}},{"type":"WeatherObserved","dataProvider":{"type":"Property","value":"sensor.community"},"source":{"type":"Property","value":"https://data.sensor.community/airrohr/v1/filter/country=DE&type=BMP180"},"stationName":{"type":"Property","value":"BMP180:13219"},"location":{"type":"GeoProperty","value":{"type":"Point","coordinates":[11.918,49.152]}},"id":"urn:ngsi-ld:WeatherObserved:BMP180:13219","temperature":{"observedAt":"2020-04-29T15:12:03Z","type":"Property","value":13.92},"atmosphericPressure":{"observedAt":"2020-04-29T15:12:03Z","type":"Property","value":953.1433999999999}},{"type":"WeatherObserved","dataProvider":{"type":"Property","value":"sensor.community"},"source":{"type":"Property","value":"https://data.sensor.community/airrohr/v1/filter/country=DE&type=BMP180"},"stationName":{"type":"Property","value":"BMP180:20092"},"location":{"type":"GeoProperty","value":{"type":"Point","coordinates":[6.56,49.678]}},"id":"urn:ngsi-ld:WeatherObserved:BMP180:20092","temperature":{"observedAt":"2020-04-29T15:12:03Z","type":"Property","value":22.2},"atmosphericPressure":{"observedAt":"2020-04-29T15:12:03Z","type":"Property","value":990.26}},{"type":"WeatherObserved","dataProvider":{"type":"Property","value":"sensor.community"},"source":{"type":"Property","value":"https://data.sensor.community/airrohr/v1/filter/country=DE&type=BMP180"},"stationName":{"type":"Property","value":"BMP180:10999"},"location":{"type":"GeoProperty","value":{"type":"Point","coordinates":[13.606,51.122]}},"id":"urn:ngsi-ld:WeatherObserved:BMP180:10999","temperature":{"observedAt":"2020-04-29T15:12:03Z","type":"Property","value":24.7},"atmosphericPressure":{"observedAt":"2020-04-29T15:12:03Z","type":"Property","value":990.71}},{"type":"WeatherObserved","dataProvider":{"type":"Property","value":"sensor.community"},"source":{"type":"Property","value":"https://data.sensor.community/airrohr/v1/filter/country=DE&type=BMP180"},"stationName":{"type":"Property","value":"BMP180:41038"},"location":{"type":"GeoProperty","value":{"type":"Point","coordinates":[10.046,53.606]}},"id":"urn:ngsi-ld:WeatherObserved:BMP180:41038","temperature":{"observedAt":"2020-04-29T15:12:02Z","type":"Property","value":20.7},"atmosphericPressure":{"observedAt":"2020-04-29T15:12:02Z","type":"Property","value":1004.04}},{"type":"WeatherObserved","dataProvider":{"type":"Property","value":"sensor.community"},"source":{"type":"Property","value":"https://data.sensor.community/airrohr/v1/filter/country=DE&type=BMP180"},"stationName":{"type":"Property","value":"BMP180:14784"},"location":{"type":"GeoProperty","value":{"type":"Point","coordinates":[12.138,50.498]}},"id":"urn:ngsi-ld:WeatherObserved:BMP180:14784","temperature":{"observedAt":"2020-04-29T15:12:00Z","type":"Property","value":16.1},"atmosphericPressure":{"observedAt":"2020-04-29T15:12:00Z","type":"Property","value":960.39}},{"type":"WeatherObserved","dataProvider":{"type":"Property","value":"sensor.community"},"source":{"type":"Property","value":"https://data.sensor.community/airrohr/v1/filter/country=DE&type=BMP180"},"stationName":{"type":"Property","value":"BMP180:33267"},"location":{"type":"GeoProperty","value":{"type":"Point","coordinates":[11.896,49.08]}},"id":"urn:ngsi-ld:WeatherObserved:BMP180:33267","temperature":{"observedAt":"2020-04-29T15:11:57Z","type":"Property","value":18.2},"atmosphericPressure":{"observedAt":"2020-04-29T15:11:57Z","type":"Property","value":955.6}},{"type":"WeatherObserved","dataProvider":{"type":"Property","value":"sensor.community"},"source":{"type":"Property","value":"https://data.sensor.community/airrohr/v1/filter/country=DE&type=BMP180"},"stationName":{"type":"Property","value":"BMP180:18219"},"location":{"type":"GeoProperty","value":{"type":"Point","coordinates":[11.12,49.344]}},"id":"urn:ngsi-ld:WeatherObserved:BMP180:18219","temperature":{"observedAt":"2020-04-29T15:11:56Z","type":"Property","value":24.2},"atmosphericPressure":{"observedAt":"2020-04-29T15:11:56Z","type":"Property","value":967.05}},{"type":"WeatherObserved","dataProvider":{"type":"Property","value":"sensor.community"},"source":{"type":"Property","value":"https://data.sensor.community/airrohr/v1/filter/country=DE&type=BMP180"},"stationName":{"type":"Property","value":"BMP180:20289"},"location":{"type":"GeoProperty","value":{"type":"Point","coordinates":[8.372,51.96]}},"id":"urn:ngsi-ld:WeatherObserved:BMP180:20289","temperature":{"observedAt":"2020-04-29T15:11:54Z","type":"Property","value":19.3},"atmosphericPressure":{"observedAt":"2020-04-29T15:11:54Z","type":"Property","value":994.53}},{"type":"WeatherObserved","dataProvider":{"type":"Property","value":"sensor.community"},"source":{"type":"Property","value":"https://data.sensor.community/airrohr/v1/filter/country=DE&type=BMP180"},"stationName":{"type":"Property","value":"BMP180:10556"},"location":{"type":"GeoProperty","value":{"type":"Point","coordinates":[7.388,51.522]}},"id":"urn:ngsi-ld:WeatherObserved:BMP180:10556","temperature":{"observedAt":"2020-04-29T15:11:52Z","type":"Property","value":18.34},"atmosphericPressure":{"observedAt":"2020-04-29T15:11:52Z","type":"Property","value":995.6834}},{"type":"WeatherObserved","dataProvider":{"type":"Property","value":"sensor.community"},"source":{"type":"Property","value":"https://data.sensor.community/airrohr/v1/filter/country=DE&type=BMP180"},"stationName":{"type":"Property","value":"BMP180:19666"},"location":{"type":"GeoProperty","value":{"type":"Point","coordinates":[7.772,51.02]}},"id":"urn:ngsi-ld:WeatherObserved:BMP180:19666","temperature":{"observedAt":"2020-04-29T15:11:50Z","type":"Property","value":20.5},"atmosphericPressure":{"observedAt":"2020-04-29T15:11:50Z","type":"Property","value":965.56}},{"type":"WeatherObserved","dataProvider":{"type":"Property","value":"sensor.community"},"source":{"type":"Property","value":"https://data.sensor.community/airrohr/v1/filter/country=DE&type=BMP180"},"stationName":{"type":"Property","value":"BMP180:16664"},"location":{"type":"GeoProperty","value":{"type":"Point","coordinates":[9.434,51.27]}},"id":"urn:ngsi-ld:WeatherObserved:BMP180:16664","temperature":{"observedAt":"2020-04-29T15:11:47Z","type":"Property","value":19.0},"atmosphericPressure":{"observedAt":"2020-04-29T15:11:47Z","type":"Property","value":981.83}},{"type":"WeatherObserved","dataProvider":{"type":"Property","value":"sensor.community"},"source":{"type":"Property","value":"https://data.sensor.community/airrohr/v1/filter/country=DE&type=BMP180"},"stationName":{"type":"Property","value":"BMP180:20308"},"location":{"type":"GeoProperty","value":{"type":"Point","coordinates":[13.206,52.434]}},"id":"urn:ngsi-ld:WeatherObserved:BMP180:20308","temperature":{"observedAt":"2020-04-29T15:11:46Z","type":"Property","value":16.6},"atmosphericPressure":{"observedAt":"2020-04-29T15:11:46Z","type":"Property","value":999.97}},{"type":"WeatherObserved","dataProvider":{"type":"Property","value":"sensor.community"},"source":{"type":"Property","value":"https://data.sensor.community/airrohr/v1/filter/country=DE&type=BMP180"},"stationName":{"type":"Property","value":"BMP180:19948"},"location":{"type":"GeoProperty","value":{"type":"Point","coordinates":[7.276,50.702]}},"id":"urn:ngsi-ld:WeatherObserved:BMP180:19948","temperature":{"observedAt":"2020-04-29T15:11:43Z","type":"Property","value":22.0},"atmosphericPressure":{"observedAt":"2020-04-29T15:11:43Z","type":"Property","value":984.55}},{"type":"WeatherObserved","dataProvider":{"type":"Property","value":"sensor.community"},"source":{"type":"Property","value":"https://data.sensor.community/airrohr/v1/filter/country=DE&type=BMP180"},"stationName":{"type":"Property","value":"BMP180:8227"},"location":{"type":"GeoProperty","value":{"type":"Point","coordinates":[9.012,48.81]}},"id":"urn:ngsi-ld:WeatherObserved:BMP180:8227","temperature":{"observedAt":"2020-04-29T15:11:39Z","type":"Property","value":19.4},"atmosphericPressure":{"observedAt":"2020-04-29T15:11:39Z","type":"Property","value":963.0}},{"type":"WeatherObserved","dataProvider":{"type":"Property","value":"sensor.community"},"source":{"type":"Property","value":"https://data.sensor.community/airrohr/v1/filter/country=DE&type=BMP180"},"stationName":{"type":"Property","value":"BMP180:14023"},"location":{"type":"GeoProperty","value":{"type":"Point","coordinates":[11.58,48.116]}},"id":"urn:ngsi-ld:WeatherObserved:BMP180:14023","temperature":{"observedAt":"2020-04-29T15:11:34Z","type":"Property","value":20.5},"atmosphericPressure":{"observedAt":"2020-04-29T15:11:34Z","type":"Property","value":946.75}},{"type":"WeatherObserved","dataProvider":{"type":"Property","value":"sensor.community"},"source":{"type":"Property","value":"https://data.sensor.community/airrohr/v1/filter/country=DE&type=BMP180"},"stationName":{"type":"Property","value":"BMP180:31565"},"location":{"type":"GeoProperty","value":{"type":"Point","coordinates":[11.216,48.038]}},"id":"urn:ngsi-ld:WeatherObserved:BMP180:31565","temperature":{"observedAt":"2020-04-29T15:11:28Z","type":"Property","value":22.2},"atmosphericPressure":{"observedAt":"2020-04-29T15:11:28Z","type":"Property","value":946.92}},{"type":"WeatherObserved","dataProvider":{"type":"Property","value":"sensor.community"},"source":{"type":"Property","value":"https://data.sensor.community/airrohr/v1/filter/country=DE&type=BMP180"},"stationName":{"type":"Property","value":"BMP180:12000"},"location":{"type":"GeoProperty","value":{"type":"Point","coordinates":[9.954,51.52]}},"id":"urn:ngsi-ld:WeatherObserved:BMP180:12000","temperature":{"observedAt":"2020-04-29T15:11:26Z","type":"Property","value":-143.27},"atmosphericPressure":{"observedAt":"2020-04-29T15:11:26Z","type":"Property","value":507.0531}},{"type":"WeatherObserved","dataProvider":{"type":"Property","value":"sensor.community"},"source":{"type":"Property","value":"https://data.sensor.community/airrohr/v1/filter/country=DE&type=BMP180"},"stationName":{"type":"Property","value":"BMP180:20058"},"location":{"type":"GeoProperty","value":{"type":"Point","coordinates":[7.906,49.546]}},"id":"urn:ngsi-ld:WeatherObserved:BMP180:20058","temperature":{"observedAt":"2020-04-29T15:11:26Z","type":"Property","value":18.7},"atmosphericPressure":{"observedAt":"2020-04-29T15:11:26Z","type":"Property","value":972.64}},{"type":"WeatherObserved","dataProvider":{"type":"Property","value":"sensor.community"},"source":{"type":"Property","value":"https://data.sensor.community/airrohr/v1/filter/country=DE&type=BMP180"},"stationName":{"type":"Property","value":"BMP180:13570"},"location":{"type":"GeoProperty","value":{"type":"Point","coordinates":[7.158,51.46]}},"id":"urn:ngsi-ld:WeatherObserved:BMP180:13570","temperature":{"observedAt":"2020-04-29T15:11:26Z","type":"Property","value":20.8},"atmosphericPressure":{"observedAt":"2020-04-29T15:11:26Z","type":"Property","value":994.14}},{"type":"WeatherObserved","dataProvider":{"type":"Property","value":"sensor.community"},"source":{"type":"Property","value":"https://data.sensor.community/airrohr/v1/filter/country=DE&type=BMP180"},"stationName":{"type":"Property","value":"BMP180:33877"},"location":{"type":"GeoProperty","value":{"type":"Point","coordinates":[7.158,51.738]}},"id":"urn:ngsi-ld:WeatherObserved:BMP180:33877","temperature":{"observedAt":"2020-04-29T15:11:25Z","type":"Property","value":17.2},"atmosphericPressure":{"observedAt":"2020-04-29T15:11:25Z","type":"Property","value":999.68}},{"type":"WeatherObserved","dataProvider":{"type":"Property","value":"sensor.community"},"source":{"type":"Property","value":"https://data.sensor.community/airrohr/v1/filter/country=DE&type=BMP180"},"stationName":{"type":"Property","value":"BMP180:13778"},"location":{"type":"GeoProperty","value":{"type":"Point","coordinates":[9.42,48.682]}},"id":"urn:ngsi-ld:WeatherObserved:BMP180:13778","temperature":{"observedAt":"2020-04-29T15:11:24Z","type":"Property","value":18.4},"atmosphericPressure":{"observedAt":"2020-04-29T15:11:24Z","type":"Property","value":972.17}},{"type":"WeatherObserved","dataProvider":{"type":"Property","value":"sensor.community"},"source":{"type":"Property","value":"https://data.sensor.community/airrohr/v1/filter/country=DE&type=BMP180"},"stationName":{"type":"Property","value":"BMP180:15935"},"location":{"type":"GeoProperty","value":{"type":"Point","coordinates":[11.384,48.776]}},"id":"urn:ngsi-ld:WeatherObserved:BMP180:15935","temperature":{"observedAt":"2020-04-29T15:11:23Z","type":"Property","value":24.3},"atmosphericPressure":{"observedAt":"2020-04-29T15:11:23Z","type":"Property","value":967.44}},{"type":"WeatherObserved","dataProvider":{"type":"Property","value":"sensor.community"},"source":{"type":"Property","value":"https://data.sensor.community/airrohr/v1/filter/country=DE&type=BMP180"},"stationName":{"type":"Property","value":"BMP180:12061"},"location":{"type":"GeoProperty","value":{"type":"Point","coordinates":[6.88,51.432]}},"id":"urn:ngsi-ld:WeatherObserved:BMP180:12061","temperature":{"observedAt":"2020-04-29T15:11:22Z","type":"Property","value":23.7},"atmosphericPressure":{"observedAt":"2020-04-29T15:11:22Z","type":"Property","value":999.5}},{"type":"WeatherObserved","dataProvider":{"type":"Property","value":"sensor.community"},"source":{"type":"Property","value":"https://data.sensor.community/airrohr/v1/filter/country=DE&type=BMP180"},"stationName":{"type":"Property","value":"BMP180:15333"},"location":{"type":"GeoProperty","value":{"type":"Point","coordinates":[6.722,51.534]}},"id":"urn:ngsi-ld:WeatherObserved:BMP180:15333","temperature":{"observedAt":"2020-04-29T15:11:21Z","type":"Property","value":19.66},"atmosphericPressure":{"observedAt":"2020-04-29T15:11:21Z","type":"Property","value":998.9944}},{"type":"WeatherObserved","dataProvider":{"type":"Property","value":"sensor.community"},"source":{"type":"Property","value":"https://data.sensor.community/airrohr/v1/filter/country=DE&type=BMP180"},"stationName":{"type":"Property","value":"BMP180:15544"},"location":{"type":"GeoProperty","value":{"type":"Point","coordinates":[12.856,52.23]}},"id":"urn:ngsi-ld:WeatherObserved:BMP180:15544","temperature":{"observedAt":"2020-04-29T15:11:20Z","type":"Property","value":23.3},"atmosphericPressure":{"observedAt":"2020-04-29T15:11:20Z","type":"Property","value":997.6013}},{"type":"WeatherObserved","dataProvider":{"type":"Property","value":"sensor.community"},"source":{"type":"Property","value":"https://data.sensor.community/airrohr/v1/filter/country=DE&type=BMP180"},"stationName":{"type":"Property","value":"BMP180:11792"},"location":{"type":"GeoProperty","value":{"type":"Point","coordinates":[9.918,52.372]}},"id":"urn:ngsi-ld:WeatherObserved:BMP180:11792","temperature":{"observedAt":"2020-04-29T15:11:17Z","type":"Property","value":19.2},"atmosphericPressure":{"observedAt":"2020-04-29T15:11:17Z","type":"Property","value":997.07}},{"type":"WeatherObserved","dataProvider":{"type":"Property","value":"sensor.community"},"source":{"type":"Property","value":"https://data.sensor.community/airrohr/v1/filter/country=DE&type=BMP180"},"stationName":{"type":"Property","value":"BMP180:21336"},"location":{"type":"GeoProperty","value":{"type":"Point","coordinates":[13.432,52.536]}},"id":"urn:ngsi-ld:WeatherObserved:BMP180:21336","temperature":{"observedAt":"2020-04-29T15:11:15Z","type":"Property","value":24.8},"atmosphericPressure":{"observedAt":"2020-04-29T15:11:15Z","type":"Property","value":999.78}},{"type":"WeatherObserved","dataProvider":{"type":"Property","value":"sensor.community"},"source":{"type":"Property","value":"https://data.sensor.community/airrohr/v1/filter/country=DE&type=BMP180"},"stationName":{"type":"Property","value":"BMP180:15845"},"location":{"type":"GeoProperty","value":{"type":"Point","coordinates":[13.466,52.498]}},"id":"urn:ngsi-ld:WeatherObserved:BMP180:15845","temperature":{"observedAt":"2020-04-29T15:11:12Z","type":"Property","value":23.9},"atmosphericPressure":{"observedAt":"2020-04-29T15:11:12Z","type":"Property","value":1000.9}},{"type":"WeatherObserved","dataProvider":{"type":"Property","value":"sensor.community"},"source":{"type":"Property","value":"https://data.sensor.community/airrohr/v1/filter/country=DE&type=BMP180"},"stationName":{"type":"Property","value":"BMP180:41276"},"location":{"type":"GeoProperty","value":{"type":"Point","coordinates":[12.912,47.718]}},"id":"urn:ngsi-ld:WeatherObserved:BMP180:41276","temperature":{"observedAt":"2020-04-29T15:11:06Z","type":"Property","value":12.1},"atmosphericPressure":{"observedAt":"2020-04-29T15:11:06Z","type":"Property","value":945.17}},{"type":"WeatherObserved","dataProvider":{"type":"Property","value":"sensor.community"},"source":{"type":"Property","value":"https://data.sensor.community/airrohr/v1/filter/country=DE&type=BMP180"},"stationName":{"type":"Property","value":"BMP180:41371"},"location":{"type":"GeoProperty","value":{"type":"Point","coordinates":[10.878,48.344]}},"id":"urn:ngsi-ld:WeatherObserved:BMP180:41371","temperature":{"observedAt":"2020-04-29T15:11:04Z","type":"Property","value":17.1},"atmosphericPressure":{"observedAt":"2020-04-29T15:11:04Z","type":"Property","value":951.17}},{"type":"WeatherObserved","dataProvider":{"type":"Property","value":"sensor.community"},"source":{"type":"Property","value":"https://data.sensor.community/airrohr/v1/filter/country=DE&type=BMP180"},"stationName":{"type":"Property","value":"BMP180:6454"},"location":{"type":"GeoProperty","value":{"type":"Point","coordinates":[13.502,52.438]}},"id":"urn:ngsi-ld:WeatherObserved:BMP180:6454","temperature":{"observedAt":"2020-04-29T15:11:03Z","type":"Property","value":23.6},"atmosphericPressure":{"observedAt":"2020-04-29T15:11:03Z","type":"Property","value":983.47}},{"type":"WeatherObserved","dataProvider":{"type":"Property","value":"sensor.community"},"source":{"type":"Property","value":"https://data.sensor.community/airrohr/v1/filter/country=DE&type=BMP180"},"stationName":{"type":"Property","value":"BMP180:11424"},"location":{"type":"GeoProperty","value":{"type":"Point","coordinates":[7.21,51.476]}},"id":"urn:ngsi-ld:WeatherObserved:BMP180:11424","temperature":{"observedAt":"2020-04-29T15:10:56Z","type":"Property","value":21.9},"atmosphericPressure":{"observedAt":"2020-04-29T15:10:56Z","type":"Property","value":992.78}},{"type":"WeatherObserved","dataProvider":{"type":"Property","value":"sensor.community"},"source":{"type":"Property","value":"https://data.sensor.community/airrohr/v1/filter/country=DE&type=BMP180"},"stationName":{"type":"Property","value":"BMP180:8903"},"location":{"type":"GeoProperty","value":{"type":"Point","coordinates":[6.478,51.232]}},"id":"urn:ngsi-ld:WeatherObserved:BMP180:8903","temperature":{"observedAt":"2020-04-29T15:10:56Z","type":"Property","value":19.1},"atmosphericPressure":{"observedAt":"2020-04-29T15:10:56Z","type":"Property","value":999.32}},{"type":"WeatherObserved","dataProvider":{"type":"Property","value":"sensor.community"},"source":{"type":"Property","value":"https://data.sensor.community/airrohr/v1/filter/country=DE&type=BMP180"},"stationName":{"type":"Property","value":"BMP180:7389"},"location":{"type":"GeoProperty","value":{"type":"Point","coordinates":[11.062,50.136]}},"id":"urn:ngsi-ld:WeatherObserved:BMP180:7389","temperature":{"observedAt":"2020-04-29T15:10:55Z","type":"Property","value":18.0},"atmosphericPressure":{"observedAt":"2020-04-29T15:10:55Z","type":"Property","value":972.29}},{"type":"WeatherObserved","dataProvider":{"type":"Property","value":"sensor.community"},"source":{"type":"Property","value":"https://data.sensor.community/airrohr/v1/filter/country=DE&type=BMP180"},"stationName":{"type":"Property","value":"BMP180:13254"},"location":{"type":"GeoProperty","value":{"type":"Point","coordinates":[10.132,54.37]}},"id":"urn:ngsi-ld:WeatherObserved:BMP180:13254","temperature":{"observedAt":"2020-04-29T15:10:54Z","type":"Property","value":-131.9},"atmosphericPressure":{"observedAt":"2020-04-29T15:10:54Z","type":"Property","value":-209.0469}},{"type":"WeatherObserved","dataProvider":{"type":"Property","value":"sensor.community"},"source":{"type":"Property","value":"https://data.sensor.community/airrohr/v1/filter/country=DE&type=BMP180"},"stationName":{"type":"Property","value":"BMP180:8441"},"location":{"type":"GeoProperty","value":{"type":"Point","coordinates":[7.818,48.568]}},"id":"urn:ngsi-ld:WeatherObserved:BMP180:8441","temperature":{"observedAt":"2020-04-29T15:10:54Z","type":"Property","value":22.0},"atmosphericPressure":{"observedAt":"2020-04-29T15:10:54Z","type":"Property","value":993.14}},{"type":"WeatherObserved","dataProvider":{"type":"Property","value":"sensor.community"},"source":{"type":"Property","value":"https://data.sensor.community/airrohr/v1/filter/country=DE&type=BMP180"},"stationName":{"type":"Property","value":"BMP180:11483"},"location":{"type":"GeoProperty","value":{"type":"Point","coordinates":[6.748,51.662]}},"id":"urn:ngsi-ld:WeatherObserved:BMP180:11483","temperature":{"observedAt":"2020-04-29T15:10:52Z","type":"Property","value":18.5},"atmosphericPressure":{"observedAt":"2020-04-29T15:10:52Z","type":"Property","value":1001.06}},{"type":"WeatherObserved","dataProvider":{"type":"Property","value":"sensor.community"},"source":{"type":"Property","value":"https://data.sensor.community/airrohr/v1/filter/country=DE&type=BMP180"},"stationName":{"type":"Property","value":"BMP180:12918"},"location":{"type":"GeoProperty","value":{"type":"Point","coordinates":[13.092,54.312]}},"id":"urn:ngsi-ld:WeatherObserved:BMP180:12918","temperature":{"observedAt":"2020-04-29T15:10:52Z","type":"Property","value":11.0},"atmosphericPressure":{"observedAt":"2020-04-29T15:10:52Z","type":"Property","value":1008.22}},{"type":"WeatherObserved","dataProvider":{"type":"Property","value":"sensor.community"},"source":{"type":"Property","value":"https://data.sensor.community/airrohr/v1/filter/country=DE&type=BMP180"},"stationName":{"type":"Property","value":"BMP180:22906"},"location":{"type":"GeoProperty","value":{"type":"Point","coordinates":[8.518,50.14]}},"id":"urn:ngsi-ld:WeatherObserved:BMP180:22906","temperature":{"observedAt":"2020-04-29T15:10:49Z","type":"Property","value":19.2},"atmosphericPressure":{"observedAt":"2020-04-29T15:10:49Z","type":"Property","value":982.3}},{"type":"WeatherObserved","dataProvider":{"type":"Property","value":"sensor.community"},"source":{"type":"Property","value":"https://data.sensor.community/airrohr/v1/filter/country=DE&type=BMP180"},"stationName":{"type":"Property","value":"BMP180:16528"},"location":{"type":"GeoProperty","value":{"type":"Point","coordinates":[11.542,48.15]}},"id":"urn:ngsi-ld:WeatherObserved:BMP180:16528","temperature":{"observedAt":"2020-04-29T15:10:49Z","type":"Property","value":22.15},"atmosphericPressure":{"observedAt":"2020-04-29T15:10:49Z","type":"Property","value":950.055}},{"type":"WeatherObserved","dataProvider":{"type":"Property","value":"sensor.community"},"source":{"type":"Property","value":"https://data.sensor.community/airrohr/v1/filter/country=DE&type=BMP180"},"stationName":{"type":"Property","value":"BMP180:31565"},"location":{"type":"GeoProperty","value":{"type":"Point","coordinates":[11.216,48.038]}},"id":"urn:ngsi-ld:WeatherObserved:BMP180:31565","temperature":{"observedAt":"2020-04-29T15:10:48Z","type":"Property","value":22.2},"atmosphericPressure":{"observedAt":"2020-04-29T15:10:48Z","type":"Property","value":946.94}},{"type":"WeatherObserved","dataProvider":{"type":"Property","value":"sensor.community"},"source":{"type":"Property","value":"https://data.sensor.community/airrohr/v1/filter/country=DE&type=BMP180"},"stationName":{"type":"Property","value":"BMP180:8125"},"location":{"type":"GeoProperty","value":{"type":"Point","coordinates":[8.356,50.012]}},"id":"urn:ngsi-ld:WeatherObserved:BMP180:8125","temperature":{"observedAt":"2020-04-29T15:10:46Z","type":"Property","value":17.89},"atmosphericPressure":{"observedAt":"2020-04-29T15:10:46Z","type":"Property","value":990.7156}},{"type":"WeatherObserved","dataProvider":{"type":"Property","value":"sensor.community"},"source":{"type":"Property","value":"https://data.sensor.community/airrohr/v1/filter/country=DE&type=BMP180"},"stationName":{"type":"Property","value":"BMP180:22828"},"location":{"type":"GeoProperty","value":{"type":"Point","coordinates":[13.418,52.562]}},"id":"urn:ngsi-ld:WeatherObserved:BMP180:22828","temperature":{"observedAt":"2020-04-29T15:10:43Z","type":"Property","value":23.1},"atmosphericPressure":{"observedAt":"2020-04-29T15:10:43Z","type":"Property","value":996.69}},{"type":"WeatherObserved","dataProvider":{"type":"Property","value":"sensor.community"},"source":{"type":"Property","value":"https://data.sensor.community/airrohr/v1/filter/country=DE&type=BMP180"},"stationName":{"type":"Property","value":"BMP180:15803"},"location":{"type":"GeoProperty","value":{"type":"Point","coordinates":[13.448,52.512]}},"id":"urn:ngsi-ld:WeatherObserved:BMP180:15803","temperature":{"observedAt":"2020-04-29T15:10:37Z","type":"Property","value":24.7},"atmosphericPressure":{"observedAt":"2020-04-29T15:10:37Z","type":"Property","value":1000.6}},{"type":"WeatherObserved","dataProvider":{"type":"Property","value":"sensor.community"},"source":{"type":"Property","value":"https://data.sensor.community/airrohr/v1/filter/country=DE&type=BMP180"},"stationName":{"type":"Property","value":"BMP180:17469"},"location":{"type":"GeoProperty","value":{"type":"Point","coordinates":[13.434,52.544]}},"id":"urn:ngsi-ld:WeatherObserved:BMP180:17469","temperature":{"observedAt":"2020-04-29T15:10:35Z","type":"Property","value":23.6},"atmosphericPressure":{"observedAt":"2020-04-29T15:10:35Z","type":"Property","value":999.38}}]'

The Result:

{ "@context": "https://schema.lab.fiware.org/ld/context", "success": [ "urn:ngsi-ld:WeatherObserved:BMP180:15845", "urn:ngsi-ld:WeatherObserved:BMP180:3076", "urn:ngsi-ld:WeatherObserved:BMP180:16956", "urn:ngsi-ld:WeatherObserved:BMP180:10058", "urn:ngsi-ld:WeatherObserved:BMP180:9985", "urn:ngsi-ld:WeatherObserved:BMP180:13219", "urn:ngsi-ld:WeatherObserved:BMP180:20092", "urn:ngsi-ld:WeatherObserved:BMP180:10999", "urn:ngsi-ld:WeatherObserved:BMP180:41038", "urn:ngsi-ld:WeatherObserved:BMP180:14784", "urn:ngsi-ld:WeatherObserved:BMP180:33267", "urn:ngsi-ld:WeatherObserved:BMP180:18219", "urn:ngsi-ld:WeatherObserved:BMP180:20289", "urn:ngsi-ld:WeatherObserved:BMP180:10556", "urn:ngsi-ld:WeatherObserved:BMP180:19666", "urn:ngsi-ld:WeatherObserved:BMP180:16664", "urn:ngsi-ld:WeatherObserved:BMP180:20308", "urn:ngsi-ld:WeatherObserved:BMP180:19948", "urn:ngsi-ld:WeatherObserved:BMP180:8227", "urn:ngsi-ld:WeatherObserved:BMP180:14023", "urn:ngsi-ld:WeatherObserved:BMP180:31565", "urn:ngsi-ld:WeatherObserved:BMP180:12000", "urn:ngsi-ld:WeatherObserved:BMP180:20058", "urn:ngsi-ld:WeatherObserved:BMP180:13570", "urn:ngsi-ld:WeatherObserved:BMP180:33877", "urn:ngsi-ld:WeatherObserved:BMP180:15935", "urn:ngsi-ld:WeatherObserved:BMP180:12061", "urn:ngsi-ld:WeatherObserved:BMP180:15333", "urn:ngsi-ld:WeatherObserved:BMP180:15544", "urn:ngsi-ld:WeatherObserved:BMP180:11792", "urn:ngsi-ld:WeatherObserved:BMP180:21336", "urn:ngsi-ld:WeatherObserved:BMP180:15845", "urn:ngsi-ld:WeatherObserved:BMP180:41371", "urn:ngsi-ld:WeatherObserved:BMP180:6454", "urn:ngsi-ld:WeatherObserved:BMP180:11424", "urn:ngsi-ld:WeatherObserved:BMP180:8903", "urn:ngsi-ld:WeatherObserved:BMP180:7389", "urn:ngsi-ld:WeatherObserved:BMP180:13254", "urn:ngsi-ld:WeatherObserved:BMP180:8441", "urn:ngsi-ld:WeatherObserved:BMP180:11483", "urn:ngsi-ld:WeatherObserved:BMP180:12918", "urn:ngsi-ld:WeatherObserved:BMP180:22906", "urn:ngsi-ld:WeatherObserved:BMP180:16528", "urn:ngsi-ld:WeatherObserved:BMP180:31565", "urn:ngsi-ld:WeatherObserved:BMP180:8125", "urn:ngsi-ld:WeatherObserved:BMP180:22828", "urn:ngsi-ld:WeatherObserved:BMP180:15803", "urn:ngsi-ld:WeatherObserved:BMP180:17469" ], "errors": [ { "entityId": "urn:ngsi-ld:WeatherObserved:BMP180:13778", "error": { "type": "https://uri.etsi.org/ngsi-ld/errors/BadRequestData", "title": "non-matching entity type", "detail": "WeatherObserved", "status": 400 } }, { "entityId": "urn:ngsi-ld:WeatherObserved:BMP180:41276", "error": { "type": "https://uri.etsi.org/ngsi-ld/errors/BadRequestData", "title": "non-matching entity type", "detail": "WeatherObserved", "status": 400 } }, { "entityId": "urn:ngsi-ld:WeatherObserved:BMP180:15845", "error": { "type": "https://uri.etsi.org/ngsi-ld/errors/BadRequestData", "title": "", "detail": "Bad Request", "status": 400 } }, { "entityId": "urn:ngsi-ld:WeatherObserved:BMP180:31565", "error": { "type": "https://uri.etsi.org/ngsi-ld/errors/BadRequestData", "title": "", "detail": "Bad Request", "status": 400 } } ] }

kzangeli commented 4 years ago

This seems to have nothing whatsoever to do with creDate == -1 ...

However, Two of the entities fail due to an error in the request:

I saw this earlier with Michael Schulz. The reason for the error is that one context is used when creating the entity and another one when trying to update.

In the upsert command that you pasted here, the context 'https://schema.lab.fiware.org/ld/context.jsonld' is used => WeatherObserved will be expanded to https://uri.fiware.org/ns/data-models#WeatherObserved. When creating the entity, some other context was used and WeatherObserved was expanded to something else, thus the error., It is not allowed to modify the type of an entity. If that is what you want, you will have to delete the entity and create it anew.

The other two errors unfortunately are without title. My fault, sorry about that. I will try to see if I can find the reason anyway ("Bad Request" as detail might help me find it).

But, this issue was about creDate == -1 ...

kzangeli commented 4 years ago

So, in PR #458, I changed the DB function used by batch upsert to accept creDate to be a float, which at least should fix part of the problem. The other part is to find where the timestamp is set to -1, but for that I need to be able to reproduce the problem ...

A new docker image (orion-ld:latest) containing this fix is uploaded to dockerhub. Please test and let me know.