kartoza / django-bims

https://testing.healthyrivers.kartoza.com
GNU Affero General Public License v3.0
11 stars 19 forks source link

Plant data uploaded in March 2023 come up as no records even though Present = 1 #3927

Closed helendallas closed 1 month ago

helendallas commented 3 months ago

Not sure what the issue is.

In March I uploaded >9000 plant records. They uploaded successfully.

Screenshot 2024-05-23 at 12 09 52

However on the Validate records form, all of these sites show Unvalidated (even though uploaded data should become validated automatically on upload), plus the occurrences are zero.

https://freshwaterbiodiversity.org/site-visit/list/?validated=[%22unvalidated%22]&o=date

Screenshot 2024-05-23 at 12 14 09

If I go to one of these sites via the search on Map, then the record is there and the data. see example here. SO must be an issue with validation form?

https://freshwaterbiodiversity.org/map/#site-detail/taxon=&search=G22B--00088&siteId=143847&collector=&category=&yearFrom=&yearTo=&months=&boundary=&userBoundary=&referenceCategory=&spatialFilter=&reference=&endemic=&conservationStatus=[]&modules=37&validated=&sourceCollection=[%22fbis%22,%22gbif%22,%22virtual_museum%22]&module=occurrence&ecologicalCategory=&rank=&siteIdOpen=143847&orderBy=name&polygon=&dst=&ecosystemType=River,Wetland,Open%20waterbody,Unspecified

helendallas commented 3 months ago

It's not only this dataset. there are others. that were uploaded and which are unvalidated, and have zero records. Is the zero records perhaps because there is no abundance, only Present = 1

here is another example

Screenshot 2024-05-23 at 12 22 08
dimasciput commented 2 months ago

Hi @helendallas,

I have checked this, and the data is not related to what you uploaded. It's an empty site visit, probably legacy data. I will remove it safely.

Here's some proof:

Data you uploaded in CSV, the first row: image

And this is the actual validated data: https://freshwaterbiodiversity.org/site-visit/detail/454276/

dimasciput commented 2 months ago

@helendallas I cleaned up the site visits in the fbis staging.

helendallas commented 2 months ago

Thanks @dimasciput I assume this is on https://fbis.sta.do.kartoza.com

Thanks for figuring out the issue and removing the legacy data

Please action on production: https://freshwaterbiodiversity.org