Data upload testing for macroinvertebrate

[mmindje]

Here we are testing the data upload for macroinvertebrate

[mmindje]

we have been able yo add the master list and now we are adding the occurrence list.

However, it seems it will take long to be uploaded....is that always usual?

Thank you

[mmindje]

@helendallas I think that length of time might be internet issues but today it seems to work...we proceed now. Thank you

[helendallas]

@mmindje okay happy it is working

[mmindje]

I think now we got it right

@helendallas

How are we adding the circle legend on the data?

[mmindje]

Dear @helendallas ,

A problem still persists:

We are uploading the occurence data as 556 but we encounter 535 in the testing site ,....we are indeed not sure where the problem is....

We checked coordinates are right even site description are right as well

so, we are not sure about what is causing the issue

[helendallas]

@mmindje Checking now

[mmindje]

sure, thank you @helendallas

[helendallas]

Issues noted:

Master list: Two taxa spelt incorrectly in Taxon column: Dytiscidae and Leptophlebiidae - I have corrected these, new master list attached, and reingested into RBIS testing.

RBIS.Macroinvertebrate.Final.Master.List.24 March 2021.xlsx

I removed all invert data on testing, reuploaded the master file - Success for master file:

Data file:

Error received when uploading data file - bad UUID.

So I deleted the UUID in the data file, and recreated new UUID for all occurrence records. Also changed Reference Category to Unpublished data.

New data file is here:

RBIS_Macroinvertebrate.final.Data.file.24March.2021.xlsx

Success for data file

[mmindje]

Thank you Helen. Can we now upload these to the final site? We shall also add more data we received yesterday

thank you

On Wed, 24 Mar 2021 at 09:59, Helen Dallas @.***> wrote:

Issues noted:

Master list: Two taxa spelt incorrectly in Taxon column: Dytiscidae and Leptophlebiidae - I have corrected these, new master list attached, and reingested into RBIS testing.

RBIS.Macroinvertebrate.Final.Master.List.24 March 2021.xlsx https://github.com/mmindje/Data-management-FRC-RBIS/files/6194878/RBIS.Macroinvertebrate.Final.Master.List.24.March.2021.xlsx

I removed all invert data on testing, reuploaded the master file - Success for master file:

[image: image] https://user-images.githubusercontent.com/45286876/112271090-2d16b780-8c83-11eb-976d-bf6731239c03.png

Data file:

Error received when uploading data file - bad UUID.

So I deleted the UUID in the data file, and recreated new UUID for all occurrence records. Also changed Reference Category to Unpublished data.

New data file is here:

RBIS_Macroinvertebrate.final.Data.file.24March.2021.xlsx https://github.com/mmindje/Data-management-FRC-RBIS/files/6195171/RBIS_Macroinvertebrate.final.Data.file.24March.2021.xlsx

Success for data file [image: image] https://user-images.githubusercontent.com/45286876/112270959-0193cd00-8c83-11eb-9148-3f4a375b366c.png

[image: image] https://user-images.githubusercontent.com/45286876/112271534-b7f7b200-8c83-11eb-94e6-6856ad18d58b.png

[image: image] https://user-images.githubusercontent.com/45286876/112272986-7e27ab00-8c85-11eb-9195-3adb97435619.png

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/mmindje/Data-management-FRC-RBIS/issues/41#issuecomment-805588852, or unsubscribe https://github.com/notifications/unsubscribe-auth/APPTV6TRZHIJ2LNTLJRIV4TTFGLW3ANCNFSM4YEP76FQ .

--

Mapendo MINDJE University of Rwanda-Huye Campus

• Assistant lecturer (MSc Conservation biology and MSc BioGeosciences)*
• Team leader for Biodiversity data management*
• Researcher affiliate to the - CoEB*

[helendallas]

If you have new invertebrate data to add to the data file, I would first upload it to the testing .

Then if you are happy, load to RBIS production.

Why not just load the files I sent this morning (converted to csv as per the docs), and leave the new data to be consolidated and tested later.

[mmindje]

That is actually the option. We are going to upload no the data to the final site and see also.

[mmindje]

@helendallas A STRANGE issue again

We used the data above you used for testing, converted into CSV but the upload on the Final site results into a discrepancy

It is now 393 than 556 records.

The remove button is not active in the RBIS final site....

There is is still may be a problem that we need to know how to address it!

[mmindje]

@helendallas A STRANGE issue again

We used the data above you used for testing, converted into CSV but the upload on the Final site results into a discrepancy

It is now 393 than 556 records.

The remove button is not active in the RBIS final site....

There is is still may be a problem that we need to know how to address it!

[helendallas]

oh dear, let me check I see only 59 taxa have been added.

[helendallas]

Still checking

[mmindje]

Sure, thank you. Yes, the cancellation was erroneous. Maybe we can also be able to delete records as in the testing site that helps so much!

On Wed, 24 Mar 2021 at 13:21, Helen Dallas @.***> wrote:

On the : Upload Taxonomic data; it shows the upload was cancelled.

[image: image] https://user-images.githubusercontent.com/45286876/112300044-1da66700-8ca1-11eb-9c56-0a9ea5311a82.png

I have re-uploaded and now records are at

Upload Taxonomic data

I have asked Dimas to delete records. Let me try from my side, and then we can see if it works and then we can figure out what is happening

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/mmindje/Data-management-FRC-RBIS/issues/41#issuecomment-805741337, or unsubscribe https://github.com/notifications/unsubscribe-auth/APPTV6XMY2NUASTX7V2H2ITTFHDKLANCNFSM4YEP76FQ .

--

Mapendo MINDJE University of Rwanda-Huye Campus

• Assistant lecturer (MSc Conservation biology and MSc BioGeosciences)*
• Team leader for Biodiversity data management*
• Researcher affiliate to the - CoEB*

[helendallas]

@mmindje @Thacien1 So I have been working with Dimas who found some bugs on the RBIS production uploading. These have now been fixed and the master list and data have been uploaded.

I would like to plan for another session where we go through the uploading process on the RBIS testing site. Just to make sure you are all comfortable with the whole process.

Thanks

[mmindje]

Awesome, thanks for the update!

Maybe we can also have the remove button in the final site in Taxon management in case... We shall now work on new data and add them after testing.

In the meantime, we are working on the fish masterlist that is soon done as well

On Thu, 25 Mar 2021 at 11:23, Helen Dallas @.***> wrote:

@mmindje https://github.com/mmindje @Thacien1 https://github.com/Thacien1 So I have been working with Dimas who found some bugs on the RBIS production uploading. These have now been fixed and the master list and data have been uploaded.

[image: image] https://user-images.githubusercontent.com/45286876/112449371-fc568100-8d5b-11eb-8231-81f7ba08ab50.png

I would like to plan for another session where we go through the uploading process on the RBIS testing site. Just to make sure you are all comfortable with the whole process.

Thanks

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/mmindje/Data-management-FRC-RBIS/issues/41#issuecomment-806494789, or unsubscribe https://github.com/notifications/unsubscribe-auth/APPTV6UTXJED2L67AHMD3W3TFL6H3ANCNFSM4YEP76FQ .

--

Mapendo MINDJE University of Rwanda-Huye Campus

• Assistant lecturer (MSc Conservation biology and MSc BioGeosciences)*
• Team leader for Biodiversity data management*
• Researcher affiliate to the - CoEB*

[helendallas]

@mmindje I agree re the remove button, but it is risky as all data are deleted, so if you have added data over several months then it would all be deleted.

Perhaps Dimas could include a date range, so that only the data added after a certain date would be removed.

[mmindje]

Thank you @helendallas for testing the invertebrates

So, do you think it can also be created for the RBIS live?

Thank you

[helendallas]

This has been uploaded to RBIS production. See ticket #34 Closing ticket.