plazi / arcadia-project

2 stars 1 forks source link

final report #174

Open myrmoteras opened 2 years ago

myrmoteras commented 2 years ago

Arcadia final report_sb.pdf

Dear colleagues

In my humble view, a very successful Arcadia project has finished. We achieved a lot, learned a lot, grew in numbers including our office in Porto Allegre, and built a little powerhouse to tackle some still huge challenges in front of us, technical, workload wise, and social, to open up biodiversity literature.

Our collaboration is continuing in BiCIKL, and hopefully in a follow up Arcadia project to add another yet larger corpus of treatments. May be other doors might open as well.

This is the final report summarizing and discussing the last three years and its impact.

The last weeks have been one of the rare, more than exciting moments in my life, watching how all comes together to produce an unprecedented amount of processing over a sustained time that challenged all of us involved – but then ,who would have thought we can process 20,000 treatments in a day. With that we also discovered scaling issues we would not have anticipate when we started three years ago, and we hit the goal to liberating over 300,000 treatments and 250,000 figures in the three years.

Alex’ presentation of Zenodo to the Flemish government representatives on September 10 has been a similar moment, where the three years we worked together passed by. Our achievements on a technical level could not have been better as when Alex started to publish an article – untested, really randomly selected, of course not too long – which then used the microservice triggering TreatmentBank and then just before the 5 minutes have been hit, you hear Guido explaining that it will take another 3 minutes, because, o wonder, even the transfer to GBIF took place. After this 8 minutes we had an example of what microservices could mean if we really make use of it: https://zenodo.org/record/5499090 and the video where you can follow this after 1:42 h. A work over two continents, 9 time zones, GitHub, ClickUp, Notion, Google Drives, various APIs, slack, skype, email, WhatsApp, telegram, SMS, phone, in person meetings all did not build unsurmountable barriers.

I am thrilled by the work done, but even more how we operated as a team, the dedication of everybody.

Thank you very, very much for all your devotion and passion to get this complex endeavor to work, even in a time when we haven’t met in person for a long time.

All the best

Donat