riparias / gbif-alert

GBIF Alert is a GBIF occurrence based alert system.
https://gbif-alert-demo.thebinaryforest.net/
MIT License
8 stars 2 forks source link

gbif-blocking-occurrence-download source code? #280

Closed nigelcharman closed 6 months ago

nigelcharman commented 6 months ago

Firstly, congratulations on building such an awesome tool!

We're building a weed alert tool in NZ and considered basing it off gbif-alert, but have decided our requirements are sufficiently different and we're quite time-bound so will build it as a separate tool for now. We're looking to learn from what you have done though!

We're intermittently finding we have corrupt csv files on our downloads. I noticed you are using the gbif-blocking-occurrence-download library to download your occurrences. Is the source code or documentation available for this somewhere?

niconoe commented 6 months ago

Thanks for the nice words, cool that you're interested in sharing and reusing code!

It's a tiny tiny package I wrote, there's only one function in it actually. You can find its documentation and source code on my personal GitHub: https://github.com/niconoe/gbif-blocking-occurrence-download, it can also be installed simply via pip install gbif-blocking-occurrence-download.

Hope this helps!

Nicolas

nigelcharman commented 6 months ago

Awesome, thanks for the link!

It looks like my problem is due to GBIF generating corrupt csv files on occasion. I've still to get to the bottom of that problem, but maybe I'll switch to DWCA.

niconoe commented 6 months ago

Cool, I've never really had issues with DwC-A so far. I don't want to sound like a salesman, but don't hesitate to have a look at another of my packages, python-dwca-reader if you need to open them from python code :D

nigelcharman commented 6 months ago

Great, thanks for suggesting that! That makes sense for me to try. If it's working reliably for you, it should work for me 🤞

I think longer term there may be some benefit to having the DwC-A extensions available too.