Identify Birds !

[boly38]

Need

Check if a free api exist in order to do a bird identification plugin

• need: simple call with image content or image url, and as result, need some details apout bird species identification with confident ratio
• database must be open and free to use (& if possible with a community or company behind) and sustainable over time

Candidates

relevant candidates list:

• 1) BioClip repository & demo : need to deep test but really good candidate (unable to find condition of use for now) (suggested by James 🙏 )
• 2) a dataset of 535 species + 📦 mvp mymale repo
• 3) https://blog.roboflow.com/bird-detection-api/ : cf. test under

need to dig more list

• Google Cloud Vision API 💲 seems not free / "1000unit/month" (from price) .. from demonstration, it seems powerfull but need to dig more
• Microsoft Azure Computer Vision API - doc 💲 price price2 (free plan 50 labels/project) / quick start

(seems) 🟥 out-of-scope list

• birdNet app => it's a (funny) android app that recognize bird from a given recorded sound range.
  • iNaturalist API doc => unable to find api to identify an image
  • Merlin Bird ID website => it's an app, seems there is no API, send mail to ask.
• Picture Bird - Bird Identifier - android app only

💲 💲 NOT free

• yeschat.ai (Bird Buddy) (price - starting 8€/month) - really accurate
• nyckel.com : need an input image that focus on the bird for better id. based on kraggle model too. Using pre trained classifier is not free (price)

other references

• reddit same question
• database of species avibase

[boly38]

Roboflow > bird-v2

credit;

James Gallagher. (Feb 20, 2023). How to Use the Roboflow Bird Detection API. Roboflow Blog: https://blog.roboflow.com/bird-detection-api/

• blog post > LeeM bird v2
• test API against detect.roboflow.com/bird-v2/2 - 🔨 gist : example used to test
• create a free plan account on roboflow.com

ℹ️ current model training " the model only detects the species of around 30 birds," (but could increase over the time) ℹ️ there is a feature to augment the input image with box+class_label around (1..N) detection(s) (seen in python)

free plan limits seems to be 10k call per month

➕ 2 simple examples to test, ✔️ it works, it'sfree ➖ give only "class" (result extract, cf gist) :

  confidence: 0.6883782148361206,
  class: 'orchard-oriole',
  class_id: 19,
  detection_id: '4c4c2404-f16b-4bd9-9416-e5525e2566fc'

⁉️ is it possible to get result class details ? it seems that "class" is the final result. ⁉️ what is an acceptable confident ratio ? => do more tests

More tests :

• test multiples jpg files gist : => 🔴 14 images, detection of some random internet sample: seems that only 3 results are OK, and some confident result are wrong .. :'( => got quite same result with detect.roboflow.com/bird-species-kdlph/1 => I'm not sure this kind of model will be improved by "a community" to extends the results ? ask to the forum about roboflow limits

[boly38]

Google cloud vision API

• on-line demonstration

[boly38]

BioCLIP

repo - demo + integration samples

I've got NO error until now on my fiew (10) manual tests 😲

Example1

Example2 +avibase example2

---

Deep tests :

• • NodeJS first tests https://github.com/boly38/bioclipBootstrap : the result is a full string including all ranks + score ; not that better but need extra processing to extract species

+huggingface discussion about NodeJS + REX

• python client is https://github.com/Imageomics/pybioclip
• try HF dedicated clone with another endpoint : 🟥 cant get dictionnary as outpout
• tested pybioclip in standalone mode in https://github.com/boly38/pyBird : ✔️
• • ➕ takes an image URI as input and dictionnary as output.
• • ➖ need huge amount of data locally to make it work
• try HF+gradio sample API doc and MVP that produce JSON as output : https://huggingface.co/spaces/3oly/gradioAPI ✔️
• and final : HF + gradio + pybioclip MVP of bioclip a new API => 3oly/grBird ✅
• • ℹ️ cloning some part of pyBird + pybioclip code and TreeOfLifeClassifier classe.
• • ➕ takes image URI as input and produce JSON dictionnary as output

[boly38]

Github actions : support cron timezone : discussion and ticket

Interesting discussion extract workaround

schedule:
    # During "Central European Time" (CET): Offset from UTC: -1
    - cron: '42  7,10,13,16  *  11-12,1-3 1-5'
    # During "Central European Summer Time" (CEST): Offset from UTC: -2
    - cron: '42  6,9,12,15   *  4-10      1-5'
During winter-months, it runs on a 1-hour offset, during summer-months on a 2-hour offset.