tphakala / birdnet-pi2go

BirdNET-Pi2Go is a data migration tool designed to facilitate the conversion of BirdNET-Pi database contents and audio files to the BirdNET-Go data model.
10 stars 1 forks source link

Some notes #14

Open caphector opened 1 month ago

caphector commented 1 month ago

If the -target-dir isn't set then it fails saying Failed to check disk space:.

At least in my attempt, when I migrated using operation copy it copies WAV files over but I don't see any files of those names in the clips folder. As an example, I see corvus_brachyrhynchos_73p_20241021T092751Z.wav in the DB but:

parrot@birdnet:~/birdnet-go $ find ./data/clips/ -name 'corvus_brachyrhynchos_73p_20241021T092751Z.wav'
parrot@birdnet:~/birdnet-go $

I wanted to merge two birdnet-pi DBs (accidentally created a second a while back; wanted to merge the two into one DB for birdnet-go). As per the other issue I tried to migrate one to a new DB (which worked fine) and then tried the merge function. The merge doesn't seem to have worked, unfortunately. I realize this isn't documented but I wanted to let you know.

parrot@birdnet:~/pi2go/birdnet-pi2go $ -source-db other-birds.db -target-db test.db -source-dir ./BirdSongs/ -target-dir ./clips -operation copy

2024/10/21 23:40:01 ~/pi2go/dbops.go:225 record not found
[0.188ms] [rows:0] SELECT * FROM `notes` ORDER BY date DESC, time DESC,`notes`.`id` LIMIT 1
Total records to process: 30363
Processing batch 1-1000 of 30363
[and so on]
parrot@birdnet:~/pi2go/birdnet-pi2go $ ~/pi2go/birdnet-pi2go -source-db birds.db -target-db test.db -source-dir ./BirdSongs/ -target-dir ./clips -operation merge
2024/10/21 23:41:15 Database merge completed successfully with batching.
parrot@birdnet:~/pi2go/birdnet-pi2go $ ~/pi2go/birdnet-pi2go -source-db birds.db -target-db birdnet.db -source-dir ./BirdSongs/ -target-dir ./clips -operation copy
2024/10/21 23:42:32 ~/pi2go/dbops.go:22 record not found
[0.188ms] [rows:0] SELECT * FROM `notes` ORDER BY date DESC, time DESC,`notes`.`id` LIMIT 1
Total records to process: 211268

The DB size doesn't change between the first and second operations.

tphakala commented 4 weeks ago

Thanks for reporting, I will look into these soon