johanohly / AirTrail

A modern, open-source personal flight tracking system
http://airtrail.johan.ohly.dk/
GNU General Public License v3.0
279 stars 13 forks source link

Duplicates with two sources #101

Open mrman486 opened 1 week ago

mrman486 commented 1 week ago

The bug

If I import via FR24 and App in the Air for example, some of the imports have the same data so there is duplicates in the final result in AirTrail.

Is there an easy way to clean out duplicates?

Operating System that is running AirTrail

docker

AirTrail Version

Latest

Your docker-compose.yml content

No response

Your .env content

No response

Reproduction steps

1.Import FR24 2.Import App in the Air

  1. View results ...

Relevant log output

No response

Additional information

No response

johanohly commented 1 week ago

I've actually never considered the use-case of importing from multiple sources.

I don't think there is a need to check for duplicates when importing, as that is a very niche use-case, but I could see a kind of like tools page that lets you delete duplicates according to your specification. For your use-case, is matching the airports and date and time enough?

Another option you have, if you are comfortable with SQL databases, is accessing the AirTrail database outside of AirTrail, and execute a raw SQL query to delete duplicates.

mrman486 commented 1 week ago

If there was an option to filter dupes in the list then have an option to select all etc to delete would work very well. Matching dates and airports would be perfect.

I know there have been times going back I have entered data twice by mistake after forgetting I have already entered the flights.

Cheers