search

adsblol / globe_history_2024

✈️🗄 2024 Historical data for all aircrafts traces known to adsb.lol. Openly licensed.
https://adsb.lol
Open Data Commons Open Database License v1.0
42 stars 0 forks source link

Additional MLAT-only files - Unique or duplicate data? #7

Closed MrAirspace closed 7 months ago

MrAirspace commented 7 months ago

Hello, First of all, I want to express how impressed I am with the adsblol datasets, very impressive initiative!

I have a question. I understand the 'staging' and 'prod' databases are very similar, but as of recently, also a dataset with designator 'mlat only' is provided. Is this 'mlat only' data also included in the 'staging' or 'prod' tar files already?

Please advise :) Thanks a lot! Sebastiaan.

iakat commented 7 months ago

thank you very much for your kind words and support :)

https://mlatonly.adsb.lol/ is an experimental globe with all aircraft tracked via MLAT instead of ADSB

for aircraft that do not send location, the data is already included in the normal release.

for aircraft that do send location, the location is discarded when computing MLAT results, so depending on whether the location the aircraft is sending is wrong for any reason, the data might be different in mlatonly

what made me want to look into this is GPS interference such as: https://adsb.lol/?icao=484135&lat=48.692&lon=15.146&zoom=4.9&showTrace=2024-03-14

this aircraft's trace would have looked... different on mlatonly, showing the real position, I think

iakat commented 7 months ago

here is an example by @wiseman: https://nitter.poast.org/lemonodor/status/1776665612309430501#m

https://mlatonly.adsb.lol/?icao=76cd6d&lat=51.603&lon=-0.174&zoom=10.0&showTrace=2024-04-05&trackLabels&timestamp=1712329102

https://adsb.lol/?icao=76cd6d&lat=51.603&lon=-0.174&zoom=10.0&showTrace=2024-04-05&trackLabels&timestamp=1712329102

open these two links in two different tabs and switch between them quickly and see if you notice the difference

on adsb.lol, it looks like the aircraft landed in a residential area, on mlatonly, it loses track aligned with the right approach of the runway

MrAirspace commented 7 months ago

Thank you for the interesting links! So just to make sure I understand correctly, if an aircraft (icao hex code) is contained in both the mlat dataset as well as the prod/staging dataset, then it is deleted from the prod/staging dataset? I just want to make sure I really understand the info/insights from your first reply :) Thanks again :)

iakat commented 7 months ago

No nothing is deleted.

On Mon, 8 Apr 2024 at 10:14, Sebastiaan < @.***> wrote:

Thank you for the interesting links! So just to make sure I understand correctly, if an aircraft (icao hex code) is contained in both the mlat dataset as well as the prod/staging dataset, then it is d DuckDuckGo removed one tracker. More https://duckduckgo.com/-QhdW8FC0UI14lXtwnNRQ8zgMg6AwEYykOHrkeQHqEBfqOHHwBGRRr45SUAWTlqv68MrdYV8qr5cHpTibDKkw7oUkqWFAe5kjSVraiHcB9OXXzJhPJGjrcaIMUC5K6GWp4s0PeBYw2iR7mGBVhHeAwy0vR1nKLVu-Hl3-tb1eUYz3Xnm4OIdpyAcr3ECOKhGbO6MxNhCB5eJQ-lPPZCHgm7zwOUs6HACL30Zx5vh8NNp_ob9CYC5mchLXa4pikzuwVbtYkrIf4BXEIX_tWGiQ518dqTIopSj952DoJrxubFajvQMqN4xH7IvBuZ5WQustqtfjk5wvGxWIe3SBNMieoOi7thSNStYau9TjLaVmW6lE4e6fhYS2F8EacOnf_9wgtAvyzaUH1MwOTUkf2sLfubGkDJZjT8 Report Spam https://duckduckgo.com/-QhdW8FC0UI14lXtwnNRQ8zgMg6AwEYykOHrkeQHqEBfqOHHwBGRRr45SUAWTlqv68MrdYV8qr5cHpTibDKkw7oUkqWFAe5kjSVraiHcB9OXXzJhPJGjrcaIMUC5K6GWp4s0PeBYw2iR7mGBVhHeAwy0vR1nKLVu-Hl3-tb1eUYz3Xnm4OIdpyAcr3ECOKhGbO6MxNhCB5eJQ-lPPZCHgm7zwOUs6HACL30Zx5vh8NNp_ob9CYC5mchLXa4pikzuwVbtYkrIf4BXEIX_tWGiQ518dqTIopSj952DoJrxubFajvQMqN4xH7IvBuZ5WQustqtfjk5wvGxWIe3SBNMieoOi7thSNStYau9TjLaVmW6lE4e6fhYS2F8EacOnf_9wgtAvyzaUH1MwOTUkf2sLfubGkDJZjT8

Thank you for the interesting links! So just to make sure I understand correctly, if an aircraft (icao hex code) is contained in both the mlat dataset as well as the prod/staging dataset, then it is deleted from the prod/staging dataset? I just want to make sure I really understand the info/insights from your first reply :) Thanks again :)

— Reply to this email directly, view it on GitHub https://github.com/adsblol/globe_history_2024/issues/7#issuecomment-2042130482, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAM553PNF2RGTEP3E2LWYY3Y4JGVPAVCNFSM6AAAAABFZTG72KVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDANBSGEZTANBYGI . You are receiving this because you commented.Message ID: @.***>

iakat commented 7 months ago

Mlat server usually calculates position only for aircraft without position, yes?

I have configured it to do it for all aircraft instead

But readsb discards Mlat position when Adsb position is available because that is more accurate.

So mlatonly exists to show the Mlat position only.

Make sense?

On Mon, 8 Apr 2024 at 10:59, Katia Esposito @.***> wrote:

No nothing is deleted.

On Mon, 8 Apr 2024 at 10:14, Sebastiaan < @.***> wrote:

Thank you for the interesting links! So just to make sure I understand correctly, if an aircraft (icao hex code) is contained in both the mlat dataset as well as the prod/staging dataset, then it is d DuckDuckGo removed one tracker. More https://duckduckgo.com/-QhdW8FC0UI14lXtwnNRQ8zgMg6AwEYykOHrkeQHqEBfqOHHwBGRRr45SUAWTlqv68MrdYV8qr5cHpTibDKkw7oUkqWFAe5kjSVraiHcB9OXXzJhPJGjrcaIMUC5K6GWp4s0PeBYw2iR7mGBVhHeAwy0vR1nKLVu-Hl3-tb1eUYz3Xnm4OIdpyAcr3ECOKhGbO6MxNhCB5eJQ-lPPZCHgm7zwOUs6HACL30Zx5vh8NNp_ob9CYC5mchLXa4pikzuwVbtYkrIf4BXEIX_tWGiQ518dqTIopSj952DoJrxubFajvQMqN4xH7IvBuZ5WQustqtfjk5wvGxWIe3SBNMieoOi7thSNStYau9TjLaVmW6lE4e6fhYS2F8EacOnf_9wgtAvyzaUH1MwOTUkf2sLfubGkDJZjT8 Report Spam https://duckduckgo.com/-QhdW8FC0UI14lXtwnNRQ8zgMg6AwEYykOHrkeQHqEBfqOHHwBGRRr45SUAWTlqv68MrdYV8qr5cHpTibDKkw7oUkqWFAe5kjSVraiHcB9OXXzJhPJGjrcaIMUC5K6GWp4s0PeBYw2iR7mGBVhHeAwy0vR1nKLVu-Hl3-tb1eUYz3Xnm4OIdpyAcr3ECOKhGbO6MxNhCB5eJQ-lPPZCHgm7zwOUs6HACL30Zx5vh8NNp_ob9CYC5mchLXa4pikzuwVbtYkrIf4BXEIX_tWGiQ518dqTIopSj952DoJrxubFajvQMqN4xH7IvBuZ5WQustqtfjk5wvGxWIe3SBNMieoOi7thSNStYau9TjLaVmW6lE4e6fhYS2F8EacOnf_9wgtAvyzaUH1MwOTUkf2sLfubGkDJZjT8

Thank you for the interesting links! So just to make sure I understand correctly, if an aircraft (icao hex code) is contained in both the mlat dataset as well as the prod/staging dataset, then it is deleted from the prod/staging dataset? I just want to make sure I really understand the info/insights from your first reply :) Thanks again :)

— Reply to this email directly, view it on GitHub https://github.com/adsblol/globe_history_2024/issues/7#issuecomment-2042130482, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAM553PNF2RGTEP3E2LWYY3Y4JGVPAVCNFSM6AAAAABFZTG72KVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDANBSGEZTANBYGI . You are receiving this because you commented.Message ID: @.***>

iakat commented 7 months ago

The way to see the difference is to open the file of the specific aircraft (or any others, but the one I linked will have clear gps malfunction and difference between the two files) for both datasets (prod and mlatonly) and see

The links I showed you do the same thing, but you get the beauty of tar1090 displaying you what’s up.

Thinking about it you could also open these 2 links, look at network activity, and download just the two aircraft globe history json files like that instead of downloading the entire dataset from GH

On Mon, 8 Apr 2024 at 11:06, Katia Esposito @.***> wrote:

Mlat server usually calculates position only for aircraft without position, yes?

I have configured it to do it for all aircraft instead

But readsb discards Mlat position when Adsb position is available because that is more accurate.

So mlatonly exists to show the Mlat position only.

Make sense?

On Mon, 8 Apr 2024 at 10:59, Katia Esposito @.***> wrote:

No nothing is deleted.

On Mon, 8 Apr 2024 at 10:14, Sebastiaan < @.***> wrote:

Thank you for the interesting links! So just to make sure I understand correctly, if an aircraft (icao hex code) is contained in both the mlat dataset as well as the prod/staging dataset, then it is d DuckDuckGo removed one tracker. More https://duckduckgo.com/-QhdW8FC0UI14lXtwnNRQ8zgMg6AwEYykOHrkeQHqEBfqOHHwBGRRr45SUAWTlqv68MrdYV8qr5cHpTibDKkw7oUkqWFAe5kjSVraiHcB9OXXzJhPJGjrcaIMUC5K6GWp4s0PeBYw2iR7mGBVhHeAwy0vR1nKLVu-Hl3-tb1eUYz3Xnm4OIdpyAcr3ECOKhGbO6MxNhCB5eJQ-lPPZCHgm7zwOUs6HACL30Zx5vh8NNp_ob9CYC5mchLXa4pikzuwVbtYkrIf4BXEIX_tWGiQ518dqTIopSj952DoJrxubFajvQMqN4xH7IvBuZ5WQustqtfjk5wvGxWIe3SBNMieoOi7thSNStYau9TjLaVmW6lE4e6fhYS2F8EacOnf_9wgtAvyzaUH1MwOTUkf2sLfubGkDJZjT8 Report Spam https://duckduckgo.com/-QhdW8FC0UI14lXtwnNRQ8zgMg6AwEYykOHrkeQHqEBfqOHHwBGRRr45SUAWTlqv68MrdYV8qr5cHpTibDKkw7oUkqWFAe5kjSVraiHcB9OXXzJhPJGjrcaIMUC5K6GWp4s0PeBYw2iR7mGBVhHeAwy0vR1nKLVu-Hl3-tb1eUYz3Xnm4OIdpyAcr3ECOKhGbO6MxNhCB5eJQ-lPPZCHgm7zwOUs6HACL30Zx5vh8NNp_ob9CYC5mchLXa4pikzuwVbtYkrIf4BXEIX_tWGiQ518dqTIopSj952DoJrxubFajvQMqN4xH7IvBuZ5WQustqtfjk5wvGxWIe3SBNMieoOi7thSNStYau9TjLaVmW6lE4e6fhYS2F8EacOnf_9wgtAvyzaUH1MwOTUkf2sLfubGkDJZjT8

Thank you for the interesting links! So just to make sure I understand correctly, if an aircraft (icao hex code) is contained in both the mlat dataset as well as the prod/staging dataset, then it is deleted from the prod/staging dataset? I just want to make sure I really understand the info/insights from your first reply :) Thanks again :)

— Reply to this email directly, view it on GitHub https://github.com/adsblol/globe_history_2024/issues/7#issuecomment-2042130482, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAM553PNF2RGTEP3E2LWYY3Y4JGVPAVCNFSM6AAAAABFZTG72KVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDANBSGEZTANBYGI . You are receiving this because you commented.Message ID: @.***>

MrAirspace commented 7 months ago

Hi again :) Thanks for the extra explanation, happy to hear data is not deleted but that more accurate data then indeed exists in the MLAT data set.

iakat commented 7 months ago

Well, mlat is always an estimate as far as I understand it.

But it is more accurate if the aircraft is sending wrong location, yes

On Mon, 8 Apr 2024 at 15:44, Sebastiaan < @.***> wrote:

Hi again :) Thanks for the extra explanation, happy to hear data is not deleted but that more accurate data then indeed exists in the MLAT data set. —Reply to this email directly, view it on GitHub, o DuckDuckGo removed one tracker. More https://duckduckgo.com/-cEXNZ2-Bi9EYFd2AVi4qi8un7l1YamQ3gqGUaFeqUDCPBRBDoivWUXJY6YCVv2QKNY1kW0RCAHN2PPWecGq49fZG88U4o_FNN7_WNun4ZGPi6JEBWnEkzPb84558I8wzIUt7UYA6y-CZXs08jhD-RgnmNpMh7ORjgZeFCcFxdYe0c8ZqJzhzGeG3cwjgCPdBfxy_ZFgRpiq_wpCEysPLQCCq1ZnmcKvKMSoy4zPaYcDWzZNxQPdrufJf-327wo-PedTMNe6bxlCZmHo7vClJD_LeYNkoj_VJLLPL50tPq-QWL3DeTj3PKEdaVoYGdrxSJSegloIx8WBHm_fzi6IeNtZ0oijiSd1P4bNk1sOidEzj7HSRK-1b2tfzIhTyoscN1_SYgIX7P9-6i8JNR9LlNYmgZ28TKLPkOQ6_C4GQ Report Spam https://duckduckgo.com/-cEXNZ2-Bi9EYFd2AVi4qi8un7l1YamQ3gqGUaFeqUDCPBRBDoivWUXJY6YCVv2QKNY1kW0RCAHN2PPWecGq49fZG88U4o_FNN7_WNun4ZGPi6JEBWnEkzPb84558I8wzIUt7UYA6y-CZXs08jhD-RgnmNpMh7ORjgZeFCcFxdYe0c8ZqJzhzGeG3cwjgCPdBfxy_ZFgRpiq_wpCEysPLQCCq1ZnmcKvKMSoy4zPaYcDWzZNxQPdrufJf-327wo-PedTMNe6bxlCZmHo7vClJD_LeYNkoj_VJLLPL50tPq-QWL3DeTj3PKEdaVoYGdrxSJSegloIx8WBHm_fzi6IeNtZ0oijiSd1P4bNk1sOidEzj7HSRK-1b2tfzIhTyoscN1_SYgIX7P9-6i8JNR9LlNYmgZ28TKLPkOQ6_C4GQ

Hi again :) Thanks for the extra explanation, happy to hear data is not deleted but that more accurate data then indeed exists in the MLAT data set.

— Reply to this email directly, view it on GitHub https://github.com/adsblol/globe_history_2024/issues/7#issuecomment-2042799470, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAM553NYT7GKYY724RERRRDY4KNKDAVCNFSM6AAAAABFZTG72KVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDANBSG44TSNBXGA . You are receiving this because you commented.Message ID: @.***>

iakat commented 6 months ago

another example (via @wiedehopf)

https://adsb.lol/?icao=484cba&lat=51.629&lon=8.492&zoom=6.0&showTrace=2024-04-16 https://mlatonly.adsb.lol/?icao=484cba&lat=51.629&lon=8.492&zoom=6.0&showTrace=2024-04-16