search

DDMAL / linkedmusic-datalake

To create mapping strategies for various music databases into our data lake
https://virtuoso.staging.simssa.ca
0 stars 4 forks source link

Understanding ListenBrainz data dumps #87

Closed Yueqiao12Zhang closed 3 months ago

Yueqiao12Zhang commented 3 months ago

Problems encountered during inspection of ListenBrainz.

Yueqiao12Zhang commented 3 months ago

There are four TSV files in the ListenBrainz Data Dumps. These TSVs are without header. What are these columns? For example: 

2710876 26899   10f7dd1e-a6f8-4c69-bacf-85430d9d5a01    26368d33-773d-4a0c-a2c0-b937b1e60466    1   2024-05-20 20:04:34.555014+00
2710877 25755   \N  89c18464-a538-49f7-b9d6-ecf458c0ea5a    1   2024-05-20 20:05:16.292707+00
44695   15602   c78fa67d-b5ea-4e58-89d9-fc729489bdb4    ee0dc07a-efdc-473e-b30e-b2d401b66c49    1   2022-04-21 23:31:16.947638+00
1614467 8443    da2a6fa7-9091-43c9-92a4-4f433834002c    \N  1   2023-12-13 21:24:20.642369+00
45147   18098   cf9dfb58-4983-47f3-8505-7b55ec482289    d936b486-26d8-49ec-96bf-a32e2ce43c43    1   2022-04-24 17:46:55.690322+00
45429   1282    64a075ce-9e5e-4ae5-b828-54a9c3dd16b8    c46bf2e7-a180-4ce5-a5eb-ccb54e2c4e8f    1   2022-04-26 17:11:32.243929+00
1614470 27399   21672e13-db7d-4c40-8c38-84641bba3c33    ce4db764-7e03-4636-b656-e886175ee410    1   2023-12-13 21:24:58.084201+00
45668   18092   37f96828-b13f-4d57-b412-71c79322f73f    c96d7537-acf6-4b5f-85da-0691268756c2    1   2022-04-27 13:23:21.811398+00

The middle two columns seems like MBIDs, and the last column seems like timestamp. What are the types of the MBIDs? What are other columns?

Yueqiao12Zhang commented 3 months ago

It also has a "Listens" dump, which are consisted of JSON files. Are they equally important? Are they related to each other?

{"user_id":18646,"user_name":"respiritosanto1","timestamp":1721174403,"track_metadata":{"track_name":"Promise Me","artist_name":"Beverley Craven","release_name":"Very Best Of Beverley Craven","additional_info":{"duration_ms":217390,"tracknumber":1,"artist_mbids":[],"submission_client":"navidrome","submission_client_version":"0.52.5 (c5560888)","recording_msid":"40cc5f51-7d2f-4494-82b5-f39760d488b1"}},"recording_msid":"40cc5f51-7d2f-4494-82b5-f39760d488b1"}
{"user_id":18789,"user_name":"solarsea","timestamp":1721174400,"track_metadata":{"track_name":"Let The Children Play","artist_name":"White Heart","release_name":"Don't Wait For The Movie","additional_info":{"tracknumber":6,"recording_msid":"7d42483d-7014-4385-8b91-4130fb86b10e"}},"recording_msid":"7d42483d-7014-4385-8b91-4130fb86b10e"}
{"user_id":1085,"user_name":"labdarex","timestamp":1721174386,"track_metadata":{"track_name":"Don’t Let Me Let Go (with ILLENIUM & EVAN GIIA)","artist_name":"Dillon Francis","release_name":"Don’t Let Me Let Go (with ILLENIUM & EVAN GIIA)","additional_info":{"duration_ms":205000,"submission_client":"Pano Scrobbler","submission_client_version":"3.27 - 2024, Mar 25","recording_msid":"3b762262-0c44-4afb-b3ae-50f991d5da0d"}},"recording_msid":"3b762262-0c44-4afb-b3ae-50f991d5da0d"}
Yueqiao12Zhang commented 3 months ago

What is a MSID? How can I track it to its web page?