Yooooomi / your_spotify

Self hosted Spotify tracking dashboard
GNU General Public License v3.0
2.77k stars 110 forks source link

Extended streaming history import - new format? #264

Closed filcuk closed 1 year ago

filcuk commented 1 year ago

Describe the bug Cannot import history due to what I assume is a new format of .json files.

Additional context The files look like below, i.e. no endsongx.json, which is what I believe the app expects. I'm happy to provide a sample, but would prefer to do so privately to the dev(s).

Screenshots image

If applicable, add screenshots to help explain your problem.

Shared link I don't think it's relevant in this case, but let me know if there's some other way I can help.

As a sidenote, great app! Love it, and it's great knowing I have my data stored where I can see it.

filcuk commented 1 year ago

Here's an example of my Streaming_History_Audio_2014-2018_0.json:

[
    {
        "ts": "2014-08-02T20:35:55Z",
        "username": "g52273418860",
        "platform": "WebPlayer (websocket RFC6455)",
        "ms_played": 225409,
        "conn_country": "GB",
        "ip_addr_decrypted": "2.24.14.42",
        "user_agent_decrypted": "Mozilla%2f5.0%20(Windows%20NT%206.3%3b%20Win64%3b%20x64)%20AppleWebKit%2f537.36%20(KHTML,%20like%20Gecko)%20Chrome%2f37.0.2062.58%20Safari%2f537.36",
        "master_metadata_track_name": "Truth (Helios Remix)",
        "master_metadata_album_artist_name": "Balmorhea",
        "master_metadata_album_album_name": "All Is Wild, All Is Silent Remixes",
        "spotify_track_uri": "spotify:track:4lwGyv3tbahmN1Z25wdCxa",
        "episode_name": null,
        "episode_show_name": null,
        "spotify_episode_uri": null,
        "reason_start": "playbtn",
        "reason_end": "unknown",
        "shuffle": false,
        "skipped": false,
        "offline": false,
        "offline_timestamp": 0,
        "incognito_mode": false
    }
]
filcuk commented 1 year ago

I should add that in the console, I get ERR_BAD_REQUEST: image

And Docker logs seem to have no sign of an error.

I have run regular account imports successfully: image

dlmservers commented 1 year ago

Also having same issue

Yooooomi commented 1 year ago

Hello! The name of the file should have no impact, just a warning. Are you running behind a reverse proxy / cloudflare?

filcuk commented 1 year ago

I am behind Traefik 2 and Cloudflare indeed. I've restarted my instance as local and the import seems to be working now: image

I'm going to close the issue. Could you please give me pointes as to what I should be looking at to fix this @Yooooomi? @dlmservers I'll let you know if I figure it out.

dlmservers commented 1 year ago

I am behind Traefik 2 and Cloudflare indeed. I've restarted my instance as local and the import seems to be working now: image

I'm going to close the issue. Could you please give me pointes as to what I should be looking at to fix this @Yooooomi? @dlmservers I'll let you know if I figure it out.

Updated my server to the latest release and rebooted the containers. Seems okay now, currently in the process of importing Importing complete, everything seems to be good

filcuk commented 1 year ago

For anyone potentially coming across this with a similar setup... Ensure that your CORS headers are applied before any middlewares that may otherwise overwrite it, i.e.:

- "traefik.http.routers.yourspotifyapi-rtr.middlewares=yourspotifyapi-cors@docker,chain-no-auth@file"
Supbro112 commented 1 year ago

I have an issue with importing too, and the format does seem wrong too, but I managed one import but then now it constantly says there is already an import running on the account (??) (Yes, the import is done. it says its 16581/16581)

Here is also one entry of my docker desktop. I believe to be every entry in my streaminghistory files: (I dont think its able to read the format.)

2023-07-28 03:24:24 { 2023-07-28 03:24:24 "code": "invalid_type", 2023-07-28 03:24:24 "expected": "string", 2023-07-28 03:24:24 "received": "undefined", 2023-07-28 03:24:24 "path": [ 2023-07-28 03:24:24 16487, 2023-07-28 03:24:24 "trackName" 2023-07-28 03:24:24 ], 2023-07-28 03:24:24 "message": "Required" 2023-07-28 03:24:24 },

Yooooomi commented 1 year ago

@Supbro112 can you please, if you don't mind, send me the files you're trying to import on discord @yooooomi_?