Sheraff / soft-serve-tunes

Self hosted music server on raspberry pi
7 stars 0 forks source link

Look into Essentia (or ≠ signal processing / ML models) for music feature extraction without relying on spotify #42

Open Sheraff opened 1 year ago

Sheraff commented 1 year ago

https://essentia.upf.edu/models.html

Essentia allows us to extract "simple" music features (loudness, bpm, danceability) as well as more complex features through ML (pre-trained?) models (genre, mood, instrumentation, voiciness, valence, gender, acousticness, ...)

5Go / 8M+ sqlite dataset of spotify tracks and their audio features: https://www.kaggle.com/datasets/maltegrosse/8-m-spotify-tracks-genre-audio-features

We don't have to stick to Spotify's feature list (acousticness, danceability, energy, instrumentalness, liveness, speechiness, valence) as long as we find some vectors that allow for