Icecast Radio Directory: Import 20,000 streams

[davidhedlund]

I emailed Icecast-dev@xiph.org and got positive feedback how to use their data almost immediately:

Good evening,

On Wed, 2017-09-20 at 07:54 +0200, David Hedlund wrote:

I wrote this issue earlier for radio-browser.info: Import 20,000 steams from the Icecast Radio Directory - https://github.com/segler-alex/radiobrowser-api/issues/31

radio-browser.info publish the latest database (http://www.radio-browser.info/backups/latest.sql.gz) and you are free to use it. Do you also publish the database used for http://dir.xiph.org/?

The database for the directory service is kind of just a cache. All the data within are refreshed all the time. entries have a maximum age of about 20minutes. That is the rebuild time of the directory.

You can access the current content via: http://dir.xiph.org/yp.xml But please do not request that file too often as it's heavy.

Hope that helps you.

With best regards,

-- Philipp Schafft (CEO/Geschäftsführer) Telephon: +49.3535 490 17 92

Löwenfelsen UG (haftungsbeschränkt) Registration number: Bickinger Straße 21 HRB 12308 CB 04916 Herzberg (Elster) VATIN/USt-ID: Germany DE305133015

[davidhedlund]

Here's the XML file structure:

$ xmllint yp.xml
<?xml version="1.0" encoding="UTF-8"?>
<directory>
    <entry>
        <server_name>ilovehaze</server_name>
        <listen_url>http://streaming210.radionomy.com:80/ilovehaze</listen_url>
        <server_type>audio/mpeg</server_type>
        <bitrate>128</bitrate>
        <channels>0</channels>
        <samplerate>0</samplerate>
        <genre>hip</genre>
        <current_song>Fake Love - Drake</current_song>
    </entry>
    <entry>
        <server_name>Mozartiana</server_name>
        <listen_url>http://streaming211.radionomy.com:80/Mozartiana</listen_url>
        <server_type>audio/mpeg</server_type>
        <bitrate>128</bitrate>
        <channels>0</channels>
        <samplerate>0</samplerate>
        <genre>classical</genre>
        <current_song>Symphony No. 16 In C, K. 128: III. Allegro - Neville Marriner</current_song>
    </entry>
    <entry>
        <server_name>Raadio Elmar</server_name>
        <listen_url>http://217.146.71.24:80/elmar_high.mp3</listen_url>
        <server_type>audio/mpeg</server_type>
        <bitrate>256</bitrate>
        <channels>0</channels>
        <samplerate>0</samplerate>
        <genre>rock</genre>
        <current_song>Miina &amp; Refiller - Kahe Vahel</current_song>
    </entry>
...
</directory>

[davidhedlund]

@segler-alex I can export http://dir.xiph.org/yp.xml to a different format so you can import it to MariaDB. Which format do you prefer?

[davidhedlund]

@segler-alex I noticed that you are familiar with http://dir.xiph.org/yp.xml in this maililng list http://lists.xiph.org/pipermail/icecast/2009-October/011501.html. Do you already periodically merge http://dir.xiph.org/yp.xml to the database used by radio-browser.info?

[davidhedlund]

https://github.com/segler-alex/radiobrowser-api/issues/34

[davidhedlund]

Sent to the Icecast-dev mailing-list: [Icecast-dev] Please make permanent playlist URLs

[davidhedlund]

https://github.com/segler-alex/radiobrowser/issues/45

[kousu]

Oh!! @davidhedlund nice!! I didn't see this issue when I posted in https://github.com/segler-alex/radiobrowser/issues/45. You're proactive!

[kousu]

The nice advantage Radio-Browser has over Xiph's raw data is the crowdsourced metadata/voting. The VLC radio directory always loads in a different order and with no tags and I never know what's good. I just click at random until I find something I like.

[davidhedlund]

Oh!! @davidhedlund nice!! I didn't see this issue when I posted in segler-alex/radiobrowser#45. You're proactive!

Thank you. Hopefully the Icecast Radio Directory will be imported in the future so you can add votes to their stations on radio-browser.info.