search

tomeshnet / ipfs-live-streaming

Like HTTP live streaming, but with IPFS which is maybe better?
GNU General Public License v3.0
449 stars 74 forks source link

ffmpeg starts generating tiny chunks after more about 1.2 hours #33

Closed benhylau closed 6 years ago

benhylau commented 6 years ago

This happened on the ffmpeg server after a streaming for a long time. Notice chunk durations:

added QmZvituPPVigWxMMuz8wwbowbTokytSdLh5yA3FjgNUiCo 201807030033-LIVE277.ts 2018-07-03-02-03-05.ts 16.666000
added QmVojZz89P4Cn9zZZcbywsFMBbYHY5Ex3FhKCaVeKJHwci 201807030033-LIVE278.ts 2018-07-03-02-03-21.ts 16.667000
added QmXH5cXWkWcB8iGuV5TWoEfAjPQG2bdESU3c3viDgaH92L 201807030033-LIVE279.ts 2018-07-03-02-03-38.ts 16.667000
added QmUuy3M5v9S6cT8LAntoDN923GDzu2NAPMAGd2hnDjnVw7 201807030033-LIVE280.ts 2018-07-03-02-03-46.ts 8.333000
added QmdamU22Qn8uAvSF17aymFRrPRbeJw7pbaaJBuMTwhkZWn 201807030033-LIVE281.ts 2018-07-03-02-04-03.ts 16.667000
added QmQUC85DwT1piMmwfZ7zRxDX8BwF1pkpKCtyKrSUcAxKwT 201807030033-LIVE282.ts 2018-07-03-02-04-19.ts 16.033000
added QmUVAAEcej3SaQVWJXuwRvHJkMhZnyYkrrEQ9xn98kjMJK 201807030033-LIVE283.ts 2018-07-03-02-04-35.ts 15.700000
added QmUoHNQ47666xgWnSsucXfrfEGAmouk6WCpeKPFD77wYwa 201807030033-LIVE284.ts 2018-07-03-02-04-49.ts 14.467000
added QmfS9tNyURgfDGcN4xfmKCdcG8d63p3GEdGDoBESG9ZX5c 201807030033-LIVE285.ts 2018-07-03-02-05-06.ts 16.666000
added QmcCUvqM9q5faZYkftndGnYYk272Z5hmVXP144XXoJo7HW 201807030033-LIVE286.ts 2018-07-03-02-05-18.ts 11.900000
added QmUA6AQ83ynUJ1QtvoWDZZcgUUBmrktb6127c83isy3ZQV 201807030033-LIVE287.ts 2018-07-03-02-05-32.ts 13.034000
added QmVuxAqZWRvt3rz1DEU42zoeTEVxeiiQY1zZSZEiCP8zjj 201807030033-LIVE288.ts 2018-07-03-02-06-19.ts 15.000000
added QmQnuqLe5WFVpMn2Jmy33mRtR2toXNSgGKs31L6xsdiPdo 201807030033-LIVE289.ts 2018-07-03-02-20-26.ts 0.001956
added Qmadk5JnsqKaAz7fc1W5khyAxCfMq2hH7dcqWAEXhFkYFq 201807030033-LIVE290.ts 2018-07-03-02-20-33.ts 0.002167
added QmeDuvphcHiLxmz56N8KdDp2E4NEWbPec7BAEQ2AnUtSyY 201807030033-LIVE291.ts 2018-07-03-02-20-41.ts 0.002778
added QmQexUqn8ey1vH6NgpZ9Dv3KtTgyg32YBQFwCFF5gBKoyG 201807030033-LIVE292.ts 2018-07-03-02-20-50.ts 0.002778
added QmbVmhL4omnY4iWefzJpZtgQ4rTbRKJADvUWUK4JpsNjd1 201807030033-LIVE293.ts 2018-07-03-02-20-55.ts 0.001878
added QmTqWSqAB7QzVCv1aGRkCkcP1Hi9txkZDykUm6EDue6v6R 201807030033-LIVE294.ts 2018-07-03-02-21-03.ts 0.002778
added QmQ5ovnJcC1ELAeAmei4qUrse2RfypywKcXjrh5A4btUar 201807030033-LIVE295.ts 2018-07-03-02-21-12.ts 0.002778
added QmPrsJo5Wq7mTtimBFdsMuffANkgePGRVZN6bWj2ypF8FH 201807030033-LIVE296.ts 2018-07-03-02-21-20.ts 0.002267
added QmaJsJhfcR8eUrP9p3Mvb5g3MrCTmSeWRuC784z1xgsJ9w 201807030033-LIVE297.ts 2018-07-03-02-21-28.ts 0.002778
added QmXZGExpKqz7DTKpjw9rkKVGfRUsr6H5XtyUaiXvGLDHo5 201807030033-LIVE298.ts 2018-07-03-02-21-33.ts 0.001644
added QmXgQ3x2Q3hDpHJkV5BeYzTaovaR7hSQd5gH4oAs46g9N9 201807030033-LIVE299.ts 2018-07-03-02-21-37.ts 0.001222
added QmYuibHcwSCJ3msb1T6BmSaWHcF5n8EBH8sFpj9BgJSumG 201807030033-LIVE300.ts 2018-07-03-02-21-41.ts 0.001433
added QmauzZEQ2EQjSrR4B6Mi25Kx2JqezTZi4jRAVpHPPniUeb 201807030033-LIVE301.ts 2018-07-03-02-21-44.ts 0.000778
added QmUNqEBeK6ttRdD7bxHWUg7mcgAtvkoAvBe7FAgAnd3VQv 201807030033-LIVE302.ts 2018-07-03-02-21-49.ts 0.001722
added Qmeq3be2iqSuBSmXgkEsEZW2XUCXNGsc2Vh1UZHZEhm7qY 201807030033-LIVE303.ts 2018-07-03-02-21-52.ts 0.000922
added QmWk6XrdGqd4tsE8rBXSntqEs5Xz8asZnepQxXYthYDZaH 201807030033-LIVE304.ts 2018-07-03-02-21-53.ts 0.000589
added QmZV6D7fC1wfGq1SteVFfH4g2E37Pv9pAu4PBfugPsvxAn 201807030033-LIVE305.ts 2018-07-03-02-21-55.ts 0.000400
added QmQTpLQkXo49XYYKpd8RakWcJsr9Cciosx47W9rrevKFtY 201807030033-LIVE306.ts 2018-07-03-02-22-00.ts 0.001833
added Qmc7v1seFBpga8X7AMUWXGnSfoii2Ytu7oxjcfrZMkLeo9 201807030033-LIVE307.ts 2018-07-03-02-22-08.ts 0.002778
added QmRo8bodcCT6aj1kJiCP1EAmgKDuhrwHCwFPRV6SmnQbNE 201807030033-LIVE308.ts 2018-07-03-02-22-12.ts 0.001156
added QmajgeZ6zcfXiKcFaRiwon8dM6UcTXkxCLumqRoS7Vh1ss 201807030033-LIVE309.ts 2018-07-03-02-22-16.ts 0.001522
added QmXcHtiFGS1ME7z5ASS8Tcoo1cRxscZCujWuPsUpuyA7Rr 201807030033-LIVE310.ts 2018-07-03-02-22-21.ts 0.001556
added QmVTcqAFikVmvaZFF2MSVHgG47jpjLc6zg2py5ohg1nP48 201807030033-LIVE311.ts 2018-07-03-02-22-29.ts 0.002778
added QmVG8S5MuDoiQk5hVznwETokSPf5FDvyHMHwAsNuMCKhQR 201807030033-LIVE312.ts 2018-07-03-02-22-38.ts 0.002778
added QmcpQm8eekq8SLASXGHotjXfoLZWsmPtU6NM8cSp8mEWNo 201807030033-LIVE313.ts 2018-07-03-02-22-45.ts 0.002456
added Qme4Km7WvVVvhqM3uhzUpYF7w4zJ4KepXCsditbTfY3UXZ 201807030033-LIVE314.ts 2018-07-03-02-22-50.ts 0.001622
added QmdJZf7AhCnDnB8asF57NUCN41nGL3J5pyYBB3KxdRZLt3 201807030033-LIVE315.ts 2018-07-03-02-22-56.ts 0.002056
added QmSSt3cDNzM5PjVBQqKBmLuoqgkQDZVgSvq4bcmAxCXtYm 201807030033-LIVE316.ts 2018-07-03-02-23-03.ts 0.002122
added QmegcAY3Z1NecZuS5M2g9XH9SYaCMMwB1F2dCLnyuTGhQJ 201807030033-LIVE317.ts 2018-07-03-02-23-10.ts 0.002556
added QmdDjoobxw71XFh9MHyVCuBxtVMmQsz3CgktA6G63KF6gt 201807030033-LIVE318.ts 2018-07-03-02-23-13.ts 0.000800
added QmRB2THaY6SASDC5gpTDP72ZpGfoaRQMjfSmL26zc7v4Qn 201807030033-LIVE319.ts 2018-07-03-02-23-16.ts 0.001056
added Qmd9B795zArARN7b4VTfJHkGeLVumQGdxDedGPvgkwJdaK 201807030033-LIVE320.ts 2018-07-03-02-23-20.ts 0.001544
added QmcJEdDzsuMJgVtDsJXygvtNP9tZccxwp9KVTUZkKxDq5h 201807030033-LIVE321.ts 2018-07-03-02-23-25.ts 0.001356
added QmcpFhrNsz3Qgj1yM8wtx4MgqpMW7gWZV8kBSQ7erfausq 201807030033-LIVE322.ts 2018-07-03-02-23-26.ts 0.000611
added QmVe8C3n2Cofkn9DHwEscMifhXhxsMmjgdBLHgeugAKwE1 201807030033-LIVE323.ts 2018-07-03-02-23-34.ts 0.002633
added QmPDAdh13YvvToAvfKurrdqy38huwthMTZo9X88ZyhkLai 201807030033-LIVE324.ts 2018-07-03-02-23-40.ts 0.001833
added QmcP8mm7VSZuJp4TDJbic9LhKw58q6rioJFyijaKGhVuud 201807030033-LIVE325.ts 2018-07-03-02-23-43.ts 0.001189
added QmV1t7nGwLxx7NtRhAEFuRiUjhZkdrqHoNqx339PPGmihQ 201807030033-LIVE326.ts 2018-07-03-02-23-46.ts 0.000867
added QmPVghtAM9yFru61P9eHUJWQKvj6voUgw2tzrbPe1biL87 201807030033-LIVE327.ts 2018-07-03-02-23-48.ts 0.000733
added QmVi9mMjvrUcZGJ7bu32E3evcrvEnu3GvhKExvLmPqseMN 201807030033-LIVE328.ts 2018-07-03-02-23-52.ts 0.001289
added QmdDvjWErnCszPusrEUXgnfeofBoQc5naAiHjk2nZ5gwdc 201807030033-LIVE329.ts 2018-07-03-02-23-58.ts 0.002022
added QmcfhzKPxR7KHgdy5zgsHkRebKG8WEzCX3kcs9KshrycVi 201807030033-LIVE330.ts 2018-07-03-02-24-05.ts 0.002378
added QmPvyszp2crU8LWE3iphT1jFMDuxCYMqjpoM45XLSzpsHi 201807030033-LIVE331.ts 2018-07-03-02-24-09.ts 0.001344
added QmTJEw9ASCa2hQ14PYZZoa2Z7hDVToqzaqC7svyodnpLFw 201807030033-LIVE332.ts 2018-07-03-02-24-15.ts 0.001756
added QmX84gNkUywxGFXaz6s2tLbabKpN6anaGtbuqZxHZ56YZ6 201807030033-LIVE333.ts 2018-07-03-02-24-19.ts 0.001611
added QmQ5gXFMgEU66CNPzAHhuoNaNTBjdmiStJCRTVTJKdBgLe 201807030033-LIVE334.ts 2018-07-03-02-24-27.ts 0.002478
added QmNTTEg8ec6EDQ2pwbQPp8PGCzfPdCnxHKFeWwHyjXb695 201807030033-LIVE335.ts 2018-07-03-02-24-34.ts 0.002378
added QmWdDaug5XDe24ypQ9tuAdMq2FYFrFw8bXTZ7kaQ24T2Mg 201807030033-LIVE336.ts 2018-07-03-02-24-42.ts 0.002778
added QmcRUGAPtFWrZRMTfVnxnkeyaPAw2gG6F5Wt5xt8FeL8Tu 201807030033-LIVE337.ts 2018-07-03-02-24-50.ts 0.002578
added QmVV8dtznV6m6fQjd81yv5vikaLE5W48KLraQcXkAAoE7E 201807030033-LIVE338.ts 2018-07-03-02-24-56.ts 0.001878
added QmayCpDeS3yVn4PWxRLZZBDvfwDVF1Q9FWiqnKW5a6TFKc 201807030033-LIVE339.ts 2018-07-03-02-24-59.ts 0.000656
added QmSdkTwDsA7ZXek7H46LHHic3zm1gE9DqG7w25xFWC96eL 201807030033-LIVE340.ts 2018-07-03-02-25-00.ts 0.000789
added QmVC9xzBdTvNSvwYDoWQ1BLhwuPpuraE8kiYwxy65nB3ox 201807030033-LIVE341.ts 2018-07-03-02-25-06.ts 0.002011
added QmbGhAdgCxdKRGXk3WWPFXrqxsABP4npULKnYm7Mt9LGLb 201807030033-LIVE342.ts 2018-07-03-02-25-54.ts 15.000000

Then I killed the source stream and that was the end of output. Only after that the m3u8s on both server and mirror synced up. Previously everything including the local ffmpeg generated m3u8 in the live folder was stuck around LIVE287 LIVE288.

This error in ffmpeg logs didn't come up until late into this situation:

Non-monotonous DTS in output stream 0:1;

On the player side, choppy playback and looping content is observed, which is what prompted me to look at logs.

screen shot 2018-07-02 at 10 33 09 pm

benhylau commented 6 years ago

The Non-monotonous DTS in output stream 0:1; seems to occur when OBS Studio disconnects. Restarting ffmpeg manually would fix it:

root@ipfs-server:~# systemctl restart process-stream.service
benhylau commented 6 years ago

Same case as: https://github.com/tomeshnet/ipfs-live-streaming/issues/45