Azure / azure-media-migration

Azure Media Migration Tool
https://github.com/Azure/azure-media-migration
MIT License
11 stars 15 forks source link

Migration fails if file name isn't ASCII character #261

Open mpoozd opened 1 month ago

mpoozd commented 1 month ago

Migration fails if file name in Arabic.

12:06:41 trce: AMSMigrate.Transform.PackageTransform[0] Starting static packaging for asset 6edbf7d1-5843-4cc9-a3a3-a457e832fb96... 12:06:41 dbug: AMSMigrate.Transform.ShakaPackager[0] Starting packager /app/packager-linux-x64... 12:06:41 trce: AMSMigrate.Transform.ShakaPackager[0] Packager arguments: "stream=video,in=/tmp/AMSMigrate/6edbf7d1-5843-4cc9-a3a3-a457e832fb96/بداية _1920x1080_6000.mp4,out=/tmp/AMSMigrate/6edbf7d1-5843-4cc9-a3a3-a457e832fb96/output/بداية _0.mp4,playlist_name=/tmp/AMSMigrate/6edbf7d1-5843-4cc9-a3a3-a457e832fb96/output/بداية _0.m3u8" "stream=video,in=/tmp/AMSMigrate/6edbf7d1-5843-4cc9-a3a3-a457e832fb96/بداية _1920x1080_4700.mp4,out=/tmp/AMSMigrate/6edbf7d1-5843-4cc9-a3a3-a457e832fb96/output/بداية _1.mp4,playlist_name=/tmp/AMSMigrate/6edbf7d1-5843-4cc9-a3a3-a457e832fb96/output/بداية _1.m3u8" "stream=video,in=/tmp/AMSMigrate/6edbf7d1-5843-4cc9-a3a3-a457e832fb96/بداية _1280x720_3400.mp4,out=/tmp/AMSMigrate/6edbf7d1-5843-4cc9-a3a3-a457e832fb96/output/بداية _2.mp4,playlist_name=/tmp/AMSMigrate/6edbf7d1-5843-4cc9-a3a3-a457e832fb96/output/بداية _2.m3u8" "stream=video,in=/tmp/AMSMigrate/6edbf7d1-5843-4cc9-a3a3-a457e832fb96/بداية _960x540_2250.mp4,out=/tmp/AMSMigrate/6edbf7d1-5843-4cc9-a3a3-a457e832fb96/output/بداية _3.mp4,playlist_name=/tmp/AMSMigrate/6edbf7d1-5843-4cc9-a3a3-a457e832fb96/output/بداية _3.m3u8" "stream=video,in=/tmp/AMSMigrate/6edbf7d1-5843-4cc9-a3a3-a457e832fb96/بداية _960x540_1500.mp4,out=/tmp/AMSMigrate/6edbf7d1-5843-4cc9-a3a3-a457e832fb96/output/بداية _4.mp4,playlist_name=/tmp/AMSMigrate/6edbf7d1-5843-4cc9-a3a3-a457e832fb96/output/بداية _4.m3u8" "stream=video,in=/tmp/AMSMigrate/6edbf7d1-5843-4cc9-a3a3-a457e832fb96/بداية _640x360_1000.mp4,out=/tmp/AMSMigrate/6edbf7d1-5843-4cc9-a3a3-a457e832fb96/output/بداية _5.mp4,playlist_name=/tmp/AMSMigrate/6edbf7d1-5843-4cc9-a3a3-a457e832fb96/output/بداية _5.m3u8" "stream=video,in=/tmp/AMSMigrate/6edbf7d1-5843-4cc9-a3a3-a457e832fb96/بداية _640x360_650.mp4,out=/tmp/AMSMigrate/6edbf7d1-5843-4cc9-a3a3-a457e832fb96/output/بداية _6.mp4,playlist_name=/tmp/AMSMigrate/6edbf7d1-5843-4cc9-a3a3-a457e832fb96/output/بداية _6.m3u8" "stream=video,in=/tmp/AMSMigrate/6edbf7d1-5843-4cc9-a3a3-a457e832fb96/بداية _320x180_400.mp4,out=/tmp/AMSMigrate/6edbf7d1-5843-4cc9-a3a3-a457e832fb96/output/بداية _7.mp4,playlist_name=/tmp/AMSMigrate/6edbf7d1-5843-4cc9-a3a3-a457e832fb96/output/بداية _7.m3u8" "stream=audio,in=/tmp/AMSMigrate/6edbf7d1-5843-4cc9-a3a3-a457e832fb96/بداية _320x180_400.mp4,out=/tmp/AMSMigrate/6edbf7d1-5843-4cc9-a3a3-a457e832fb96/output/بداية _8.mp4,playlist_name=/tmp/AMSMigrate/6edbf7d1-5843-4cc9-a3a3-a457e832fb96/output/بداية _8.m3u8" --temp_dir /tmp/AMSMigrate --mpd_output "/tmp/AMSMigrate/6edbf7d1-5843-4cc9-a3a3-a457e832fb96/output/بداية .mpd" --hls_master_playlist_output "/tmp/AMSMigrate/6edbf7d1-5843-4cc9-a3a3-a457e832fb96/output/بداية .m3u8" 12:06:41 info: AMSMigrate.Transform.ShakaPackager[101] [0730/120641:INFO:demuxer.cc(89)] Demuxer::Run() on file '/tmp/AMSMigrate/6edbf7d1-5843-4cc9-a3a3-a457e832fb96/بداية _1280x720_3400.mp4'. 12:06:41 info: AMSMigrate.Transform.ShakaPackager[101] [0730/120641:INFO:demuxer.cc(155)] Initialize Demuxer for file '/tmp/AMSMigrate/6edbf7d1-5843-4cc9-a3a3-a457e832fb96/بداية _1280x720_3400.mp4'. 12:06:41 info: AMSMigrate.Transform.ShakaPackager[101] [0730/120641:INFO:demuxer.cc(89)] Demuxer::Run() on file '/tmp/AMSMigrate/6edbf7d1-5843-4cc9-a3a3-a457e832fb96/بداية _1920x1080_4700.mp4'. 12:06:41 info: AMSMigrate.Transform.ShakaPackager[101] [0730/120641:INFO:demuxer.cc(155)] Initialize Demuxer for file '/tmp/AMSMigrate/6edbf7d1-5843-4cc9-a3a3-a457e832fb96/بداية _1920x1080_4700.mp4'. 12:06:41 info: AMSMigrate.Transform.ShakaPackager[101] [0730/120641:INFO:demuxer.cc(89)] Demuxer::Run() on file '/tmp/AMSMigrate/6edbf7d1-5843-4cc9-a3a3-a457e832fb96/بداية _1920x1080_6000.mp4'. 12:06:41 info: AMSMigrate.Transform.ShakaPackager[101] [0730/120641:INFO:demuxer.cc(155)] Initialize Demuxer for file '/tmp/AMSMigrate/6edbf7d1-5843-4cc9-a3a3-a457e832fb96/بداية _1920x1080_6000.mp4'. 12:06:41 info: AMSMigrate.Transform.ShakaPackager[101] [0730/120641:INFO:demuxer.cc(89)] Demuxer::Run() on file '/tmp/AMSMigrate/6edbf7d1-5843-4cc9-a3a3-a457e832fb96/بداية _320x180_400.mp4'. 12:06:41 info: AMSMigrate.Transform.ShakaPackager[101] [0730/120641:INFO:demuxer.cc(155)] Initialize Demuxer for file '/tmp/AMSMigrate/6edbf7d1-5843-4cc9-a3a3-a457e832fb96/بداية _320x180_400.mp4'. 12:06:41 info: AMSMigrate.Transform.ShakaPackager[101] [0730/120641:INFO:demuxer.cc(89)] Demuxer::Run() on file '/tmp/AMSMigrate/6edbf7d1-5843-4cc9-a3a3-a457e832fb96/بداية _640x360_1000.mp4'. 12:06:41 info: AMSMigrate.Transform.ShakaPackager[101] [0730/120641:INFO:demuxer.cc(155)] Initialize Demuxer for file '/tmp/AMSMigrate/6edbf7d1-5843-4cc9-a3a3-a457e832fb96/بداية _640x360_1000.mp4'. 12:06:41 info: AMSMigrate.Transform.ShakaPackager[101] [0730/120641:INFO:demuxer.cc(89)] Demuxer::Run() on file '/tmp/AMSMigrate/6edbf7d1-5843-4cc9-a3a3-a457e832fb96/بداية _640x360_650.mp4'. 12:06:41 info: AMSMigrate.Transform.ShakaPackager[101] [0730/120641:INFO:demuxer.cc(155)] Initialize Demuxer for file '/tmp/AMSMigrate/6edbf7d1-5843-4cc9-a3a3-a457e832fb96/بداية _640x360_650.mp4'. 12:06:41 info: AMSMigrate.Transform.ShakaPackager[101] [0730/120641:INFO:demuxer.cc(89)] Demuxer::Run() on file '/tmp/AMSMigrate/6edbf7d1-5843-4cc9-a3a3-a457e832fb96/بداية _960x540_1500.mp4'. 12:06:41 info: AMSMigrate.Transform.ShakaPackager[101] [0730/120641:INFO:demuxer.cc(155)] Initialize Demuxer for file '/tmp/AMSMigrate/6edbf7d1-5843-4cc9-a3a3-a457e832fb96/بداية _960x540_1500.mp4'. 12:06:41 info: AMSMigrate.Transform.ShakaPackager[101] [0730/120641:INFO:demuxer.cc(89)] Demuxer::Run() on file '/tmp/AMSMigrate/6edbf7d1-5843-4cc9-a3a3-a457e832fb96/بداية _960x540_2250.mp4'. 12:06:41 info: AMSMigrate.Transform.ShakaPackager[101] [0730/120641:INFO:demuxer.cc(155)] Initialize Demuxer for file '/tmp/AMSMigrate/6edbf7d1-5843-4cc9-a3a3-a457e832fb96/بداية _960x540_2250.mp4'. 12:06:41 fail: AMSMigrate.Transform.ShakaPackager[101] [0730/120641:ERROR:packager_main.cc(554)] Packaging Error: 5 (FILE_FAILURE): Cannot open file for reading /tmp/AMSMigrate/6edbf7d1-5843-4cc9-a3a3-a457e832fb96/بداية _1280x720_3400.mp4 12:06:41 fail: AMSMigrate.Transform.ShakaPackager[0] Packager /app/packager-linux-x64 finished with exit code 2 12:06:41 fail: AMSMigrate.Transform.PackageTransform[0] Failed to migrate asset 6edbf7d1-5843-4cc9-a3a3-a457e832fb96 Error:System.ComponentModel.Win32Exception (2): /app/packager-linux-x64 failed at AMSMigrate.Transform.PackageTransform.TransformAsync(AssetDetails details, ValueTuple2 outputPath, CancellationToken cancellationToken) in /src/transform/PackageTransform.cs:line 168 12:06:44 trce: AMSMigrate.Azure.AzureStorageUploader[0] The lease-detect blob for output path under 6edbf7d1-5843-4cc9-a3a3-a457e832fb96 is deleted.

12:07:09 fail: AMSMigrate.Ams.AssetMigrator[0] Failed to migrate asset 6edbf7d1-5843-4cc9-a3a3-a457e832fb96. System.AggregateException: Retry failed after 6 tries. Retry settings can be adjusted in ClientOptions.Retry or by configuring a custom retry policy in ClientOptions.RetryPolicy. (Request headers must contain only ASCII characters.) (Request headers must contain only ASCII characters.) (Request headers must contain only ASCII characters.) (Request headers must contain only ASCII characters.) (Request headers must contain only ASCII characters.) (Request headers must contain only ASCII characters.) ---> Azure.RequestFailedException: Request headers must contain only ASCII characters. ---> System.Net.Http.HttpRequestException: Request headers must contain only ASCII characters. at System.Net.Http.HttpConnection.WriteStringAsync(String s, Boolean async) at System.Net.Http.HttpConnection.WriteStringAsync(String s, Boolean async, Encoding encoding) at System.Net.Http.HttpConnection.WriteHeadersAsync(HttpHeaders headers, String cookiesFromContainer, Boolean async) at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken)

mpoozd commented 1 month ago

@duggaraju any thoughts ?