AWS S3 on YouPHPTube

[davidjmaxey]

Is there a file size limit to the videos stored on s3? Is so how big? Also, it seems like I get lots of very small files sent to the s3 bucket but not any video files themselves? Where can I verify that I have the correct information?

[DanielnetoDotCom]

Hi, I am not aware about any file limit.

also should go only video files to your S3.

do you have clouflare or something similar on your server?

Atenciosamente

Daniel Neto

Master in Systems and Computing (2009) Specialist in WEB Systems and Applications (2005) http://buscatextual.cnpq.br/buscatextual/visualizacv.do?id=K4252385T9

PHP ZEND 4/5 Certified Engineer PHP Zend Certification - Authentication http://zend.com/zce.php?c=ZEND001318&r=209210010

Programming in HTML5 with JavaScript and CSS3 Specialist (MCP 70-480) https://mcp.microsoft.com/authenticate/ValidateMCP.aspx Transcript ID (1040640) and the Access Code (danielNeto)

On Wed, Apr 25, 2018 at 2:54 PM, davidjmaxey notifications@github.com wrote:

Is there a file size limit to the videos stored on s3? Is so how big? Also, it seems like I get lots of very small files sent to the s3 bucket but not any video files themselves? Where can I verify that I have the correct information?

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/DanielnetoDotCom/YouPHPTube/issues/631, or mute the thread https://github.com/notifications/unsubscribe-auth/ARLMzY51zT0jsAqsEhp6eiHZ3h25lc4mks5tsLhrgaJpZM4Tj4ox .

[davidjmaxey]

hmm, nope, no cloudflare. Let me try a create a new s3 bucket with user and try again. Also I was not sure what my "profile" is supposed to be?

[DanielnetoDotCom]

are you using amazon?

leave endpoint and profile empty

Atenciosamente

Daniel Neto

Master in Systems and Computing (2009) Specialist in WEB Systems and Applications (2005) http://buscatextual.cnpq.br/buscatextual/visualizacv.do?id=K4252385T9

PHP ZEND 4/5 Certified Engineer PHP Zend Certification - Authentication http://zend.com/zce.php?c=ZEND001318&r=209210010

Programming in HTML5 with JavaScript and CSS3 Specialist (MCP 70-480) https://mcp.microsoft.com/authenticate/ValidateMCP.aspx Transcript ID (1040640) and the Access Code (danielNeto)

On Wed, Apr 25, 2018 at 3:07 PM, davidjmaxey notifications@github.com wrote:

hmm, nope, no cloudflare. Let me try a create a new s3 bucket with user and try again. Also I was not sure what my "profile" is supposed to be?

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/DanielnetoDotCom/YouPHPTube/issues/631#issuecomment-384381229, or mute the thread https://github.com/notifications/unsubscribe-auth/ARLMzeIv5PTJ_FrPEqKySU4yGhN3vPEYks5tsLt0gaJpZM4Tj4ox .

[davidjmaxey]

Still having issues on this. I've created a new bucket and user with correct policies to my knowledges, however, I'm still not getting files moved to the bucket and after a conversion the video itself will not even play.

My bucket is us-east-2 region. Is this S3 Region link correct? https://s3.us-east-2.amazonaws.com/

No sure what else to check at this point?

[DanielnetoDotCom]

Can you please manually update a file to your bucket and share the link here?

also can you please check the streamer log to see it there is something blocking your S3?

Also you can test if your configuration is working access this: http://[YourYPTSite]/plugin/AWS_S3/test.php

Paste the output here

[davidjmaxey]

So when I go here I get a 500 Error page not working. http://media.trinitywired.com/YouPHPTube/plugin/AWS_S3/test.php

Also here is the link from my bucket: https://s3.us-east-2.amazonaws.com/mediatrinitywired/TheWhywasbornoutofpain.mp4

Here is the output from the streamer log file..

[26-Apr-2018 14:19:53 UTC] MP4 All [26-Apr-2018 14:19:53 UTC] {"status":"error", "msg":"getDurationFromFile ERROR, File () Not Found"} [26-Apr-2018 14:19:53 UTC] YouPHPTube-Encoder sending file to https://media.trinitywired.com/youPHPTubeEncoder.json [26-Apr-2018 14:19:53 UTC] YouPHPTube-Encoder reading file from [26-Apr-2018 14:19:53 UTC] YouPHPTube-Streamer answer {"error":false,"video_id":22} [26-Apr-2018 14:19:53 UTC] {"error":false,"format":"mp4","file":"","resolution":"","target":"https:\/\/media.trinitywired.com\/youPHPTubeEncoder.json","postFields":9,"response_raw":"{\"error\":false,\"video_id\":22}","response":$ [26-Apr-2018 14:19:54 UTC] Getting Video File https://media.trinitywired.com/Encoder/videos/original_TheWhywasbornoutofpain_YPTuniqid_5ae1e0092b1d87.51086170 [26-Apr-2018 14:19:54 UTC] runMultiResolution [26-Apr-2018 14:19:54 UTC] YouPHPTube-Encoder Start Encoder [ffmpeg -i /var/www/html/YouPHPTube/Encoder/videos/9_tmpFile.mp4 -vf scale=1280:720 -movflags faststart -preset ultrafast -vcodec h264 -acodec aac -strict -2 -y /var/ww$ [26-Apr-2018 14:20:34 UTC] YouPHPTube-Encoder Start Encoder [ffmpeg -i /var/www/html/YouPHPTube/Encoder/videos/9_tmpFile.mp4 -vf scale=854:480 -movflags faststart -preset ultrafast -vcodec h264 -acodec aac -strict -2 -y /var/www$ [26-Apr-2018 14:21:19 UTC] YouPHPTube-Encoder Start Encoder [ffmpeg -i /var/www/html/YouPHPTube/Encoder/videos/9_tmpFile.mp4 -vf scale=640:360 -movflags faststart -preset ultrafast -vcodec h264 -acodec aac -strict -2 -y /var/www$ [26-Apr-2018 14:21:58 UTC] Duration founded: 0:05:07 [26-Apr-2018 14:21:58 UTC] YouPHPTube-Encoder sending file to https://media.trinitywired.com/youPHPTubeEncoder.json [26-Apr-2018 14:21:58 UTC] YouPHPTube-Encoder reading file from /var/www/html/YouPHPTube/Encoder/videos/9_tmpFile_converted_HD.mp4 [26-Apr-2018 14:22:22 UTC] YouPHPTube-Streamer answer [26-Apr-2018 14:22:22 UTC] {"error":false,"format":"mp4","file":"\/var\/www\/html\/YouPHPTube\/Encoder\/videos\/9_tmpFile_converted_HD.mp4","resolution":"HD","target":"https:\/\/media.trinitywired.com\/youPHPTubeEncoder.json","p$ [26-Apr-2018 14:22:22 UTC] Duration founded: 0:05:07 [26-Apr-2018 14:22:22 UTC] YouPHPTube-Encoder sending file to https://media.trinitywired.com/youPHPTubeEncoder.json [26-Apr-2018 14:22:22 UTC] YouPHPTube-Encoder reading file from /var/www/html/YouPHPTube/Encoder/videos/9_tmpFile_converted_SD.mp4 [26-Apr-2018 14:22:23 UTC] YouPHPTube-Streamer answer [26-Apr-2018 14:22:23 UTC] {"error":false,"format":"mp4","file":"\/var\/www\/html\/YouPHPTube\/Encoder\/videos\/9_tmpFile_converted_SD.mp4","resolution":"SD","target":"https:\/\/media.trinitywired.com\/youPHPTubeEncoder.json","p$ [26-Apr-2018 14:22:23 UTC] Duration founded: 0:05:07 [26-Apr-2018 14:22:23 UTC] YouPHPTube-Encoder sending file to https://media.trinitywired.com/youPHPTubeEncoder.json [26-Apr-2018 14:22:23 UTC] YouPHPTube-Encoder reading file from /var/www/html/YouPHPTube/Encoder/videos/9_tmpFile_converted_Low.mp4 [26-Apr-2018 14:22:24 UTC] YouPHPTube-Streamer answer [26-Apr-2018 14:22:24 UTC] {"error":false,"format":"mp4","file":"\/var\/www\/html\/YouPHPTube\/Encoder\/videos\/9_tmpFile_converted_Low.mp4","resolution":"Low","target":"https:\/\/media.trinitywired.com\/youPHPTubeEncoder.json",$

[DanielnetoDotCom]

your apache error log says:

[Thu Apr 26 14:56:16.289944 2018] [:error] [pid 2055] [client 177.8.94.4:54095] PHP Fatal error:  Uncaught exception 'Aws\\S3\\Exception\\S3Exception' with message 'Error executing "PutObject" on "https://s3.us-east-2.amazonaws.com/media.trinitywired/test.txt"; AWS HTTP error: Client error: `PUT https://s3.us-east-2.amazonaws.com/media.trinitywired/test.txt` resulted in a `404 Not Found` response:\n<?xml version="1.0" encoding="UTF-8"?>\n<Error><Code>NoSuchBucket</Code><Message>The specified bucket does not exist</Mes (truncated...)\n NoSuchBucket (client): The specified bucket does not exist - <?xml version="1.0" encoding="UTF-8"?>\n<Error><Code>NoSuchBucket</Code><Message>The specified bucket does not exist</Message><BucketName>media.trinitywired</BucketName><RequestId>5F1C2154DE0A9FD7</RequestId><HostId>//784+t5qa8egrqmfu+011kBIk0alvwTE42YqFcmBaZDFBfna0e+I0Ux7pUmI+6V37zMoypQvUY=</HostId></Error>'\n\nGuzzleHttp\\Exception\\ClientException: Client error: `PUT https://s3.us-east-2.amazonaws.com/media.trinitywired/test.txt` resulted in a `404 Not Found` response:\n<?xml version="1.0" encoding="UTF-8"?>\n<Error><Code>No in /var/www/html/YouPHPTube/plugin/AWS_S3/aws/Aws/WrappedHttpHandler.php on line 191
[Thu Apr 26 14:56:49.580036 2018] [:error] [pid 3006] [client 177.8.94.4:47988] PHP Fatal error:  Uncaught exception 'Aws\\S3\\Exception\\S3Exception' with message 'Error executing "PutObject" on "https://s3.us-east-2.amazonaws.com/media.trinitywired/test.txt"; AWS HTTP error: Client error: `PUT https://s3.us-east-2.amazonaws.com/media.trinitywired/test.txt` resulted in a `404 Not Found` response:\n<?xml version="1.0" encoding="UTF-8"?>\n<Error><Code>NoSuchBucket</Code><Message>The specified bucket does not exist</Mes (truncated...)\n NoSuchBucket (client): The specified bucket does not exist - <?xml version="1.0" encoding="UTF-8"?>\n<Error><Code>NoSuchBucket</Code><Message>The specified bucket does not exist</Message><BucketName>media.trinitywired</BucketName><RequestId>175AE5D60119ABCE</RequestId><HostId>TVC9GRudnZFEnL9obA0qwMYj0mI5D+hBNhGD6rCcqU/vQw25AwrgYA38gistNvKx7BuEBNEnGXE=</HostId></Error>'\n\nGuzzleHttp\\Exception\\ClientException: Client error: `PUT https://s3.us-east-2.amazonaws.com/media.trinitywired/test.txt` resulted in a `404 Not Found` response:\n<?xml version="1.0" encoding="UTF-8"?>\n<Error><Code>No in /var/www/html/YouPHPTube/plugin/AWS_S3/aws/Aws/WrappedHttpHandler.php on line 191

Looks like you put wrong parameters, as I asked you before, could you please manually upload a file to your bucket and share the link here?

[davidjmaxey]

I listed this in my commend above but here is the link to a file I uploaded. https://s3.us-east-2.amazonaws.com/mediatrinitywired/TheWhywasbornoutofpain.mp4

[davidjmaxey]

Do I need to make the file public? At any rate here is the file link from my comment above. https://s3.us-east-2.amazonaws.com/mediatrinitywired/TheWhywasbornoutofpain.mp4

[DanielnetoDotCom]

Sorry I didnt see above, But I can see one problem, your bucket name is mediatrinitywired NOT media.trinitywired.

Change this on your plugin configuration

[davidjmaxey]

Ok, I did create a new user for the bucket just to make sure I had permissions there correct. Here is the log file now. Still not working.

[26-Apr-2018 15:38:06 UTC] MP4 All [26-Apr-2018 15:38:06 UTC] {"status":"error", "msg":"getDurationFromFile ERROR, File () Not Found"} [26-Apr-2018 15:38:06 UTC] YouPHPTube-Encoder sending file to https://media.trinitywired.com/youPHPTubeEncoder.json [26-Apr-2018 15:38:06 UTC] YouPHPTube-Encoder reading file from [26-Apr-2018 15:38:06 UTC] YouPHPTube-Streamer answer {"error":false,"video_id":19} [26-Apr-2018 15:38:06 UTC] {"error":false,"format":"mp4","file":"","resolution":"","target":"https:\/\/media.trinitywired.com\/youPHPTubeEncoder.json","postFields":9,"response_raw":"{\"error\":false,\"video_id\":19}","response":$ [26-Apr-2018 15:38:09 UTC] Getting Video File https://media.trinitywired.com/Encoder/videos/original_TheWhywasbornoutofpain_YPTuniqid_5ae1f25e028d71.57104505 [26-Apr-2018 15:38:09 UTC] runMultiResolution [26-Apr-2018 15:38:09 UTC] YouPHPTube-Encoder Start Encoder [ffmpeg -i /var/www/html/YouPHPTube/Encoder/videos/2_tmpFile.mp4 -vf scale=1280:720 -movflags faststart -preset ultrafast -vcodec h264 -acodec aac -strict -2 -y /var/ww$ [26-Apr-2018 15:38:47 UTC] YouPHPTube-Encoder Start Encoder [ffmpeg -i /var/www/html/YouPHPTube/Encoder/videos/2_tmpFile.mp4 -vf scale=854:480 -movflags faststart -preset ultrafast -vcodec h264 -acodec aac -strict -2 -y /var/www$ [26-Apr-2018 15:39:32 UTC] YouPHPTube-Encoder Start Encoder [ffmpeg -i /var/www/html/YouPHPTube/Encoder/videos/2_tmpFile.mp4 -vf scale=640:360 -movflags faststart -preset ultrafast -vcodec h264 -acodec aac -strict -2 -y /var/www$ [26-Apr-2018 15:40:11 UTC] Duration founded: 0:05:07 [26-Apr-2018 15:40:11 UTC] YouPHPTube-Encoder sending file to https://media.trinitywired.com/youPHPTubeEncoder.json [26-Apr-2018 15:40:11 UTC] YouPHPTube-Encoder reading file from /var/www/html/YouPHPTube/Encoder/videos/2_tmpFile_converted_HD.mp4 [26-Apr-2018 15:40:34 UTC] YouPHPTube-Streamer answer [26-Apr-2018 15:40:34 UTC] {"error":false,"format":"mp4","file":"\/var\/www\/html\/YouPHPTube\/Encoder\/videos\/2_tmpFile_converted_HD.mp4","resolution":"HD","target":"https:\/\/media.trinitywired.com\/youPHPTubeEncoder.json","p$ [26-Apr-2018 15:40:34 UTC] Duration founded: 0:05:07 [26-Apr-2018 15:40:34 UTC] YouPHPTube-Encoder sending file to https://media.trinitywired.com/youPHPTubeEncoder.json [26-Apr-2018 15:40:34 UTC] YouPHPTube-Encoder reading file from /var/www/html/YouPHPTube/Encoder/videos/2_tmpFile_converted_SD.mp4 [26-Apr-2018 15:40:35 UTC] YouPHPTube-Streamer answer [26-Apr-2018 15:40:35 UTC] {"error":false,"format":"mp4","file":"\/var\/www\/html\/YouPHPTube\/Encoder\/videos\/2_tmpFile_converted_SD.mp4","resolution":"SD","target":"https:\/\/media.trinitywired.com\/youPHPTubeEncoder.json","p$ [26-Apr-2018 15:40:35 UTC] Duration founded: 0:05:07 [26-Apr-2018 15:40:35 UTC] YouPHPTube-Encoder sending file to https://media.trinitywired.com/youPHPTubeEncoder.json [26-Apr-2018 15:40:35 UTC] YouPHPTube-Encoder reading file from /var/www/html/YouPHPTube/Encoder/videos/2_tmpFile_converted_Low.mp4 [26-Apr-2018 15:40:36 UTC] YouPHPTube-Streamer answer [26-Apr-2018 15:40:36 UTC] {"error":false,"format":"mp4","file":"\/var\/www\/html\/YouPHPTube\/Encoder\/videos\/2_tmpFile_converted_Low.mp4","resolution":"Low","target":"https:\/\/media.trinitywired.com\/youPHPTubeEncoder.json",$

[DanielnetoDotCom]

@davidjmaxey the log you are placing here is for the encoder, NOT for the streamer. I didnt mean you to create a new user, just change the bucket name on the plugin configuration.

if you are using the test.php file to check if it is working, check the apache.log file on /var/log/apache2/error.log

[davidjmaxey]

The new user was in AWS not YouPHPTube. That was just for my own peace of mind. I did change the bucket name. Here is the apache2 error log.

[Thu Apr 26 15:58:56.599384 2018] [:error] [pid 2141] [client 68.56.108.219:50145] PHP Fatal error: Uncaught exception 'Aws\S3\Exception\S3Exception' with message 'Error executing "PutObject" on "https://mediatrinitywired.s3.us-east-2.amazonaws.com/test.txt"; AW$

[DanielnetoDotCom]

if you create new user, you will need to update the key and the secret. did you do that?

[DanielnetoDotCom]

I just test your test.php and looks like it is working now

[davidjmaxey]

Correct, just uploading a small video to verify it gets moved to s3 and YES its working! ;) The issue was in the wrong bucket name yes, but then I needed to add AmazonS3FullAccess policy for the AWS user that can access the S3 bucket. Thank you for the help and patience working with me to get this fixed. Have a great day!

[DanielnetoDotCom]

Great I am glad it is working :)

[DanielnetoDotCom]

For those who want to use CDN/Cloudflare https://github.com/DanielnetoDotCom/YouPHPTube/wiki/Using-CDN-for-Videos-Only