OpenVisualCloud / Dockerfiles

Optimized media, analytics and graphics software stack images. Use the dockerfile(s) in your project or as a recipe book for bare metal installation.
BSD 3-Clause "New" or "Revised" License
125 stars 77 forks source link

Help with Installation and configuration of OVC stack #503

Closed Mediacast-cloud closed 1 year ago

Mediacast-cloud commented 4 years ago

Hi, We are looking for help in installing and configuring the OVC stack, in particular, the 3 repos;

  1. SVT-HEVC.
  2. WebRTC using Open RTC Kit “CWT’.
  3. CDN Transcoding Sample.

I have attached a simple requirement document to briefly outline the workflow we currently lead in which the OVC stack would fit in. If further details are needed I will be happy to provide.

Media Server - Requirements Sheet.docx

xwu2git commented 4 years ago

Acknowledged. Working on your reqs to see what stacks can meet your needs.

xwu2git commented 4 years ago

The three projects you mentioned have their README.md for installation and configuration steps.

SVT-HEVC: https://github.com/OpenVisualCloud/SVT-HEVC/blob/master/README.md WebRTC OWT: https://github.com/open-webrtc-toolkit/owt-server/blob/master/README.md CDN Transcoding Sample: https://github.com/OpenVisualCloud/CDN-Transcode-Sample/README.md.

Can you highlight what are the specific issues in installation and configuration?

Thanks

xwu2git

Mediacast-cloud commented 4 years ago

Thank you for your support.

the installer says he id facing issues with the webrtc repo. `he quoted:

this is the error i am getting scripts/build.js -t all --check while i run this command rtcConn.target.mk:199: recipe for target 'Release/obj.target/rtcConn/erizo/src/erizo/dtls/DtlsSocket.o'; failed make: *** [Release/obj.target/rtcConn/erizo/src/erizo/dtls/DtlsSocket.o] Error 1 make: Leaving directory '/home/ubuntu/owt-server/source/agent/webrtc/rtcConn/build'

See attached screen shot

Screenshot 2020-06-12 at 21 59 18
xwu2git commented 4 years ago

@qwu16 will help you.

qwu16 commented 4 years ago

There is a new commit in OWT repo which adds a new patch, so we need update related m4 file for OWT. Please check whether it fixes your issue after related pull request is committed and merged later.

dpatel257 commented 4 years ago

There is a new commit in OWT repo which adds a new patch, so we need update related m4 file for OWT. Please check whether it fixes your issue after related pull request is committed and merged later.

Hi @qwu16 , currently owt-server in Dockerfiles is pointing to 4.2.x branch. Which commit are you referring to in this above comment?

Mediacast-cloud commented 4 years ago

Hi @qwu16

Are you referring the active branch updated by starwarfan?

OWT update
Mediacast-cloud commented 4 years ago

When trying to install from 4.3.x same error (see attached) screen shot. Also similar experience in the issue in the link below https://www.freelancer.com/users/l.php?url=https:%2F%2Fgithub.com%2Fopen-webrtc-toolkit%2Fowt-server%2Fissues&sig=2d4ad3f167fed166f7ea5c86d088d8f20e3def70ec16fa9fa24dc4ad142dec6e

OWT ERROR Screen 4.3x .pdf

qwu16 commented 4 years ago

Hi @qwu16

Are you referring the active branch updated by starwarfan?

OWT update

Yes, this commit introduces dependency change. I have committed a PR 505 in OVC Dockerfile repo and please try again after the PR is merged. If your issue still exists, please relocate you dependency install and OWT compile and packing log to one file so that we can better locate the issue.

jhou5 commented 4 years ago

PR#505 is merged to master to fix owt image. I would submit another similar fix for owt-immersive image soon. @Mediacast-cloud pls. have a try and let us know if your issue still exists.

BTW, @qwu16 , for owt images, some of the components are still old version , i.e. SVT HEVC, FFMPEG. I am thinking about upgrading them through using svt-hevc.m4 and ffmpeg.m4. Do you see any side impact?

jhou5 commented 4 years ago

The fix for owt-immersive image is also merged into master now.

qwu16 commented 4 years ago

PR#505 is merged to master to fix owt image. I would submit another similar fix for owt-immersive image soon. @Mediacast-cloud pls. have a try and let us know if your issue still exists.

BTW, @qwu16 , for owt images, some of the components are still old version , i.e. SVT HEVC, FFMPEG. I am thinking about upgrading them through using svt-hevc.m4 and ffmpeg.m4. Do you see any side impact?

@jhou5 Please keep current ffmpeg and SVT HEVC version for OWT. We are not sure if there is any side impact for upgrading cause we don't have a full testing with the newer version. Thanks.

jhou5 commented 4 years ago

@qwu16 OK, I see. Thanks for the reponse.

Mediacast-cloud commented 4 years ago

@qwu16 The error is still prevailing. Please see attached screen shots

OWC OWT INstallation Error-2 OVC OWT `indtall Error-1
qwu16 commented 4 years ago

@qwu16 The error is still prevailing. Please see attached screen shots

OWC OWT INstallation Error-2 OVC OWT `indtall Error-1

Do you update the owt.m4 template and rebuild ovc Dockerfile? According to your snapshot, your node-gyp version is still 7.0.0, and in latest owt.m4 template, we fix the node-gyp version to 6.1.0.

Mediacast-cloud commented 4 years ago

Installer still facing the issue after updating the node-gyp version to 6.1.0 Could there be a dependancy issue with the node?

OWT Installation error-3
qwu16 commented 4 years ago

Installer still facing the issue after updating the node-gyp version to 6.1.0 Could there be a dependancy issue with the node?

OWT Installation error-3

Are you using Dockerfiles in OVC to build OWT or you directly use OWT github master branch to install and build? Please save you dependency install and build process log into a file, then we can better locate the root cause.

Mediacast-cloud commented 4 years ago

Hi. The Installer is using the Master from Github. Please, review the dependency of install and the build process log shared in the attached. I hope it helps in your diagnosis. build_log.log Initial_build_command build_final_result

jhou5 commented 4 years ago

@qwu16 can you pls. help a check @Mediacast-cloud's log?

qwu16 commented 4 years ago

@Mediacast-cloud Do you use the node 8.15.0 to build OWT? It seems that you are using a newer version 14.4.0 to build OWT, and API changed in newer version. Please change node version to OWT required 8.15.0 to have a try.

jhou5 commented 4 years ago

@Mediacast-cloud do you have newly update? Need more support?

Mediacast-cloud commented 4 years ago

Yes, @ jhou5. Our installer continues to face built issues with WebRTC and CDN installations on a Ubuntu's 18.04 OS. Anyone can help is jump start the installation hurdle you know of?

jhou5 commented 4 years ago

have you tried qwu16's solution?

Mediacast-cloud commented 4 years ago

Yes but issues were still present

jhou5 commented 4 years ago

Just tried, I can not reproduce it on my machine. If possible, can you pls. guide me the steps?

Mediacast-cloud commented 4 years ago

Steps for what?

jhou5 commented 4 years ago

For how to reproduce the failure.

Mediacast-cloud commented 4 years ago

I'm sorry. I am not technical but will ask the freelance installer. Do you mean you want screen shots of the issues?

jhou5 commented 4 years ago

Not screen shots of issues. I hope to see how to reproduce the issue so as to know how to help here, as i cannot reproduce it on my side.

Mediacast-cloud commented 4 years ago

How can we do that? Access to the installation server?

jhou5 commented 4 years ago

Maybe step by step for how to reproduce the issue on a clean linux OS.

Mediacast-cloud commented 4 years ago

Yes. I certainly agree @jhou5 . I can prepare a fresh server tomorrow.

Mediacast-cloud commented 4 years ago

@jhou5 Will the below server specs suffice for installation of the OVC 3 repos (SVT-HEVC, WEbRTC and CDN)? The VPS Server Specs are: 10 CPU cores 60 GB RAM 1600 GB disk space SSD Webmin + LAMP1 1 Gbit/s port 1x IP address (let me know if you need more) OS choices: Ubuntu 16.04,18.04 or 20.04 Or Cent 7 or 8 or Debian 9 0r 10

jhou5 commented 4 years ago

Server config doesn't help. To be helpful, I need to know how to reproduce the issue on a clean linux OS.

Mediacast-cloud commented 4 years ago

@jhou5 I prepared a clean ubuntu 18.04 OS. Will this suffice for you to reproduce the issue?

jhou5 commented 4 years ago

i have clean ubuntu 18.04 OS installed, I don't know how to reproduce your issue.

Mediacast-cloud commented 4 years ago

It would help us better if you would carryout a new installation of the stack

Mediacast-cloud commented 4 years ago

Hi Still looking for help on OVC Stack installation. payment can be made for this

xwu2git commented 4 years ago

Let's reset and sort out things a bit cleaner. Cloud you list explicitly what's the current blocking issues? Please be specific about what images are the issues. I see the OWT image build is one of them and it is still not resolved? @qwu16

Mediacast-cloud commented 4 years ago

Thank you @xwu2git for the initiative. I hired a freelancer to carryout the installation of the 3 repos; 1- SVT-HEVC. 2- WebRTC using Open RTC Kit “OWT’. 3- CDN Transcoding Sample.

The installer faced node dependency issues with the WebRTC ''OWT' and the CDN repos installations on an Ubuntu 18.04 OS from the GitHub branch master. He has since gave up. First error was: scripts/build.js -t all --check while he ran this command rtcConn.target.mk:199: recipe for target 'Release/obj.target/rtcConn/erizo/src/erizo/dtls/DtlsSocket.o'; failed make: *** [Release/obj.target/rtcConn/erizo/src/erizo/dtls/DtlsSocket.o] Error 1 make: Leaving directory '/home/ubuntu/owt-server/source/agent/webrtc/rtcConn/build' despite changing to the owt.m4 template after the fix of the node-gyp version to 6.1.0 and using the node 8.15.0 to build OWT

qwu16 commented 4 years ago

It seems that your webrtc dependency is not successfully installed. Is there any network limit for your network to access Google website, WebRTC dependency needs to access to Google website to get some files. I am not sure which OWT source code version are you using, if you are not using the latest master branch OWT code, you get get the OWT dev image of recent released OWT version which includes all the dependencies and OWT source code of recent released version by: docker pull openvisualcloud/xeon-ubuntu1804-service-dev. With this image, you can modify OWT source code and build your own package.

Mediacast-cloud commented 4 years ago

Thank you @qwu16 There are no network limits. The server side set up is at a Data Centre so access to a Google website is not a problem. I am not sure which OWT version the freelance installer used but in the new installation efforts pulling docker files is a better approach to go for.

Do you know of a qualified installer who can carry out the stack installation for us? if not what basic skills should a freelancer have to be able to carry these installations?

xwu2git commented 4 years ago

I just built the following two builds from the master branch on a clean system: (1) Dockerfiles: xeon-ubuntu1804-service-owt (2) Video conferencing sample. There is no build issue in either case.

Could you please retry? Make sure the proxy setting is correctly set if your are behind a firewall. The build system datetime must be set correctly. In general though, please build from a released branch. The latest is v20.7. Master might have temporarily hiccups due to active development.

Mediacast-cloud commented 4 years ago

Thank you @xwu2git for the efforts I will have to hire a freelancer to carry out this installation. I will off course convey your recommendations