vircadia / vircadia-builder

Builds Vircadia's native Interface and Domain server ("Project Athena") on Linux.
GNU General Public License v3.0
20 stars 37 forks source link

S3 Permission Denied when attempting to Exztract qt5-install #77

Open ghost opened 2 years ago

ghost commented 2 years ago

NOte: I'm building on an 18.04/Ubuntu system.

During the "Downloading Qt from AWS" portion of the build, I received a "Connection reset by peer" Checking the S3/URL, I noted:

This XML file does not appear to have any style information associated with it. The document tree is shown below.

AccessDenied Access Denied 806Q918P9KQ03XW0 NBnCleigpSEo8fw7yOWRZe2LkaL7BQHBsn08JJrUrq3DcPGy5Fs5FuxXu0B5b7Mj0trBtHG8TNk=
JulianGro commented 2 years ago

I just tried and can access the file just fine. Have you tried multiple times? Maybe Amazon had some trouble. The URL should be something like https://athena-public.s3.amazonaws.com/dependencies/vcpkg/qt5-install-5.15.2-ubuntu-18.04-amd64.tar.xz

daleglass commented 2 years ago

Mm, I don't think anything changed in that part in a long time. I would suspect network problems on your end or some sort of rare issue, because if S3 breaks a lot of people are going to notice.

Please try again, and if it still doesn't work paste here the full output you're getting.

ghost commented 2 years ago

Hello JulianGro, Hello daleglass, Thank you for the replies. It's rather odd... if I hit up Julian's provided URL, it starts downloading w/o issue. <I'm downloading right now... and may just manually put in the qt dir> I work day-in-day-out in aws... so I'm familiar with S3... :\

Needless to say.. I've attempted to rerun the script a few times.. here's the output

`############################################################

Building

############################################################

Checking whether Qt is already installed... no. -- EXTERNAL_BUILD_ASSETS: https://athena-public.s3.amazonaws.com -- GLES_OPTION: -- Found PythonInterp: /usr/bin/python3 (found version "3.6.9") Using the Python interpreter located at: /usr/bin/python3 ['/home/mbogucki/Vircadia/source/prebuild.py', '--release-type', 'DEV', '--build-root', '/home/mbogucki/Vircadia/build'] Using a packaged Qt cmake path: /home/mbogucki/vircadia-files/qt/qt5-install/lib/cmake Downloading Qt from AWS Extracting https://athena-public.s3.amazonaws.com/dependencies/vcpkg/qt5-install-5.15.2-ubuntu-18.04-amd64.tar.xz to /home/mbogucki/vircadia-files/qt Traceback (most recent call last): File "/home/mbogucki/Vircadia/source/prebuild.py", line 211, in main() File "/home/mbogucki/Vircadia/source/prebuild.py", line 145, in main qt.installQt() File "/home/mbogucki/Vircadia/source/hifi_qt.py", line 210, in installQt hifi_utils.downloadAndExtract(self.qtUrl, self.path) File "/home/mbogucki/Vircadia/source/hifi_utils.py", line 127, in downloadAndExtract tempFileName = downloadFile(url, hash, hasher) File "/home/mbogucki/Vircadia/source/hifi_utils.py", line 113, in downloadFile tempFileName, headers = urllib.request.urlretrieve(url) File "/usr/lib/python3.6/urllib/request.py", line 277, in urlretrieve block = fp.read(bs) File "/usr/lib/python3.6/http/client.py", line 463, in read n = self.readinto(b) File "/usr/lib/python3.6/http/client.py", line 507, in readinto n = self.fp.readinto(b) File "/usr/lib/python3.6/socket.py", line 586, in readinto return self._sock.recv_into(b) File "/usr/lib/python3.6/ssl.py", line 1012, in recv_into return self.read(nbytes, buffer) File "/usr/lib/python3.6/ssl.py", line 874, in read return self._sslobj.read(len, buffer) File "/usr/lib/python3.6/ssl.py", line 631, in read v = self._sslobj.read(len, buffer) ConnectionResetError: [Errno 104] Connection reset by peer CMake Error at CMakeLists.txt:98 (message): prebuild.py failed with error 1

-- Configuring incomplete, errors occurred! To aid with debugging, please re-run with the --collect-info argument.

Fatal error: Command 'cmake ../source' exited with value 1

`

daleglass commented 2 years ago

Very strange... I tried the URL here, downloads perfectly fine for me.

Could you have some sort of proxy or other system that could be interfering? Some kind of firewall, antivirus, etc?

ghost commented 2 years ago

Hi Dale, I have a pfsense-firewall.. but all outbound should be open. I managed to manually download and install the qt-package... which allowed me to move forward. However I'm encountering a new issue w/ jsdoc and NPM. Should I open a new issue or follow up in this thread??

daleglass commented 2 years ago

By the way, is there a reason you need to specifically build on 18.04? Starting with 21.04 you can build against the system Qt packages.

I recall there being some issues with npm, but I thought that was solved at this point. Yeah, please open a separate issue on that.

ghost commented 2 years ago

Well.. my main workstation is 18.04 ... I don't like going bleeding edge since this system is also my "work/dailydriver" system. I did attempt to download and use the appImage but it was missing a ton of dependencies, esp qt-related libraries.

daleglass commented 2 years ago

Fair enough! Please also report issues with the AppImage, it should work correctly.

JulianGro commented 2 years ago

To be fair, 18.04 is what we build the releases on, so it is the most well tested and supported.

Also yeah, there shouldn't be any missing dependencies. Are you sure your 18.04 install is up to date?

ghost commented 2 years ago

Hi JulianGro, Yeah.. my system is up to date...

`$> sudo apt-get upgrade [sudo] password for mbogucki: Reading package lists... Done Building dependency tree Reading state information... Done Calculating upgrade... Done The following packages have been kept back: debhelper libegl-mesa0 libgbm1 libgl1-mesa-dri libgl1-mesa-dri:i386 libglapi-mesa libglapi-mesa:i386 libglx-mesa0 libglx-mesa0:i386 libosmesa6 libxatracker2 mesa-va-drivers mesa-vdpau-drivers my-weather-indicator netplan.io openscad ubuntu-advantage-tools 0 upgraded, 0 newly installed, 0 to remove and 17 not upgraded.


I downloaded a fresh appimage.. and this is what I'm seeing when I invoke: <see attached file -- to save on screen clutter>

foo.txt

JulianGro commented 2 years ago

That is very weird. The AppImage contains that file, it also works on my system which it shouldn't if it doesn't use the file because I am also on Ubuntu 18.04 and cannot have Qt 5.15 installed because of that either.

@mwbogucki could you check if the file is damaged via

echo "8fa373969fb58e50fe4ae66ce0c06a1f5ef314a5ad92f5efcd2e326060e3aa5fea0de082af224518ccf1a5b6896f176a59920deb43cb516852cf2a5183850d3a Vircadia-x86_64_v2021.1.3-Eos.AppImage" | sha512sum -c -
ghost commented 2 years ago

Hi Julian, Here you go: $> echo "8fa373969fb58e50fe4ae66ce0c06a1f5ef314a5ad92f5efcd2e326060e3aa5fea0de082af224518ccf1a5b6896f176a59920deb43cb516852cf2a5183850d3a Vircadia-x86_64_v2021.1.3-Eos.AppImage" | sha512sum -c - Vircadia-x86_64_v2021.1.3-Eos.AppImage: OK

On Thu, Oct 14, 2021 at 3:59 PM Julian Groß @.***> wrote:

That is very weird. The AppImage contains that file, it also works on my system which it shouldn't if it doesn't use the file because I am also on Ubuntu 18.04 and cannot have Qt 5.15 installed because of that either.

@mwbogucki https://github.com/mwbogucki could you check if the file is damaged via

echo "8fa373969fb58e50fe4ae66ce0c06a1f5ef314a5ad92f5efcd2e326060e3aa5fea0de082af224518ccf1a5b6896f176a59920deb43cb516852cf2a5183850d3a Vircadia-x86_64_v2021.1.3-Eos.AppImage" | sha512sum -c -

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/vircadia/vircadia-builder/issues/77#issuecomment-943727342, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAQG2LQTZ4ZESRBNCQAHEWLUG5ABTANCNFSM5F5TBCMQ . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.

JulianGro commented 2 years ago

I am sorry, I honestly have absolutely no idea what could be going wrong on your end.

ghost commented 2 years ago

Julian, No worries... I appreciate you guys making an effort to help out. Here's one thing I did... I mounted the app-image using: $> ./Vircadia-x86_64_v2021.1.3-Eos.AppImage --appimage-mount /tmp/mount_myXXXX

/tmp/.mount_VircadKWV9jE @.***:[/tmp/.mount_VircadKWV9jE]

[16:46:05] $> ll total 0 drwxr-xr-x 5 root root 0 Sep 8 12:14 usr drwxr-xr-x 13 root root 0 Sep 8 12:14 qt5-install lrwxrwxrwx 1 root root 47 Sep 18 21:16 Vircadia.png -> usr/share/icons/hicolor/16x16/apps/Vircadia.png -rw-rw-r-- 1 root root 142 Sep 18 21:16 Vircadia.desktop lrwxrwxrwx 1 root root 12 Sep 18 21:16 .DirIcon -> Vircadia.png lrwxrwxrwx 1 root root 28 Sep 18 21:16 AppRun -> vircadia/interface/interface drwxr-xr-x 9 root root 0 Sep 18 21:16 vircadia

Under ./usr/ ... I see the following subdirs: bin lib64 share

No "lib"

The error I'm seeing is ./Vircadia-x86_64_v2021.1.3-Eos.AppImage: /usr/lib/x86_64-linux-gnu/libQt5Core.so.5

I'm wondering if I need to symbolically link lib64 to lib...

Will monkey around with it.. to see if that may be the case.

--Mike

On Thu, Oct 14, 2021 at 4:41 PM Julian Groß @.***> wrote:

I am sorry, I honestly have absolutely no idea what could be going wrong on your end.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/vircadia/vircadia-builder/issues/77#issuecomment-943757074, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAQG2LSH6R325SQONELQMGTUG5FABANCNFSM5F5TBCMQ . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.

ghost commented 2 years ago

Success!!! I invoked the following:

$>export LD_LIBRARY_PATH=/tmp/ ./Vircadia-x86_64_v2021.1.3-Eos.AppImage

Sorry for all the confusion gentlemen.

--Mike

On Thu, Oct 14, 2021 at 4:49 PM Michael Bogucki @.***> wrote:

Julian, No worries... I appreciate you guys making an effort to help out. Here's one thing I did... I mounted the app-image using: $> ./Vircadia-x86_64_v2021.1.3-Eos.AppImage --appimage-mount /tmp/mount_myXXXX

/tmp/.mount_VircadKWV9jE @.***:[/tmp/.mount_VircadKWV9jE]

[16:46:05] $> ll total 0 drwxr-xr-x 5 root root 0 Sep 8 12:14 usr drwxr-xr-x 13 root root 0 Sep 8 12:14 qt5-install lrwxrwxrwx 1 root root 47 Sep 18 21:16 Vircadia.png -> usr/share/icons/hicolor/16x16/apps/Vircadia.png -rw-rw-r-- 1 root root 142 Sep 18 21:16 Vircadia.desktop lrwxrwxrwx 1 root root 12 Sep 18 21:16 .DirIcon -> Vircadia.png lrwxrwxrwx 1 root root 28 Sep 18 21:16 AppRun -> vircadia/interface/interface drwxr-xr-x 9 root root 0 Sep 18 21:16 vircadia

Under ./usr/ ... I see the following subdirs: bin lib64 share

No "lib"

The error I'm seeing is ./Vircadia-x86_64_v2021.1.3-Eos.AppImage: /usr/lib/x86_64-linux-gnu/libQt5Core.so.5

I'm wondering if I need to symbolically link lib64 to lib...

Will monkey around with it.. to see if that may be the case.

--Mike

On Thu, Oct 14, 2021 at 4:41 PM Julian Groß @.***> wrote:

I am sorry, I honestly have absolutely no idea what could be going wrong on your end.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/vircadia/vircadia-builder/issues/77#issuecomment-943757074, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAQG2LSH6R325SQONELQMGTUG5FABANCNFSM5F5TBCMQ . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.

JulianGro commented 2 years ago

I recall there being some issues with npm, but I thought that was solved at this point. Yeah, please open a separate issue on that.

@mwbogucki https://github.com/vircadia/vircadia/issues/1228#issuecomment-848808726