B-AROL-O / ARNEIS

Automated Recognizer, Network-Enabled, Items Sorter
https://arneis.readthedocs.io
MIT License
22 stars 9 forks source link

[FEAT]: Migrate media storage area of the ARNEIS Project from Azure to Cubbit #171

Open gmacario opened 2 years ago

gmacario commented 2 years ago

Description

At the moment each of us is storing multimedia data on his own account.

Let's create a common area using our MS Azure credits. We may transfer the contents to another storage before the credit expires (2022-07-26)

Additional Information

No response

gmacario commented 2 years ago

Learning how to use Azure Storage service

gmacario commented 2 years ago

Managed to create a storage account "arneis" from https://portal.azure.com

Installed Azure Storage Explorer and uploaded a couple of sample files under Blob Container "arneis-videos"

image

gmacario commented 2 years ago

Got the public URL of one sample file which I just uploaded to "arneis-videos"

https://portal.azure.com/#blade/Microsoft_Azure_Storage/ContainerMenuBlade/overview/storageAccountId/%2Fsubscriptions%2Fd09e457a-8b9a-489b-bafc-96e653d6c990%2FresourceGroups%2FNetworkWatcherRG%2Fproviders%2FMicrosoft.Storage%2FstorageAccounts%2Farneis/path/arneis-videos/etag/%220x8D9F68602C7C049%22/defaultEncryptionScope/%24account-encryption-key/denyEncryptionScopeOverride//defaultId//publicAccessVal/None

image

gmacario commented 2 years ago

Pasting the URL into a browser in incognito mode to check whether the object is publicly accessible:

https://arneis.blob.core.windows.net/arneis-videos/2022-02-11%2016.29.23.mp4

image

Result --> It is not (hopefully) publicly accessible, but needs authentication first

Next step: Understand how to grant access to other users

gmacario commented 2 years ago

Created a new storage container "public-folder" and gave public access level to Container

image

Please test:

gmacario commented 2 years ago

FYI: I just uploaded "arneis-conveyor-20220312.pdf" (140.1 MB) to the ARNEIS public-folder

Link: https://arneis.blob.core.windows.net/public-folder/arneis-conveyor-20220312.pdf

gteti commented 2 years ago

How can we access it remotely ?

immagine

gmacario commented 2 years ago

How can we access it remotely ?

immagine

With the current permissions the folder is by design NOT publicly accessible, while the contained objects are.

I can explain in more detail when we meet in person

gmacario commented 1 year ago

This folder should probably be transferred to a common storage area for baroloteam projects - for instance on Cubbit cloud. See https://github.com/B-AROL-O/opencv-ai-competition-2023/issues/48

gmacario commented 1 year ago

Not urgent.

Postponed until resolution of https://github.com/B-AROL-O/opencv-ai-competition-2023/issues/48 and https://github.com/B-AROL-O/opencv-ai-competition-2023/issues/78

gmacario commented 1 year ago

I managed to have my personal Azure account reactivated, therefore this task is no longer urgent. Moved to a later Sprint to prioritize other more urgent tasks.

gmacario commented 1 year ago

Cubbit announced they will soon shutdown Cubbit Hatch and will migrate to Cubbit DS3:

image

Postponing resolution until the migration is complete.