Closed zeyoner closed 5 years ago
Can you provide your config? Also the mount.log may help. Also the rclone.conf might be part of it... it's hard to tell off hand so far.
Here ya go. config.txt rclone.txt
So I am thinking it has more do do with your rclone.conf, I know on ls.io discord you mentioned using a Media dir. I'd recommend setting this in the config and rerunning setup, it will adjust your rclone mount points to ensure their correct.
google_drive_media_directory="" # Empty means media files are in root
This is what my rclone.conf looks like:
[gd]
type = drive
client_id = **Redacted**
client_secret = **Redacted**
token = **Redacted**
[gd-crypt]
type = crypt
remote = gd:Media
filename_encryption = standard
password =**Redacted**
password2 =
directory_name_encryption = true
[local-crypt]
type = crypt
remote = /opt/cloud-media-scripts/.cloud-encrypt/Media
filename_encryption = standard
password = **Redacted**
password2 =
directory_name_encryption = true
Also the setup.sh isnt built around using install_dir, but you could edit it as necessary. Also you could run the curl /w the install dir instead?
bash <( curl -Ls https://github.com/madslundt/cloud-media-scripts/raw/master/INSTALL ) [PATH]
Replace [PATH] /w /mnt/storage/cloud
Alright so I went ahead and ran the umount.remote and removed all traces of the scripts.
From /opt I ran bash <( curl -Ls https://github.com/madslundt/cloud-media-scripts/raw/master/INSTALL )
nano /opt/cloud-media-scripts/config
config.txt
bash /opt/cloud-media-scripts/setup.sh
rclone setup rclone.txt
plexdrive setup
mount.remote [ 2018-02-11@11:39:00 ] ###### Start Mount ###### [ 2018-02-11@11:39:05 ] Mounting Google Drive with Plexdrive in mountpoint: /opt/cloud-media-scripts/.cloud-encrypt [ 2018-02-11@11:39:05 ] Mounted successfully with Plexdrive [ 2018-02-11@11:39:10 ] Mounting decrypted Google Drive with Rclone in mountpoint: /opt/cloud-media-scripts/.cloud-decrypt [ 2018-02-11@11:39:10 ] Mounted successfully with Rclone [ 2018-02-11@11:39:15 ] Could not find decrypted mountpoint: /opt/cloud-media-scripts/.cloud-decrypt. Retrying in 10 seconds. [ 2018-02-11@11:39:25 ] Could not find decrypted mountpoint: /opt/cloud-media-scripts/.cloud-decrypt. Retrying in 10 seconds. [ 2018-02-11@11:39:35 ] Could not find decrypted mountpoint: /opt/cloud-media-scripts/.cloud-decrypt. Retrying in 10 seconds. [ 2018-02-11@11:39:45 ] Could not find decrypted mountpoint: /opt/cloud-media-scripts/.cloud-decrypt. Retrying in 10 seconds. [ 2018-02-11@11:39:55 ] Could not find decrypted mountpoint: /opt/cloud-media-scripts/.cloud-decrypt. Retrying in 10 seconds. [ 2018-02-11@11:40:05 ] Could not read mountpoint: /opt/cloud-media-scripts/.cloud-decrypt [ 2018-02-11@11:40:05 ] Mount failed
What I have noticed is that rclone appears to have two different locations for it's rclone.conf. The one within /opt/cloud-media-scripts/rclone and theirs an other location. I noticed this because if you look at the provided rclone.conf it's from /opt/cloud-media-scripts/rclone it's missing gd
However, when I run rclone config: `root@hoggle:/opt/cloud-media-scripts/rclone# nano rclone.conf Use "fg" to return to nano.
[1]+ Stopped nano rclone.conf root@hoggle:/opt/cloud-media-scripts/rclone# rclone config Current remotes:
Name Type ==== ==== gd drive gd-crypt crypt local-crypt crypt
e) Edit existing remote n) New remote d) Delete remote r) Rename remote c) Copy remote s) Set configuration password q) Quit config e/n/d/r/c/s/q> ` I've verified that the all three of the remotes are correct. My assumption is that when I first ran the Easy install and it didn't work for me. So I went ahead and attempted the manual path where I installed rclone myself. So the system now has rclone installed outside of the Easy install. I've also tried configuring the rclone.conf in /opt/cloud-media-scripts/rclone so that it's correct. Still does not mount.
Now I don't believe the setup.sh is even using the rclone.conf in /opt/cloud-media-scripts/rclone. Reason being that when I run the setup.sh and I get to the rclone setup it already has all three remotes configured even after completely removing the directory /opt/cloud-media-scripts/ and reinstalling then setup.sh the rclone configuration is still there.
rclong config is going to use the default rclone config location which isnt that folder. You need to do
rclone --config /opt/cloud-media-scripts/rclone/rclone.conf config
to get it to use the right one.
setup.sh does this which will replace the rclone_config from config.
${rclone_bin} --config=${rclone_config} config
rclone_config is set to
rclone_config="${rclone_dir}/rclone.conf"
rclone_dir="${install_dir}/rclone"
and your install dir was
install_dir="/opt/cloud-media-scripts"
I understand all of that. However nothing has changed. Even with me changing the location of the rclone.conf with rclone --config /opt/cloud-media-scripts/rclone/rclone.conf config
it does not make a difference. As for everything else it's been set to defaults. I posted the config in the previous post.
I've run out of ideas. It refuses to find the decrypted mountpoint even though it states it's mounted successfully.
2 things to check....
It's empty.
Then you have deeper issues, something /w your rclone isnt right. You should see the encrypted data. You need to test your rclone further to see if its even working properly... like
rclone ls --config /opt/cloud-media-scripts/rclone/rclone.conf gd:
and see if things show. And I flipped what I said last post, can you provide
/opt/cloud-media-scripts/rclone/rclone.conf (redact as needed for client id etc...)
rclone ls --config /opt/cloud-media-scripts/rclone/rclone.conf gd:
scrolled all of the junk I have on GDrive.
[gd-crypt]
type = crypt
remote = gd:
filename_encryption = standard
password =
[local-crypt]
type = crypt
remote = /opt/cloud-media-scripts/.cloud-encrypt/
filename_encryption = standard
password =
[gd] type = drive client_id = client_secret = service_account_file = token = Redacted
OK so I know you mentioned you store it all in a subdir, so you need to rerun the setup after you update your location in config.... like mine is Media. Your mount locations are wrong due to yours being "".
google_drive_media_directory="Media" # Empty means media files are in root
I've made the change to config google_drive_media_directory="Media" # Empty means media files are in root
root@hoggle:/# bash /opt/cloud-media-scripts/setup.sh
Ign:1 http://deb.debian.org/debian stretch InRelease
Get:2 http://deb.debian.org/debian stretch-updates InRelease [91.0 kB]
Get:3 http://deb.debian.org/debian stretch-backports InRelease [91.8 kB]
Hit:4 http://deb.debian.org/debian stretch Release
Hit:5 https://download.docker.com/linux/debian stretch InRelease
Get:6 http://deb.debian.org/debian stretch-backports/main amd64 Packages.diff/Index [27.8 kB]
Get:7 http://deb.debian.org/debian stretch-backports/main Translation-en.diff/Index [27.8 kB]
Get:8 http://deb.debian.org/debian stretch-backports/main amd64 Packages 2018-02-11-1425.25.pdiff [23.6 kB]
Get:8 http://deb.debian.org/debian stretch-backports/main amd64 Packages 2018-02-11-1425.25.pdiff [23.6 kB]
Get:9 http://deb.debian.org/debian stretch-backports/main Translation-en 2018-02-11-1425.25.pdiff [1,495 B]
Get:9 http://deb.debian.org/debian stretch-backports/main Translation-en 2018-02-11-1425.25.pdiff [1,495 B]
Get:11 http://security.debian.org/debian-security stretch/updates InRelease [63.0 kB]
Fetched 327 kB in 4s (80.8 kB/s)
Reading package lists... Done
Installing dependencies
Checking Rclone and PlexdriveRclone is already in version v1.39. Do you want to run setup anyway? [Y/n]? y --2018-02-11 16:00:17-- https://github.com/ncw/rclone/releases/download/v1.39/rclone-v1.39-linux-amd64.zip Resolving github.com (github.com)... 192.30.253.112, 192.30.253.113 Connecting to github.com (github.com)|192.30.253.112|:443... connected. HTTP request sent, awaiting response... 302 Found Location: https://github-production-release-asset-2e65be.s3.amazonaws.com/17803236/0e0bb858-e7e6-11e7-8348-13f9448e7a80?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIWNJYAX4CSVEH53A%2F20180211%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20180211T210017Z&X-Amz-Expires=300&X-Amz-Signature=83a634c19e0f66d37e03dbc2b1c19eaa4c42b0ed35a2647e097f3d4d56a9c794&X-Amz-SignedHeaders=host&actor_id=0&response-content-disposition=attachment%3B%20filename%3Drclone-v1.39-linux-amd64.zip&response-content-type=application%2Foctet-stream [following] --2018-02-11 16:00:17-- https://github-production-release-asset-2e65be.s3.amazonaws.com/17803236/0e0bb858-e7e6-11e7-8348-13f9448e7a80?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIWNJYAX4CSVEH53A%2F20180211%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20180211T210017Z&X-Amz-Expires=300&X-Amz-Signature=83a634c19e0f66d37e03dbc2b1c19eaa4c42b0ed35a2647e097f3d4d56a9c794&X-Amz-SignedHeaders=host&actor_id=0&response-content-disposition=attachment%3B%20filename%3Drclone-v1.39-linux-amd64.zip&response-content-type=application%2Foctet-stream Resolving github-production-release-asset-2e65be.s3.amazonaws.com (github-production-release-asset-2e65be.s3.amazonaws.com)... 52.216.20.195 Connecting to github-production-release-asset-2e65be.s3.amazonaws.com (github-production-release-asset-2e65be.s3.amazonaws.com)|52.216.20.195|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 6270216 (6.0M) [application/octet-stream] Saving to: ‘rclone-v1.39-linux-amd64.zip’
rclone-v1.39-linux-amd64.zip 100%[=======================================================>] 5.98M 5.69MB/s in 1.1s
2018-02-11 16:00:18 (5.69 MB/s) - ‘rclone-v1.39-linux-amd64.zip’ saved [6270216/6270216]
Archive: rclone-v1.39-linux-amd64.zip
inflating: /opt/cloud-media-scripts/rclone-v1.39-linux-amd64/README.html
inflating: /opt/cloud-media-scripts/rclone-v1.39-linux-amd64/rclone
inflating: /opt/cloud-media-scripts/rclone-v1.39-linux-amd64/rclone.1
inflating: /opt/cloud-media-scripts/rclone-v1.39-linux-amd64/README.txt
--2018-02-11 16:00:18-- https://github.com/dweidenfeld/plexdrive/releases/download/4.0.0/plexdrive-linux-amd64
Resolving github.com (github.com)... 192.30.253.112, 192.30.253.113
Connecting to github.com (github.com)|192.30.253.112|:443... connected.
HTTP request sent, awaiting response... 302 Found
Location: https://github-production-release-asset-2e65be.s3.amazonaws.com/89668997/116d97dc-4d2c-11e7-851d-348db60ea8ec?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIWNJYAX4CSVEH53A%2F20180211%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20180211T210018Z&X-Amz-Expires=300&X-Amz-Signature=1cff17ca3972bf193039118bcb006218fb392a75418026418f2851625253d475&X-Amz-SignedHeaders=host&actor_id=0&response-content-disposition=attachment%3B%20filename%3Dplexdrive-linux-amd64&response-content-type=application%2Foctet-stream [following]
--2018-02-11 16:00:18-- https://github-production-release-asset-2e65be.s3.amazonaws.com/89668997/116d97dc-4d2c-11e7-851d-348db60ea8ec?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIWNJYAX4CSVEH53A%2F20180211%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20180211T210018Z&X-Amz-Expires=300&X-Amz-Signature=1cff17ca3972bf193039118bcb006218fb392a75418026418f2851625253d475&X-Amz-SignedHeaders=host&actor_id=0&response-content-disposition=attachment%3B%20filename%3Dplexdrive-linux-amd64&response-content-type=application%2Foctet-stream
Resolving github-production-release-asset-2e65be.s3.amazonaws.com (github-production-release-asset-2e65be.s3.amazonaws.com)... 52.216.20.195
Connecting to github-production-release-asset-2e65be.s3.amazonaws.com (github-production-release-asset-2e65be.s3.amazonaws.com)|52.216.20.195|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 10546476 (10M) [application/octet-stream]
Saving to: ‘plexdrive-linux-amd64’
plexdrive-linux-amd64 100%[=======================================================>] 10.06M 7.18MB/s in 1.4s
2018-02-11 16:00:20 (7.18 MB/s) - ‘plexdrive-linux-amd64’ saved [10546476/10546476]
Rclone config already exists Do you want to change Rclone config now [Y/n]? y =======RCLONE========
When this is done exit rclone config by pressing 'Q' Current remotes:
Name Type ==== ==== gd drive gd-crypt crypt local-crypt crypt
e) Edit existing remote n) New remote d) Delete remote r) Rename remote c) Copy remote s) Set configuration password q) Quit config e/n/d/r/c/s/q> q
Rclone has successfully been updated Plexdrive config already exists.
Do you want to remount now [Y/n]? y [ 2018-02-11@16:00:28 ] Unmounting decrypted cloud mountpoint -> /opt/cloud-media-scripts/.cloud-decrypt fusermount: failed to unmount /opt/cloud-media-scripts/.cloud-decrypt: Invalid argument [ 2018-02-11@16:00:28 ] Unmounting encrypted cloud mountpoint -> /opt/cloud-media-scripts/.cloud-encrypt [ 2018-02-11@16:00:28 ] Unmounting final library mountpoint -> /mnt/storage/cloud/media fusermount: failed to unmount /mnt/storage/cloud/media: Invalid argument [ 2018-02-11@16:00:28 ] ###### Start Mount ###### [ 2018-02-11@16:00:33 ] Mounting Google Drive with Plexdrive in mountpoint: /opt/cloud-media-scripts/.cloud-encrypt [ 2018-02-11@16:00:33 ] Mounted successfully with Plexdrive [ 2018-02-11@16:00:38 ] Mounting decrypted Google Drive with Rclone in mountpoint: /opt/cloud-media-scripts/.cloud-decrypt [ 2018-02-11@16:00:38 ] Mounted successfully with Rclone [ 2018-02-11@16:00:43 ] Could not find decrypted mountpoint: /opt/cloud-media-scripts/.cloud-decrypt. Retrying in 10 seconds. [ 2018-02-11@16:00:54 ] Could not find decrypted mountpoint: /opt/cloud-media-scripts/.cloud-decrypt. Retrying in 10 seconds. [ 2018-02-11@16:01:04 ] Could not find decrypted mountpoint: /opt/cloud-media-scripts/.cloud-decrypt. Retrying in 10 seconds. [ 2018-02-11@16:01:14 ] Could not find decrypted mountpoint: /opt/cloud-media-scripts/.cloud-decrypt. Retrying in 10 seconds. [ 2018-02-11@16:01:24 ] Could not find decrypted mountpoint: /opt/cloud-media-scripts/.cloud-decrypt. Retrying in 10 seconds. [ 2018-02-11@16:01:34 ] Could not read mountpoint: /opt/cloud-media-scripts/.cloud-decrypt [ 2018-02-11@16:01:34 ] Mount failed
OK so you use encrypted yet made no changes to rclone when you set it up? That looks to be a problem... you put y you want to change, but you didnt go in and set your pw or anything? You need to edit your mounts to set the passwords etc... then q.
`Do you want to change Rclone config now [Y/n]? y
=======RCLONE========
When this is done exit rclone config by pressing 'Q'
Current remotes:
Name Type
==== ====
gd drive
gd-crypt crypt
local-crypt crypt
e) Edit existing remote
n) New remote
d) Delete remote
r) Rename remote
c) Copy remote
s) Set configuration password
q) Quit config
e/n/d/r/c/s/q> q
`
root@hoggle:/# bash /opt/cloud-media-scripts/setup.sh
Ign:1 http://deb.debian.org/debian stretch InRelease
Hit:2 http://deb.debian.org/debian stretch-updates InRelease
Hit:3 http://deb.debian.org/debian stretch-backports InRelease
Hit:4 http://security.debian.org/debian-security stretch/updates InRelease
Hit:5 http://deb.debian.org/debian stretch Release
Hit:6 https://download.docker.com/linux/debian stretch InRelease
Reading package lists... Done
Installing dependencies
Checking Rclone and PlexdriveRclone is already in version v1.39. Do you want to run setup anyway? [Y/n]? n Exiting setup root@hoggle:/# cd /opt/cloud-media-scripts/scripts/ root@hoggle:/opt/cloud-media-scripts/scripts# ./mount.remote [ 2018-02-11@16:11:28 ] ###### Start Mount ###### [ 2018-02-11@16:11:28 ] Google Drive mountpoint: /opt/cloud-media-scripts/.cloud-encrypt already mounted. [ 2018-02-11@16:11:33 ] Mounting decrypted Google Drive with Rclone in mountpoint: /opt/cloud-media-scripts/.cloud-decrypt [ 2018-02-11@16:11:33 ] Mounted successfully with Rclone [ 2018-02-11@16:11:38 ] Could not find decrypted mountpoint: /opt/cloud-media-scripts/.cloud-decrypt. Retrying in 10 seconds. [ 2018-02-11@16:11:48 ] Could not find decrypted mountpoint: /opt/cloud-media-scripts/.cloud-decrypt. Retrying in 10 seconds. [ 2018-02-11@16:11:58 ] Could not find decrypted mountpoint: /opt/cloud-media-scripts/.cloud-decrypt. Retrying in 10 seconds. [ 2018-02-11@16:12:08 ] Could not find decrypted mountpoint: /opt/cloud-media-scripts/.cloud-decrypt. Retrying in 10 seconds. [ 2018-02-11@16:12:18 ] Could not find decrypted mountpoint: /opt/cloud-media-scripts/.cloud-decrypt. Retrying in 10 seconds. [ 2018-02-11@16:12:28 ] Could not read mountpoint: /opt/cloud-media-scripts/.cloud-decrypt [ 2018-02-11@16:12:28 ] Mount failed root@hoggle:/opt/cloud-media-scripts/scripts# rclone config Current remotes:
Name Type ==== ==== gd drive gd-crypt crypt local-crypt crypt
e) Edit existing remote n) New remote d) Delete remote r) Rename remote c) Copy remote s) Set configuration password q) Quit config e/n/d/r/c/s/q> q root@hoggle:/opt/cloud-media-scripts/scripts#
My head is spinning at this point..
Not sure what you're showing? Looks like you didnt change anything. When you run setup.sh you need to go in and edit the rclone.conf and edit gd-crypt and local-crypt by settings your encryption settings.
[gd]
type = drive
client_id = *redacted*
client_secret = *redacted*
token = *redacted*
[gd-crypt]
type = crypt
remote = gd:Media
filename_encryption = standard
password = *redacted*
password2 =
directory_name_encryption = true
[local-crypt]
type = crypt
remote = /opt/cloud-media-scripts/.cloud-encrypt/Media
filename_encryption = standard
password = *redacted*
password2 =
directory_name_encryption = true
I really appreciate you helping me. But I don't understand what it is that you're asking me to do. I've redone the rclone config so many times it's ridiclious. I've done it before running setup.sh and after as well. Still same results. Maybe I'm configuring it wrong?
I followed the following: Endpoint to your cloud storage. Create new remote [Press N] Give it a name (default in config gd) Choose Google Drive [Press 8] If you have a client id paste it here or leave it blank Choose headless machine [Press N] Open the url in your browser and enter the verification code Encryption and decryption for your cloud storage. Create new remote [Press N] Give it the same name as the variable rclone_cloud_endpoint specified in the config but without colon (:) (default in config gd-crypt) Choose Encrypt/Decrypt a remote [Press 5] Enter the name of the endpoint created in cloud-storage appended with a colon (:) and the subfolder on your cloud. Example gd:/Media or just gd: if you have your files in root in the cloud. Choose how to encrypt filenames. I prefer option 2 Encrypt the filenames Choose to either generate your own or random password. I prefer to enter my own. Choose to enter pass phrase for the salt or leave it blank. I prefer to enter my own. Encryption and decryption for your local storage. Create new remote [Press N] Give it the same name as specified in the environment variable rclone_local_endpoint but without colon (:) (default in config local-crypt) Choose Encrypt/Decrypt a remote [Press 5] Enter the encrypted folder specified as cloud_encrypt_dir in config. If you are using subdirectory on Google Drive append it to it. Example /.cloud-encrypt/Media Choose the same filename encrypted as you did with the cloud storage. Enter the same password as you did with the cloud storage. Enter the same pass phrase as you did with the cloud storage.
Now that step by step is outdated. So maybe I'm doing something wrong?
Can you post your rclone.conf now from /opt/cloud-media-scripts/rclone?
[gd-crypt]
type = crypt
remote = gd:
filename_encryption = standard
password =
[local-crypt]
type = crypt
remote = /opt/cloud-media-scripts/.cloud-encrypt/
filename_encryption = standard
password =
[gd] type = drive client_id = client_secret = service_account_file = token = Redacted
That again shows you didn't set your password during setup on the rclone setup. What I'm saying you need to do is say Y for modify rclone config, type e for edit, and set your encryption password in local-crypt and in gd-crypt. It also does not show the gd:Media etc... in the rclone.conf which it should.
During setup.sh it should add the GOOGLE_DRIVE_MEDIA_DIRECTORY after the gd: which isn't showing for you which means the config file wasnt updated to show your correct location for your encrypted dir on Gdrive.
[gd-crypt]
type = crypt
remote = gd:<GOOGLE_DRIVE_MEDIA_DIRECTORY>
filename_encryption = standard
password = <PASSWORD>
password2 = <PASSWORD2>
[local-crypt]
type = crypt
remote = <ENCRYPTED_FOLDER>/<GOOGLE_DRIVE_MEDIA_DIRECTORY>
filename_encryption = standard
password = <PASSWORD>
password2 = <PASSWORD2>
root@hoggle:/opt/cloud-media-scripts/rclone# bash /opt/cloud-media-scripts/setup.sh
Ign:1 http://deb.debian.org/debian stretch InRelease
Get:2 http://deb.debian.org/debian stretch-updates InRelease [91.0 kB]
Get:3 http://deb.debian.org/debian stretch-backports InRelease [91.8 kB]
Get:4 http://security.debian.org/debian-security stretch/updates InRelease [63.0 kB]
Hit:5 http://deb.debian.org/debian stretch Release
Hit:6 https://download.docker.com/linux/debian stretch InRelease
Get:7 http://deb.debian.org/debian stretch-updates/main Sources.diff/Index [2,704 B]
Get:8 http://deb.debian.org/debian stretch-updates/main amd64 Packages.diff/Index [2,704 B]
Get:9 http://deb.debian.org/debian stretch-updates/main Sources 2018-02-11-2045.46.pdiff [623 B]
Get:9 http://deb.debian.org/debian stretch-updates/main Sources 2018-02-11-2045.46.pdiff [623 B]
Get:10 http://deb.debian.org/debian stretch-updates/main amd64 Packages 2018-02-11-2045.46.pdiff [332 B]
Get:10 http://deb.debian.org/debian stretch-updates/main amd64 Packages 2018-02-11-2045.46.pdiff [332 B]
Fetched 252 kB in 1s (223 kB/s)
Reading package lists... Done
Installing dependencies
Checking Rclone and PlexdriveRclone is already in version v1.39. Do you want to run setup anyway? [Y/n]? y
--2018-02-11 17:44:52-- https://github.com/ncw/rclone/releases/download/v1.39/rclone-v1.39-linux-amd64.zip
Resolving github.com (github.com)... 192.30.253.113, 192.30.253.112
Connecting to github.com (github.com)|192.30.253.113|:443... connected.
HTTP request sent, awaiting response... 302 Found
Location: https://github-production-release-asset-2e65be.s3.amazonaws.com/17803236/0e0bb858-e7e6-11e7-8348-13f9448e7a80?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIWNJYAX4CSVEH53A%2F20180211%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20180211T224452Z&X-Amz-Expires=300&X-Amz-Signature=1987fcb37fc8db9f210206f0acfacf51f90be8e2063ee557b624c7430ba2d345&X-Amz-SignedHeaders=host&actor_id=0&response-content-disposition=attachment%3B%20filename%3Drclone-v1.39-linux-amd64.zip&response-content-type=application%2Foctet-stream [following]
--2018-02-11 17:44:52-- https://github-production-release-asset-2e65be.s3.amazonaws.com/17803236/0e0bb858-e7e6-11e7-8348-13f9448e7a80?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIWNJYAX4CSVEH53A%2F20180211%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20180211T224452Z&X-Amz-Expires=300&X-Amz-Signature=1987fcb37fc8db9f210206f0acfacf51f90be8e2063ee557b624c7430ba2d345&X-Amz-SignedHeaders=host&actor_id=0&response-content-disposition=attachment%3B%20filename%3Drclone-v1.39-linux-amd64.zip&response-content-type=application%2Foctet-stream
Resolving github-production-release-asset-2e65be.s3.amazonaws.com (github-production-release-asset-2e65be.s3.amazonaws.com)... 52.216.162.59
Connecting to github-production-release-asset-2e65be.s3.amazonaws.com (github-production-release-asset-2e65be.s3.amazonaws.com)|52.216.162.59|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 6270216 (6.0M) [application/octet-stream]
Saving to: ‘rclone-v1.39-linux-amd64.zip’
rclone-v1.39-linux-amd64.zip 100%[======================================================================>] 5.98M 6.01MB/s in 1.0s
2018-02-11 17:44:53 (6.01 MB/s) - ‘rclone-v1.39-linux-amd64.zip’ saved [6270216/6270216]
Archive: rclone-v1.39-linux-amd64.zip
inflating: /opt/cloud-media-scripts/rclone-v1.39-linux-amd64/README.html
inflating: /opt/cloud-media-scripts/rclone-v1.39-linux-amd64/rclone
inflating: /opt/cloud-media-scripts/rclone-v1.39-linux-amd64/rclone.1
inflating: /opt/cloud-media-scripts/rclone-v1.39-linux-amd64/README.txt
--2018-02-11 17:44:54-- https://github.com/dweidenfeld/plexdrive/releases/download/4.0.0/plexdrive-linux-amd64
Resolving github.com (github.com)... 192.30.253.113, 192.30.253.112
Connecting to github.com (github.com)|192.30.253.113|:443... connected.
HTTP request sent, awaiting response... 302 Found
Location: https://github-production-release-asset-2e65be.s3.amazonaws.com/89668997/116d97dc-4d2c-11e7-851d-348db60ea8ec?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIWNJYAX4CSVEH53A%2F20180211%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20180211T224454Z&X-Amz-Expires=300&X-Amz-Signature=92bc3bf5b0aa9d6b0c4eb4f578845c55c4db6f1de042eb5775e7cd69ceeb6d98&X-Amz-SignedHeaders=host&actor_id=0&response-content-disposition=attachment%3B%20filename%3Dplexdrive-linux-amd64&response-content-type=application%2Foctet-stream [following]
--2018-02-11 17:44:54-- https://github-production-release-asset-2e65be.s3.amazonaws.com/89668997/116d97dc-4d2c-11e7-851d-348db60ea8ec?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIWNJYAX4CSVEH53A%2F20180211%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20180211T224454Z&X-Amz-Expires=300&X-Amz-Signature=92bc3bf5b0aa9d6b0c4eb4f578845c55c4db6f1de042eb5775e7cd69ceeb6d98&X-Amz-SignedHeaders=host&actor_id=0&response-content-disposition=attachment%3B%20filename%3Dplexdrive-linux-amd64&response-content-type=application%2Foctet-stream
Resolving github-production-release-asset-2e65be.s3.amazonaws.com (github-production-release-asset-2e65be.s3.amazonaws.com)... 52.216.162.59
Connecting to github-production-release-asset-2e65be.s3.amazonaws.com (github-production-release-asset-2e65be.s3.amazonaws.com)|52.216.162.59|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 10546476 (10M) [application/octet-stream]
Saving to: ‘plexdrive-linux-amd64’
plexdrive-linux-amd64 100%[======================================================================>] 10.06M 7.54MB/s in 1.3s
2018-02-11 17:44:56 (7.54 MB/s) - ‘plexdrive-linux-amd64’ saved [10546476/10546476]
Rclone config already exists
Do you want to change Rclone config now [Y/n]? y
=======RCLONE========
When this is done exit rclone config by pressing 'Q'
Current remotes:
Name Type
==== ====
gd drive
gd-crypt crypt
local-crypt crypt
e) Edit existing remote
n) New remote
d) Delete remote
r) Rename remote
c) Copy remote
s) Set configuration password
q) Quit config
e/n/d/r/c/s/q> e
Choose a number from below, or type in an existing value
1 > gd
2 > gd-crypt
3 > local-crypt
remote> 2
--------------------
[gd-crypt]
type = crypt
remote = gd:
filename_encryption = standard
password = *** ENCRYPTED ***
password2 = *** ENCRYPTED ***
--------------------
Edit remote
Value "remote" = "gd:"
Edit? (y/n)>
y) Yes
n) No
y/n> n
Value "filename_encryption" = "standard"
Edit? (y/n)>
y) Yes
n) No
y/n> n
Value "directory_name_encryption" = ""
Edit? (y/n)>
y) Yes
n) No
y/n> y
Option to either encrypt directory names or leave them intact.
Choose a number from below, or type in your own value
1 / Encrypt directory names.
\ "true"
2 / Don't encrypt directory names, leave them intact.
\ "false"
directory_name_encryption> 1
Value "password" = "<PASSWORD>"
Edit? (y/n)>
y) Yes
n) No
y/n> y
Password or pass phrase for encryption.
y) Yes type in my own password
g) Generate random password
y/g> y
Enter the password:
password:
Confirm the password:
password:
Value "password2" = "<PASSWORD2>"
Edit? (y/n)>
y) Yes
n) No
y/n> y
Password or pass phrase for salt. Optional but recommended.
Should be different to the previous password.
y) Yes type in my own password
g) Generate random password
n) No leave this optional password blank
y/g/n> @LI@joke!
y/g/n> y
Enter the password:
password:
Confirm the password:
password:
--------------------
[gd-crypt]
type = crypt
remote = gd:
filename_encryption = standard
password = *** ENCRYPTED ***
password2 = *** ENCRYPTED ***
directory_name_encryption = true
--------------------
y) Yes this is OK
e) Edit this remote
d) Delete this remote
y/e/d> y
Remote config
Current remotes:
Name Type
==== ====
gd drive
gd-crypt crypt
local-crypt crypt
e) Edit existing remote
n) New remote
d) Delete remote
r) Rename remote
c) Copy remote
s) Set configuration password
q) Quit config
e/n/d/r/c/s/q> e
Choose a number from below, or type in an existing value
1 > gd
2 > gd-crypt
3 > local-crypt
remote> 3
--------------------
[local-crypt]
type = crypt
remote = /opt/cloud-media-scripts/.cloud-encrypt/
filename_encryption = standard
password = *** ENCRYPTED ***
password2 = *** ENCRYPTED ***
directory_name_encryption = true
--------------------
Edit remote
Value "remote" = "/opt/cloud-media-scripts/.cloud-encrypt/"
Edit? (y/n)>
y) Yes
n) No
y/n> n
Value "filename_encryption" = "standard"
Edit? (y/n)>
y) Yes
n) No
y/n> n
Value "directory_name_encryption" = "true"
Edit? (y/n)>
y) Yes
n) No
y/n> n
Value "password" = "<PASSWORD>"
Edit? (y/n)>
y) Yes
n) No
y/n> y
Password or pass phrase for encryption.
y) Yes type in my own password
g) Generate random password
y/g> y
Enter the password:
password:
Confirm the password:
password:
Value "password2" = "<PASSWORD2>"
Edit? (y/n)>
y) Yes
n) No
y/n> y
Password or pass phrase for salt. Optional but recommended.
Should be different to the previous password.
y) Yes type in my own password
g) Generate random password
n) No leave this optional password blank
y/g/n> y
Enter the password:
password:
Confirm the password:
password:
--------------------
[local-crypt]
type = crypt
remote = /opt/cloud-media-scripts/.cloud-encrypt/
filename_encryption = standard
password = *** ENCRYPTED ***
password2 = *** ENCRYPTED ***
directory_name_encryption = true
--------------------
y) Yes this is OK
e) Edit this remote
d) Delete this remote
y/e/d> y
Remote config
Current remotes:
Name Type
==== ====
gd drive
gd-crypt crypt
local-crypt crypt
e) Edit existing remote
n) New remote
d) Delete remote
r) Rename remote
c) Copy remote
s) Set configuration password
q) Quit config
e/n/d/r/c/s/q> q
Rclone has successfully been updated
Plexdrive config already exists.
Do you want to remount now [Y/n]? y
[ 2018-02-11@17:47:07 ] Unmounting decrypted cloud mountpoint -> /opt/cloud-media-scripts/.cloud-decrypt
fusermount: failed to unmount /opt/cloud-media-scripts/.cloud-decrypt: Invalid argument
[ 2018-02-11@17:47:07 ] Unmounting encrypted cloud mountpoint -> /opt/cloud-media-scripts/.cloud-encrypt
[ 2018-02-11@17:47:07 ] Unmounting final library mountpoint -> /mnt/storage/cloud/media
fusermount: failed to unmount /mnt/storage/cloud/media: Invalid argument
[ 2018-02-11@17:47:07 ] ###### Start Mount ######
[ 2018-02-11@17:47:12 ] Mounting Google Drive with Plexdrive in mountpoint: /opt/cloud-media-scripts/.cloud-encrypt
[ 2018-02-11@17:47:12 ] Mounted successfully with Plexdrive
[ 2018-02-11@17:47:17 ] Mounting decrypted Google Drive with Rclone in mountpoint: /opt/cloud-media-scripts/.cloud-decrypt
[ 2018-02-11@17:47:17 ] Mounted successfully with Rclone
[ 2018-02-11@17:47:22 ] Could not find decrypted mountpoint: /opt/cloud-media-scripts/.cloud-decrypt. Retrying in 10 seconds.
[ 2018-02-11@17:47:32 ] Could not find decrypted mountpoint: /opt/cloud-media-scripts/.cloud-decrypt. Retrying in 10 seconds.
[ 2018-02-11@17:47:42 ] Could not find decrypted mountpoint: /opt/cloud-media-scripts/.cloud-decrypt. Retrying in 10 seconds.
[ 2018-02-11@17:47:52 ] Could not find decrypted mountpoint: /opt/cloud-media-scripts/.cloud-decrypt. Retrying in 10 seconds.
[ 2018-02-11@17:48:02 ] Could not find decrypted mountpoint: /opt/cloud-media-scripts/.cloud-decrypt. Retrying in 10 seconds.
[ 2018-02-11@17:48:12 ] Could not read mountpoint: /opt/cloud-media-scripts/.cloud-decrypt
[ 2018-02-11@17:48:12 ] Mount failed
Can you give me your config now? Something is still not looking right.
#!/bin/bash
# shellcheck disable=SC2034
###############################################################################
# DIRECTORIES
###############################################################################
media_dir="/opt/cloud-media-scripts"
# Cloud directories
cloud_encrypt_dir="${media_dir}/.cloud-encrypt"
cloud_decrypt_dir="${media_dir}/.cloud-decrypt"
# Local directory
local_decrypt_dir="${media_dir}/.local-decrypt/Media"
plexdrive_temp_dir="${media_dir}/.local-decrypt/plexdrive"
# Media directory (FINAL)
local_media_dir="/mnt/storage/cloud/media"
# Encrypt media (0 means no encryption)
encrypt_media=1
###############################################################################
# UNION-FS
###############################################################################
ufs_bin="/usr/bin/unionfs"
# Mount user Id's. Replace $(id with a different ID if you need to override.
uid=$(id -u)
gid=$(id -g)
ufs_options="-o cow,allow_other,direct_io,nonempty,auto_cache,sync_read,uid=$uid,gid=$gid"
###############################################################################
# PLEXDRIVE
###############################################################################
plexdrive_dir="${media_dir}/plexdrive"
plexdrive_bin="${plexdrive_dir}/plexdrive-linux-amd64"
mongo_database="plexdrive"
mongo_host="localhost"
mongo_user=""
mongo_password=""
plexdrive_options="--temp=${plexdrive_temp_dir} -o allow_other,read_only --clear-chunk-max-size=300G --clear-chunk-age=24h --chunk-size=10M"
###############################################################################
# RCLONE
###############################################################################
rclone_dir="${media_dir}/rclone"
rclone_bin="${rclone_dir}/rclone"
rclone_config="${rclone_dir}/rclone.conf"
rclone_options="--buffer-size 500M --checkers 16"
rclone_mount_options="${rclone_options} --read-only --allow-non-empty --allow-other --max-read-ahead 30G"
# Rclone endpoints
rclone_cloud_endpoint="gd-crypt:"
rclone_local_endpoint="local-crypt:"
google_drive_media_directory="Media" # Empty means media files are in root
###############################################################################
# Plex (empty trash)
###############################################################################
plexdrive_dir="${media_dir}/plexdrive"
plexdrive_bin="${plexdrive_dir}/plexdrive-linux-amd64"
mongo_database="plexdrive"
mongo_host="localhost"
mongo_user=""
mongo_password=""
plexdrive_options="--temp=${plexdrive_temp_dir} -o allow_other,read_only --clear-chunk-max-size=300G --clear-chunk-age=24h --chunk-size=10M"
###############################################################################
# RCLONE
###############################################################################
rclone_dir="${media_dir}/rclone"
rclone_bin="${rclone_dir}/rclone"
rclone_config="${rclone_dir}/rclone.conf"
rclone_options="--buffer-size 500M --checkers 16"
rclone_mount_options="${rclone_options} --read-only --allow-non-empty --allow-other --max-read-ahead 30G"
# Rclone endpoints
rclone_cloud_endpoint="gd-crypt:"
rclone_local_endpoint="local-crypt:"
google_drive_media_directory="Media" # Empty means media files are in root
###############################################################################
# Plex (empty trash)
###############################################################################
plex_url="http://localhost:32400"
plex_token="dmGLYzzQXzg3hUU5nycK"
###############################################################################
# MISC. CONFIG
###############################################################################
date_format="+%F@%T"
# Select to remove media files based on 'time', 'space' or 'instant'
#remove_files_based_on="instant"
#remove_files_based_on="time"
remove_files_based_on="space"
# Remove media files based on 'time'
remove_files_older_than=60 # In days
# Remove media files based on 'space'
remove_files_when_space_exceeds=500 # In Gigabytes
freeup_atleast=300 # In Gigabytes
For some reason the .sh script it not pulling in your Media folder.
Does your setup.sh have the config in the proper place?
########## CONFIGURATION ##########
. "/opt/cloud-media-scripts/config"
###################################
#!/bin/bash
########## CONFIGURATION ##########
. "/opt/cloud-media-scripts/config"
###################################
########## DOWNLOADS ##########
# Rclone
_rclone_version="v1.39"
_rclone_release="rclone-${_rclone_version}-linux-amd64"
_rclone_zip="${_rclone_release}.zip"
_rclone_url="https://github.com/ncw/rclone/releases/download/${_rclone_version}/${_rclone_zip}"
# Plexdrive
_plexdrive_bin="plexdrive-linux-amd64"
_plexdrive_url="https://github.com/dweidenfeld/plexdrive/releases/download/4.0.0/${_plexdrive_bin}"
###################################
Something is going wrong and I'm not sure what. Have you tried the manual process? However, the only things I see wrong are the rclone mounts. Try to edit the rclone.conf and the folders as the template indicates:
[gd-crypt]
type = crypt
remote = gd:Media
filename_encryption = standard
password =
[local-crypt]
type = crypt
remote = /opt/cloud-media-scripts/.cloud-encrypt/Media
filename_encryption = standard
password =
Made the changes to rclone.conf and ran ./mount.remote
Same issue.
Honestly, cant tell you whats going on. Doesn't make sense to me. Maybe @madslundt has an idea because Im out of them.
Yea same here. I've been at it for almost two days now. I don't have a clue as to what preventing it from finding decrypted mountpoint. I'd really like to get this working so I can eliminate my eight hard drives or at least have less hard drives. Plus not having to worry so much about backups.
Try running this and see if it errors? You may need to do a 2nd ssh to test. Will at least test if its a rclone issue,
rclone mount --config /opt/cloud-media-scripts/rclone/rclone.conf --buffer-size 500M --checkers 16 --read-only --allow-non-empty --allow-other --max-read-ahead 30G gd-crypt: /opt/cloud-media-scripts/.cloud-decrypt
This is interesting.
root@hoggle:/# rclone mount --config /opt/cloud-media-server/rclone/rclone.conf --buffer-size 500M --checkers 16 --read-only --allow-non-empty --allow-other --max-read-ahead 30G gd-crypt: /opt/cloud-media-scripts/.cloud-decrypt
2018/02/11 20:24:47 NOTICE: Config file "/opt/cloud-media-server/rclone/rclone.conf" not found - using defaults
2018/02/11 20:24:47 Failed to create file system for "gd-crypt:": didn't find section in config file
Look at my edit, had a typo
Ok so I ran
rclone mount --config /opt/cloud-media-scripts/rclone/rclone.conf --buffer-size 500M --checkers 16 --read-only --allow-non-empty --allow-other --max-read-ahead 30G gd-crypt: /opt/cloud-media-scripts/.cloud-decrypt
Which seem to work. I started an other ssh and ran ./mount.remote same error. :(
That makes no sense..... that's the exact same code it would run based on your config. By the other SSH I was meaning to go to /opt/cloud-media-scripts/rclone/.cloud-decrypt and look around and look if it mounted right and all the data is there
root@hoggle:/opt/cloud-media-scripts/scripts# cd /opt/cloud-media-scripts/.cloud-decrypt
root@hoggle:/opt/cloud-media-scripts/.cloud-decrypt# ls
root@hoggle:/opt/cloud-media-scripts/.cloud-decrypt#
So it didnt mount, so it has to be something wrong with your rclone settings 100% if this was a different ssh session and the mount was still running
Yes, it was a separate ssh session. Question, what should I be seeing in .cloud-decrypt?
Your decrypted media. You have the encrypted data in cloud-encrypt right? So rclone should be taking the data from that and decrypting it top .cloud-decrypt
lol, sorry for laughing but... I haven't uploading any data how would I have any decrypted data? I mean yes I have data on GDrive but not in the Media folder. Are you saying I should see what I have on the root of GDrive?
OK step 1.... upload data encrypted. Thats your issue, it is expecting data so if it sees none it thinks its not mounted. I would run that mount command i mentioned and move a file to /opt/cloud-media-scripts/.cloud-decrypt so it can recognize its mounted. And no its only going to show thats in /Media
O man I don't see how anyone uses rclone. I am now getting the following:
root@hoggle:/# rclone mount --config /opt/cloud-media-scripts/rclone/rclone.conf --buffer-size 500M --checkers 16 --read-only --allow-non-empty --allow-other --max-read-ahead 30G gd-crypt: /opt/cloud-media-scripts/.cloud-decrypt
2018/02/11 21:23:01 mount helper error: fusermount: failed to access mountpoint /opt/cloud-media-scripts/.cloud-decrypt: Transport endpoint is not connected
2018/02/11 21:23:01 Fatal error: failed to mount FUSE fs: fusermount: exit status 1
That's an easy fix and is not a rclone issue, its just a fuse mount not being unmounted.
fusermount -uz /opt/cloud-media-scripts/.cloud-decrypt
I figured that out by running the ./umount.remote
I am not able to copy anything into /opt/cloud-media-scripts/.cloud-decrypt/ But from my understanding if I place a file/folder in the local_media_dir="/mnt/storage/cloud/media" it should appear in /opt/cloud-media-scripts/.cloud-decrypt/ & /mnt/storage/cloud/media So I place a folder there. In theory it should upload it to my GDrive under Media correct?
Easy way....
rclone copy --config /opt/cloud-media-scripts/rclone/rclone.conf FILE LOCATION HERE gd-crypt:
You can also mkdir etc.... like rclone mkdir --config /opt/cloud-media-scripts/rclone/rclone.conf gd-crypt:DIRNAMEHERE
Ha! rclone copy worked. Now how do I get everything working?
Try mount.remote again
:( Nope same bull.
root@hoggle:/opt/cloud-media-scripts/scripts# ./mount.remote
[ 2018-02-11@21:47:10 ] ###### Start Mount ######
[ 2018-02-11@21:47:15 ] Mounting Google Drive with Plexdrive in mountpoint: /opt/cloud-media-scripts/.cloud-encrypt
[ 2018-02-11@21:47:15 ] Mounted successfully with Plexdrive
[ 2018-02-11@21:47:16 ] Decrypted Google Drive mountpoint: /opt/cloud-media-scripts/.cloud-decrypt already mounted.
[ 2018-02-11@21:47:21 ] Could not find decrypted mountpoint: /opt/cloud-media-scripts/.cloud-decrypt. Retrying in 10 seconds.
[ 2018-02-11@21:47:31 ] Could not find decrypted mountpoint: /opt/cloud-media-scripts/.cloud-decrypt. Retrying in 10 seconds.
[ 2018-02-11@21:47:41 ] Could not find decrypted mountpoint: /opt/cloud-media-scripts/.cloud-decrypt. Retrying in 10 seconds.
[ 2018-02-11@21:47:51 ] Could not find decrypted mountpoint: /opt/cloud-media-scripts/.cloud-decrypt. Retrying in 10 seconds.
[ 2018-02-11@21:48:01 ] Could not find decrypted mountpoint: /opt/cloud-media-scripts/.cloud-decrypt. Retrying in 10 seconds.
[ 2018-02-11@21:48:11 ] Could not read mountpoint: /opt/cloud-media-scripts/.cloud-decrypt
[ 2018-02-11@21:48:11 ] Mount failed
Try unmount first, mount again
That's what I did when I made the previous post.
I'm sure this may be an easy fix. Also their may be a possiblity I did something wrong. However I've spent an entire day attempting to figure out the issue.
[ 2018-02-10@11:15:21 ] ###### Start Mount ###### [ 2018-02-10@11:15:26 ] Mounting Google Drive with Plexdrive in mountpoint: /opt/cloud-media-scripts/.cloud-encrypt [ 2018-02-10@11:15:26 ] Mounted successfully with Plexdrive [ 2018-02-10@11:15:31 ] Mounting decrypted Google Drive with Rclone in mountpoint: /opt/cloud-media-scripts/.cloud-decrypt [ 2018-02-10@11:15:31 ] Mounted successfully with Rclone [ 2018-02-10@11:15:36 ] Could not find decrypted mountpoint: /opt/cloud-media-scripts/.cloud-decrypt. Retrying in 10 seconds. [ 2018-02-10@11:15:46 ] Could not find decrypted mountpoint: /opt/cloud-media-scripts/.cloud-decrypt. Retrying in 10 seconds. [ 2018-02-10@11:15:56 ] Could not find decrypted mountpoint: /opt/cloud-media-scripts/.cloud-decrypt. Retrying in 10 seconds. [ 2018-02-10@11:16:06 ] Could not find decrypted mountpoint: /opt/cloud-media-scripts/.cloud-decrypt. Retrying in 10 seconds. [ 2018-02-10@11:16:16 ] Could not find decrypted mountpoint: /opt/cloud-media-scripts/.cloud-decrypt. Retrying in 10 seconds. [ 2018-02-10@11:16:26 ] Could not read mountpoint: /opt/cloud-media-scripts/.cloud-decrypt [ 2018-02-10@11:16:26 ] Mount failed
What else can I provide to get this up and running?