db48x
commented
7 years ago No, that's unusual. I can see your registrations on the server, but your public key isn't actually in place to allow you to authenticate.
Open yofreke opened 7 years ago
db48x
commented
7 years ago No, that's unusual. I can see your registrations on the server, but your public key isn't actually in place to allow you to authenticate.
joeyh
commented
7 years ago Seems like an issue with pushing registrations to the gitlab repo.. After looking at the gitlab config, it started working. So, probably an interrmittent breakage in gitlab.
db48x
commented
7 years ago We've also tweaked the process to be a bit more robust to failures of this type. I just double-checked and I can see that your registration is now in place. Thanks for the bug report, and my apologies for making you wait half a day!
yofreke
commented
7 years ago After trying with same id_rsa:
Brown@jBrown-desktop:/Volumes/ia.bak/IA.BAK (master)$ ./checkoutshard shard18
Initialized empty Git repository in /Volumes/ia.bak/IA.BAK/shard18/.git/
init ok
(recording state in git...)
Checking ssh to server at SHARD18@iabak.archiveteam.org:shard18...
annex.uuid=d5e8a798-e7e5-472b-b931-800406c77ae4
core.gcrypt-id=
Warning: Identity file -i not accessible: No such file or directory.
Permission denied (publickey).
Permission denied (publickey).
fatal: Could not read from remote repository.
Please make sure you have the correct access rights
and the repository exists.
commit
On branch master
Initial commit
nothing to commit
ok
pull origin
Warning: Identity file SHARD18@iabak.archiveteam.org not accessible: No such file or directory.
Pseudo-terminal will not be allocated because stdin is not a terminal.
ssh: Could not resolve hostname git-upload-pack 'shard18': nodename nor servname provided, or not known
fatal: Could not read from remote repository.
Please make sure you have the correct access rights
and the repository exists.
failed
git-annex: sync: 1 failed
Checked out shard18 for shard18 (from SHARD18@iabak.archiveteam.org:shard18). Current status: activeTried removing id_rsa:
Brown@jBrown-desktop:/Volumes/ia.bak/IA.BAK (master)$ rm id_rsa id_rsa.pub
Brown@jBrown-desktop:/Volumes/ia.bak/IA.BAK (master)$ rm -rf shard18/
Brown@jBrown-desktop:/Volumes/ia.bak/IA.BAK (master)$ ./iabak
From https://github.com/ArchiveTeam/IA.BAK
* branch master -> FETCH_HEAD
Already up-to-date.
Welcome to iabak version 0.1
ALPHA TEST, use with caution
remote: Counting objects: 11, done.
remote: Compressing objects: 100% (7/7), done.
remote: Total 11 (delta 5), reused 10 (delta 4), pack-reused 0
Unpacking objects: 100% (11/11), done.
From https://github.com/ArchiveTeam/IA.BAK
b38fa04..81e8d16 propellor -> origin/propellor
8b4c902..0b273f2 server -> origin/server
Already up-to-date.
Looks like this is a new IA backup. I'm going to put it in
/Volumes/ia.bak/IA.BAK/shard18
This will use some disk space. :)
Press Enter to confirm, or ctrl-C to cancel.
git-annex version: 6.20161211-gf58b134
build flags: Assistant Webapp Pairing Testsuite S3(multipartupload)(storageclasses) WebDAV FsEvents XMPP ConcurrentOutput TorrentParser MagicMime Feeds Quvi
key/value backends: SHA256E SHA256 SHA512E SHA512 SHA224E SHA224 SHA384E SHA384 SHA3_256E SHA3_256 SHA3_512E SHA3_512 SHA3_224E SHA3_224 SHA3_384E SHA3_384 SKEIN256E SKEIN256 SKEIN512E SKEIN512 SHA1E SHA1 MD5E MD5 WORM URL
remote types: git gcrypt p2p S3 bup directory rsync web bittorrent webdav tahoe glacier ddar hook external
local repository version: unknown
supported repository versions: 3 5 6
upgrade supported from repository versions: 0 1 2 3 4 5
operating system: darwin x86_64
Now we need to set up a service to regularly double-check the content of
your backup. This protects the backup against bit-rot.
Your system doesn't use systemd; falling back to an old-school cron job.
You've already got the cron job installed; I didn't need to do anything. Thanks!
Initialized empty Git repository in /Volumes/ia.bak/IA.BAK/shard18/.git/
init ok
(recording state in git...)
Checking ssh to server at SHARD18@iabak.archiveteam.org:shard18...
Permission denied (publickey).
Seem you're not set up yet for access to SHARD18@iabak.archiveteam.org:shard18 yet. Let's fix that..
--2016-12-21 15:14:33-- http://iabak.archiveteam.org/cgi-bin/register.cgi?shard=SHARD18;uuid=3e5b6458-78e1-4adb-bffb-917b6a9243cc;email=sparkyjoe94%40aim.com;pubkey=ssh-rsa%20AAAAB3NzaC1yc2EAAAADAQABAAABAQCapz9JRgMtumqpg2L6%2F7j8XHqTDJH2aYfePRUZIh9r_FD_Rz23Jz4tS9Kn_oO%2FjmsCb0RKanG%2F%2FtJcJ7M9sZWEvdLOwffr%2Fw5DO6UWDJTQiNH%2FnDGggmZp7VvXSELvzZN0A4ouYeIXSG3XPdoajTRSn0yKJNQYpS%2FaWCQWAe9Xfnh5uc9UwdmdSVkGowEqBjp7PRJeFrylrRaZAnhOttsDSFawYNNOS9qRtJV05PsONJiGHIP4Fv_BY%2F8q6c_SxDB9qDxz5vi81nA_X7ltxIks7AN4sAuqItSZ92jih9KO%2FqHWfLjAgXp075o9oZBtysgdWlO13ZfVPr52TyiLLA5l%20Brown%40jBrown-desktop
Resolving iabak.archiveteam.org... 124.6.40.235
Connecting to iabak.archiveteam.org|124.6.40.235|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/plain]
Saving to: 'STDOUT'
- [<=> ] 0 --.-KB/s Already up-to-date.
[master 968f0e3] registration of sparkyjoe94 on SHARD18
1 file changed, 1 insertion(+)
- [ <=> ] 136 28.8 B/s in 4.7s
2016-12-21 15:14:40 (28.8 B/s) - written to stdout [136]
Checking ssh to server at SHARD18@iabak.archiveteam.org:shard18...
annex.uuid=d5e8a798-e7e5-472b-b931-800406c77ae4
core.gcrypt-id=
Warning: Identity file -i not accessible: No such file or directory.
Permission denied (publickey).
Permission denied (publickey).
fatal: Could not read from remote repository.
Please make sure you have the correct access rights
and the repository exists.
commit
On branch master
Initial commit
nothing to commit
ok
pull origin
Warning: Identity file SHARD18@iabak.archiveteam.org not accessible: No such file or directory.
Pseudo-terminal will not be allocated because stdin is not a terminal.
ssh: Could not resolve hostname git-upload-pack 'shard18': nodename nor servname provided, or not known
fatal: Could not read from remote repository.
Please make sure you have the correct access rights
and the repository exists.
failed
git-annex: sync: 1 failed
Checked out shard18 for shard18 (from SHARD18@iabak.archiveteam.org:shard18). Current status: active
Filesystem Size Used Avail Capacity iused ifree %iused Mounted on
192.168.1.6:/volume1/ia.bak 14Ti 638Gi 13Ti 5% 0 0 100% /Volumes/ia.bak
How much of this disk space do you want to keep free, and not use for IA backup?
(You can free up space at any time by simply deleting files from the archives.)
To use entire disk, just hit Enter, or type in something like 100M, 200G, or 1T.
You must input a value of at least 100 megabytes.
./iabak-helper: line 289: read: -i: invalid option
read: usage: read [-ers] [-u fd] [-t timeout] [-p prompt] [-a array] [-n nchars] [-d delim] [name ...]
Cleaning up...Brown@jBrown-desktop:/Volumes/ia.bak/IA.BAK (master)$ bash --version
GNU bash, version 3.2.57(1)-release (x86_64-apple-darwin16)From here:
brew update && brew install bashsudo bash -c 'echo /usr/local/bin/bash >> /etc/shells'chsh -s /usr/local/bin/bashGoing to try the reboot and see if that fixes things, but it looks like there are still access problems?
db48x
commented
7 years ago Warning: Identity file -i not accessible: No such file or directory.That seems to be the main problem at present, although installing bash is indeed necessary. Can you take a look at the id_rsa file and see why it might not be readable?
yofreke
commented
7 years ago There is no reason that should be failing that I can tell. What specifically is causing that error? Worth noting that I am running this on an NFS mount.
My new best theory is that there is something broken with the NFS mount, because my shell will frequently stop responding as well (just noticed this today), and I have to: cd /Volumes && chown -R Brown ia.bak before I can start doing anything again. Seems like this might also be effecting the script, since a new bash shell almost always causes issues.
Going to investigate the NFS stuff on my side some more.
db48x
commented
7 years ago Yes, NFS is very problematic; I doubt we've even seen all the problems it can cause.
This just loops forever:
On OSX 10.12.2
Is that normal?