anyproto / any-sync-dockercompose

docker-compose for testing any-sync
MIT License
396 stars 56 forks source link

can't generate an invite link & sync images #98

Closed tubleronchik closed 1 month ago

tubleronchik commented 1 month ago

Have you read a contributing guide?

Current Behavior

Hi there. I try to run a self hosted Anytype and while it works fine for with type content (it synchronizes properly). But I'm encountering an issue when trying to create a shared space and generate an invitation link. The following error appears (I removed ids):

store invite in ipfs: add file to sync queue: walk file blocks: process batch: select blocks to upload: add to file: SignatureDoesNotMatch: The request signature we calculated does not match the signature you provided. Check your key and signing method. status code: 403, request id: <>, host id: <>,
generate invite

I checked logs from the container and can see the same error there:

docker logs any-sync-dockercompose-any-sync-filenode-1
{"totalDur": 0.010399035, "spaceId": "", "size": 319, "cid": "", "fileId": "", "error": "SignatureDoesNotMatch: The request signature we calculated does not match the signature you provided. Check your key and signing method.\n\tstatus code: 403, request id: , host id: ", "app": "v0.6.7", "peerId": "", "identity": "", "rpc": "file.blockPush", "peerVersion": "Linux:0.42.8/middle:v0.35.7/any-sync:"}

I'm seeing this issue across multiple clients: Ubuntu (v0.42.8), macOS (v0.42.8), and iOS (iPhone, v0.32.3). Additionally, it seems that any content type other than text cannot be synchronized — I receive the same error when attempting to add an image.

Please let me know if you need any additional logs or information.

Expected Behavior

Generate invite link. Correctly synchronize all types of files.

Steps To Reproduce

I followed the procedure as mentioned in the wiki, then created a new space, made it shared and tried to generate an invitation link.

Environment

- OS:Ubuntu
- Version: 24.04 LTS 

grep 'ANY_SYNC_.*_VERSION=' .env.default
ANY_SYNC_NODE_VERSION=prod
ANY_SYNC_FILENODE_VERSION=prod
ANY_SYNC_COORDINATOR_VERSION=v0.3.26
ANY_SYNC_CONSENSUSNODE_VERSION=prod
ANY_SYNC_TOOLS_VERSION=latest

Anything else?

No response

fb929 commented 1 month ago

Please show your version of the self-hosted repository: git rev-parse HEAD

tubleronchik commented 1 month ago

Please show your version of the self-hosted repository: git rev-parse HEAD

The git rev-parse HEAD output is 41d0cacd808a13155735f2ee0e47c187baf9b66f

fb929 commented 1 month ago

and can you show me the synchronization status on the client, please? It should look something like this:

Screenshot 2024-10-09 at 14 23 08
tubleronchik commented 1 month ago

Sure. This is an empty space containing only text objects, as far as I understand, and these are being synchronized. image This is the default space. However, every time another type of content is created here (I’m not sure why since I don't create it), that content is not being synchronized. image

fb929 commented 1 month ago

can you show me the client, filenode, and coordinator logs, please? client logs: you need to run client from console, logs will be on stdout

ANYTYPE_LOG_LEVEL="*=DEBUG" ANYPROF=:6060 ANY_SYNC_NETWORK=<path/to/client.yml> /Applications/Anytype.app/Contents/MacOS/Anytype

filenode and coordinator:

docker-compose logs any-sync-filenode
docker-compose logs any-sync-coordinator
tubleronchik commented 1 month ago

client logs (Ubuntu client v.0.42.8) (I removed part of ids)::

{"level":"ERROR","ts":"2024-10-10T21:17:52.571+0200","logger":"filesync","msg":"retry uploading file error","fileId":"bafybeidqjngtnh22b43hkud7be2gt74dp7sq5nwx2av7h5tunq5uybugaa","error":"walk file blocks: walk DAG: process batch: select blocks to upload: add to file: SignatureDoesNotMatch: The request signature we calculated does not match the signature you provided. Check your key and signing method.\n\tstatus code: 403, request id: 17FD2D82DB340645, host id: dd9025<>; SignatureDoesNotMatch: The request signature we calculated does not match the signature you provided. Check your key and signing method.\n\tstatus code: 403, request id: 17FD2D82DDCBA3B4, host id: dd9025<>; SignatureDoesNotMatch: The request signature we calculated does not match the signature you provided. Check your key and signing method.\n\tstatus code: 403, request id: 17FD2D82E0608890, host id: dd9025b<>; SignatureDoesNotMatch: The request signature we calculated does not match the signature you provided. Check your key and signing method.\n\tstatus code: 403, request id: 17FD2D82E2ABD3BA, host id: dd9025<>; SignatureDoesNotMatch: The request signature we calculated does not match the signature you provided. Check your key and signing method.\n\tstatus code: 403, request id: 17FD2D82E4D6B8EE, host id: dd9025<>; SignatureDoesNotMatch: The request signature we calculated does not match the signature you provided. Check your key and signing method.\n\tstatus code: 403, request id: 17FD2D82E6FB0175, host id: dd9025<>; SignatureDoesNotMatch: The request signature we calculated does not match the signature you provided. Check your key and signing method.\n\tstatus code: 403, request id: 17FD2D82EFE73DBF, host id: dd9025<>; SignatureDoesNotMatch: The request signature we calculated does not match the signature you provided. Check your key and signing method.\n\tstatus code: 403, request id: 17FD2D82F27D4315, host id: dd9025<>; SignatureDoesNotMatch: The request signature we calculated does not match the signature you provided. Check your key and signing method.\n\tstatus code: 403, request id: 17FD2D82F4C4C7A4, host id: dd9025<>; SignatureDoesNotMatch: The request signature we calculated does not match the signature you provided. Check your key and signing method.\n\tstatus code: 403, request id: 17FD2D82F714EDD2, host id: dd9025<>","objectId":"bafyreig54hu7kenm6z7ltaluvuoc3qnfn2xlrlcdr33s2dkchj552kovdu"}

Additionally, I've the following error: {"level":"ERROR","ts":"2024-10-10T21:13:43.165+0200","logger":"any-pp.drpcclient","msg":"no payment processing peers configured"}


filenode logs (I removed part of ids):

INFO    rpcLog          {"totalDur": 0.007423745, "spaceId": "bafyrei<>", "size": 106, "cid": "bafybeibrkttiv<>", "fileId": "bafybeidqjngtnh<>", "error": "SignatureDoesNotMatch: The request signature we calculated does not match the signature you provided. Check your key and signing method.\n\tstatus code: 403, request id: 17FD2D82F4C4C7A4, host id: dd9025<>", "app": "v0.6.7", "peerId": "12D3KooWSBaNU<>", "identity": "A7rJAgW8dc9<>", "rpc": "file.blockPush", "peerVersion": "Linux:0.42.8/middle:v0.35.7/any-sync:v0.4.30"}

coordinator logs: I'm not sure which logs from the coordinator I should provide so here is some errors or warnings which I can see

WARN    common.net.connutil     can't set write deadline        {"remoteAddr": "172.18.0.11:54364"}
any-sync-coordinator-1  | 2024-10-10T19:24:46.151Z      INFO    common.net.peer serve connection error  {"error": "manager closed: EOF", "errorVerbose": "manager closed: EOF\n\tstorj.io/drpc/drpcmanager.(*Manager).manageReader:234"}
taoyuan commented 1 month ago

I have the same issue

TaoRone commented 1 month ago

I had a similar problem after I redeployed today Through my testing, I found that if I upload an image through the PC side (windows11), for example an 800kb photo, it can be uploaded successfully over the network, and then through a non-LAN Android device (latest version client side: 0.32.41) can successfully sync the photo and display it (occasionally need to exit the app and re-enter to display it) But on the other hand, if I upload a photo on my Android phone, the green dot in the upper left corner of the Android phone prompts that it has been synced, but the synchronization on the PC side is always in progress (near photos, text is not affected) Tomorrow, I will try to sync with another win PC and an IOS device. If there are any new findings, I will continue to post them. Hope to provide you with a reference.

fb929 commented 1 month ago

@tubleronchik These lines are not enough, I need the full log.
The log is safe to share, as it doesn't contain keys, only IDs. However, if you'd like, you can obfuscate the IDs by replacing them with any "stream editor", like sed.

Alternatively, you can send the logs to me on Telegram, nickname @fb_929

tubleronchik commented 1 month ago

These lines are not enough, I need the full log.

hi again, sorry for misunderstanding. Here is my logs, but they are brief because I only ran Anytype for a short time. Let me know if you need additional logs

coordinator.log filenode.log ubuntu_client.log

fb929 commented 1 month ago

It looks like the bucket wasn't created in MinIO; we had an issue with this in one of the recent versions. Check the service logs:

docker-compose logs create-bucket

To fix this, perform the update:

git checkout v5.0.4 && make restart
tubleronchik commented 1 month ago

here is my bucket logs before update:

bucket.log

After update the logs remained the same and the images still couldn't be synchronized. I also tried to clean everything (using make clean & make cleanEtcStorage) and then run again make start. Here is the bucket after it:

bucket_new.log

Even though that (as far as I understand) the bucket was created, I still can't generate an invitation link and the images are still not being synchronized

tubleronchik commented 1 month ago

I found the problem. I changed AWS_SECRET_ACCESS_KEY (adding a new one to .env.override). After I've changed it to default value all works fine

Thanks for your assistance!