search

Duke-GCB / DukeDSClient

Command line program to allow uploading, downloading, and managing projects in the duke-data-service.
MIT License
5 stars 6 forks source link

Connection reset by peer error #330

Open bethrusnak opened 3 years ago

bethrusnak commented 3 years ago

One of my users is getting the following error (don't know if others are or not as not that many use the service). It started recently, perhaps after Linux patches. Running on python 3.8 and on 3.9

ValueError: Error downloading Sammons_7042/210606_A00201R_0418_AHFFHTDRXY/Data/Intensities/BaseCalls/L001/C2.1/L001_2.cbcl ('Connection aborted.', ConnectionResetError(104, 'Connection reset by peer'))

johnbradley commented 3 years ago

@bethrusnak I think this error is due to a networking problem connecting to the backing DHTS S3 data store. There is a service now ticket looking into fixing this networking problem. Once the networking problem is fixed your users should be able to download again.

bethrusnak commented 3 years ago

Thanks so much John! Will you let me know when it is fixed?

From: John Bradley @.> Sent: Monday, June 21, 2021 12:48 PM To: Duke-GCB/DukeDSClient @.> Cc: Beth Rusnak @.>; Mention @.> Subject: Re: [Duke-GCB/DukeDSClient] Connection reset by peer error (#330)

@bethrusnakhttps://urldefense.com/v3/__https:/github.com/bethrusnak__;!!OToaGQ!8OlE0SqWZ_N28dnYb_dtgbN1HceCF_ANwWtFuoc3sLdYLLsmltG3qUukdkItGex73c8$ I think this error is due to a networking problem connecting to the backing DHTS S3 data store. There is a service now ticket looking into fixing this networking problem. Once the networking problem is fixed your users should be able to download again.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHubhttps://urldefense.com/v3/__https:/github.com/Duke-GCB/DukeDSClient/issues/330*issuecomment-865188381__;Iw!!OToaGQ!8OlE0SqWZ_N28dnYb_dtgbN1HceCF_ANwWtFuoc3sLdYLLsmltG3qUukdkItb91oZHE$, or unsubscribehttps://urldefense.com/v3/__https:/github.com/notifications/unsubscribe-auth/ADVDM32RAIBCMQJLIMAVPP3TT5ULVANCNFSM47B5CNZQ__;!!OToaGQ!8OlE0SqWZ_N28dnYb_dtgbN1HceCF_ANwWtFuoc3sLdYLLsmltG3qUukdkItEgVhGLg$.

johnbradley commented 3 years ago

Thanks so much John! Will you let me know when it is fixed?

Will do @bethrusnak

johnbradley commented 3 years ago

@bethrusnak I just received word that the networking problem has been fixed and DDS should be working fine again. Please let me know if your users are still experiencing this issue. Thanks.

bethrusnak commented 3 years ago

Thanks John. My user had success downloading yesterday, although he said it was slow.

From: John Bradley @.> Sent: Wednesday, June 23, 2021 12:06 PM To: Duke-GCB/DukeDSClient @.> Cc: Beth Rusnak @.>; Mention @.> Subject: Re: [Duke-GCB/DukeDSClient] Connection reset by peer error (#330)

@bethrusnakhttps://urldefense.com/v3/__https:/github.com/bethrusnak__;!!OToaGQ!8qR4QuXhO4hjuIJCm2eIM67KpDj7jClWcs1MdPIHb8KDPEeM3d2BlUYQjOGJW4KF8Ro$ I just received word that the networking problem has been fixed and DDS should be working fine again. Please let me know if your users are still experiencing this issue. Thanks.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHubhttps://urldefense.com/v3/__https:/github.com/Duke-GCB/DukeDSClient/issues/330*issuecomment-866970184__;Iw!!OToaGQ!8qR4QuXhO4hjuIJCm2eIM67KpDj7jClWcs1MdPIHb8KDPEeM3d2BlUYQjOGJs_1_4a4$, or unsubscribehttps://urldefense.com/v3/__https:/github.com/notifications/unsubscribe-auth/ADVDM36P4ORXKLAJKDNCSPTTUIBAJANCNFSM47B5CNZQ__;!!OToaGQ!8qR4QuXhO4hjuIJCm2eIM67KpDj7jClWcs1MdPIHb8KDPEeM3d2BlUYQjOGJtB5fDc8$.

johnbradley commented 3 years ago

@bethrusnak The problem was an overloaded intermediate server and DHTS has been working on getting the load down. It should be faster now. I was seeing 70 MB/s downloading on HARDAC and 40 MB/s downloading on DCC earlier today.

corinnestrawser commented 2 years ago

I've been having this issue as well. Is there a work-around? Has anyone else been struggling with this again?

johnbradley commented 2 years ago

@cnhaines01 Are you consistently able to reproduce this problem or is it sporadic? Are you using a wired network connection? We have been seeing many intermittent problems lately with the DDS API servers. The DDS API servers have been scaled back. So setting the number of workers to use when uploading or downloading to say 4 or 2 may help. To do so update the upload or download workers in your .ddsclient config file. Please see the documentation for the upload_workers and download_workers settings.

corinnestrawser commented 2 years ago

It's been consistent. I was not using a wired network connection. I will try your suggestion- thank you!