sberl / supersid

Cross-platform Sudden Ionospheric Disturbances (SID) monitor
MIT License
9 stars 9 forks source link

ftp_to_stanford not working #60

Closed kunkleb closed 2 years ago

kunkleb commented 2 years ago

ftp_to_stanford creates the files in the outgoing directory but I get the following error: Sending /home/pi/supersid/outgoing//GHM_2_NAA_2022-01-17.csv Error sending GHM_2_NAA_2022-01-17.csv : 553 Could not create file. FTP session closed.

The original ftp_to_Standford.py will send the files.

kunkleb commented 2 years ago

Does the new ftp_to_stanford limit you to only sending the ftp once?
I was running a test and tried to ftp again.

sberl commented 2 years ago

FTP error 553 is related to permissions on the server. On the stanford.edu server you only have permission to write a new file, but you don't have permissions to overwrite or modify a file that is already there. So the 2nd time you try to send it you get this error. About once per hour, about 40 minutes after the hour, the scripts on the server side run and move all the files from the incoming directory and you can send it again.

From the logs I can see that your file was processed twice. Once in the run at Mon Jan 17 16:43:10 PST 2022 and again at Mon Jan 17 17:43:03 PST 2022.

Steve

On Mon, Jan 17, 2022 at 4:59 PM kunkleb @.***> wrote:

Does the new ftp_to_stanford limit you to only sending the ftp once? I was running a test and tried to ftp again.

— Reply to this email directly, view it on GitHub https://github.com/sberl/supersid/issues/60#issuecomment-1014982467, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAHXLEOB7USX5KA2OJST5OTUWS3QTANCNFSM5MF4GP4A . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.

You are receiving this because you are subscribed to this thread.Message ID: @.***>

-- -steve

kunkleb commented 2 years ago

Yes, I did try to send after my script attempted to do it yesterday. My script runs at 10 minutes after midnight UTC and looking at the log just now, I see this: Warning: read SuperSid non extended file and generate time stamps. Error sending GHM_2_NML_2022-01-18.csv : 553 Could not create file. Error sending GHM_2_NAA_2022-01-18.csv : 553 Could not create file.

On Tue, Jan 18, 2022 at 5:25 PM Steve Berl @.***> wrote:

FTP error 553 is related to permissions on the server. On the stanford.edu server you only have permission to write a new file, but you don't have permissions to overwrite or modify a file that is already there. So the 2nd time you try to send it you get this error. About once per hour, about 40 minutes after the hour, the scripts on the server side run and move all the files from the incoming directory and you can send it again.

From the logs I can see that your file was processed twice. Once in the run at Mon Jan 17 16:43:10 PST 2022 and again at Mon Jan 17 17:43:03 PST 2022.

Steve

On Mon, Jan 17, 2022 at 4:59 PM kunkleb @.***> wrote:

Does the new ftp_to_stanford limit you to only sending the ftp once? I was running a test and tried to ftp again.

— Reply to this email directly, view it on GitHub https://github.com/sberl/supersid/issues/60#issuecomment-1014982467, or unsubscribe < https://github.com/notifications/unsubscribe-auth/AAHXLEOB7USX5KA2OJST5OTUWS3QTANCNFSM5MF4GP4A

. Triage notifications on the go with GitHub Mobile for iOS < https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675

or Android < https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub .

You are receiving this because you are subscribed to this thread.Message ID: @.***>

-- -steve

— Reply to this email directly, view it on GitHub https://github.com/sberl/supersid/issues/60#issuecomment-1015956677, or unsubscribe https://github.com/notifications/unsubscribe-auth/AVOU2IBHXGUJARJADQCZTN3UWYAJHANCNFSM5MF4GP4A . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.

You are receiving this because you authored the thread.Message ID: @.***>

kunkleb commented 2 years ago

The data is on the Stanford site - 9435 GHM_2

On Tue, Jan 18, 2022 at 5:42 PM Bill Kunkle @.***> wrote:

Yes, I did try to send after my script attempted to do it yesterday. My script runs at 10 minutes after midnight UTC and looking at the log just now, I see this: Warning: read SuperSid non extended file and generate time stamps. Error sending GHM_2_NML_2022-01-18.csv : 553 Could not create file. Error sending GHM_2_NAA_2022-01-18.csv : 553 Could not create file.

On Tue, Jan 18, 2022 at 5:25 PM Steve Berl @.***> wrote:

FTP error 553 is related to permissions on the server. On the stanford.edu server you only have permission to write a new file, but you don't have permissions to overwrite or modify a file that is already there. So the 2nd time you try to send it you get this error. About once per hour, about 40 minutes after the hour, the scripts on the server side run and move all the files from the incoming directory and you can send it again.

From the logs I can see that your file was processed twice. Once in the run at Mon Jan 17 16:43:10 PST 2022 and again at Mon Jan 17 17:43:03 PST 2022.

Steve

On Mon, Jan 17, 2022 at 4:59 PM kunkleb @.***> wrote:

Does the new ftp_to_stanford limit you to only sending the ftp once? I was running a test and tried to ftp again.

— Reply to this email directly, view it on GitHub https://github.com/sberl/supersid/issues/60#issuecomment-1014982467, or unsubscribe < https://github.com/notifications/unsubscribe-auth/AAHXLEOB7USX5KA2OJST5OTUWS3QTANCNFSM5MF4GP4A

. Triage notifications on the go with GitHub Mobile for iOS < https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675

or Android < https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub .

You are receiving this because you are subscribed to this thread.Message ID: @.***>

-- -steve

— Reply to this email directly, view it on GitHub https://github.com/sberl/supersid/issues/60#issuecomment-1015956677, or unsubscribe https://github.com/notifications/unsubscribe-auth/AVOU2IBHXGUJARJADQCZTN3UWYAJHANCNFSM5MF4GP4A . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.

You are receiving this because you authored the thread.Message ID: @.***>