FTP Issue

[spacemanbobby]

So I have put the tags into the scripts to upload the files with that has been mentioned... Image-resize.jpg, startrails, keograms and the daily mp4 all get uploaded to the website.... but it is as if it only puts them in the base directory that I set the FTP account to log into.

lets say... Allsky@website.com logs into ftp.website.com On my site I set this account to access public_html\allsky\ I have the other folders under allsky.... images, keograms, startrails, videos.... all lower caps and they are 755 under the allsky folder. When the scripts fire off they all just put them in the base allsky folder even though I have them as \allsky\ for images, \allsky\videos\ for videos... etc...

I have tried all sorts of combo's on the paths but it always just gets put into the base allsky directory that the ftp account points to for signing into a certain directory. I even tried setting the ftp account to sign into \public_html\ and then let the upload scripts try to get to allsky, but it just dumped it in public_html.

Any ideas. At this point I am going into ftp from my computer and moving the files to the respective folders.

I even bought a second respberry pi board and installed the OS and the Allsky software onto it. Same results once I get it to upload to the ftp account.

[thomasjacquin]

I believe this is an issue with some web hosts. However you can fix the issue by adding a mv command to the lftp command.

lftp "$PROTOCOL"://"$USER":"$PASSWORD"@"$HOST":"$IMGDIR" "set net:max-retries 1; set net:timeout 20; put $FILENAME-resize.$EXTENSION; mv $FILENAME-resize.$EXTENSION allsky/$FILENAME-resize.$EXTENSION; bye"

This will move the uploaded image to the allsky directory

You will have to update the lftp command in a few scripts in order to get it to work for startrails, keograms and timelapse as well.

[gremlinforce007]

Thanks Thomas this was super helpful :)

[spacemanbobby]

Thanks for the additional information, the images resize are now loading in the images folder... Just got to see if the other stuff starts working tonight and tomorrow morning when it finishes.

On Thu, Apr 11, 2019 at 10:11 AM Thomas Jacquin notifications@github.com wrote:

I believe this is an issue with some web hosts. However you can fix the issue by adding a mv command to the lftp command.

lftp "$PROTOCOL"://"$USER":"$PASSWORD"@"$HOST":"$IMGDIR" "set net:max-retries 1; set net:timeout 20; put $FILENAME-resize.$EXTENSION; mv $FILENAME-resize.$EXTENSION allsky/$FILENAME-resize.$EXTENSION; bye"

This will move the uploaded image to the allsky directory

You will have to update the lftp command in a few scripts in order to get it to work for startrails, keograms and timelapse as well.

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/thomasjacquin/allsky/issues/74#issuecomment-482205482, or mute the thread https://github.com/notifications/unsubscribe-auth/ArTEuk76ejndtru-J7AnOAG1KGpFcWcUks5vf2zagaJpZM4cn7mC .

[gremlinforce007]

@spacemanbobby can you please post the script edits you've done for timelapses, keograms and startrails please ?

[thomasjacquin]

These should work but I haven't tested them. Let me know if they don't and I'll update them.

SaveImageDay.sh and saveImageNight.sh: lftp "$PROTOCOL"://"$USER":"$PASSWORD"@"$HOST":"$IMGDIR" -e "set net:max-retries 1; set net:timeout 20; put $FILENAME-resize.$EXTENSION; mv $FILENAME-resize.$EXTENSION; $IMGDIR/$FILENAME-resize.$EXTENSION; bye"

Timelapse: lftp "$PROTOCOL"://"$USER":"$PASSWORD"@"$HOST" -e "set net:max-retries 1; put images/$1/allsky-$1.mp4; mv allsky-$1.mp4 $MP4DIR/allsky-$1.mp4; bye"

Keogram (in endOfNight.sh): lftp "$PROTOCOL"://"$USER":"$PASSWORD"@"$HOST" -e "set net:max-retries 1; put $OUTPUT; mv $OUTPUT $KEOGRAM_DIR/$OUTPUT; bye"

Startrails (in endOfNight.sh): lftp "$PROTOCOL"://"$USER":"$PASSWORD"@"$HOST" -e "set net:max-retries 1; put $OUTPUT; mv $OUTPUT $STARTRAILS_DIR/$OUTPUT; bye"

[gremlinforce007]

Thanks i made an edit i'll let you know tonight :)

[gremlinforce007]

Hi @thomasjacquin

Just tried your post: Still went to root folder:

See code below:

Timelapse: lftp "$PROTOCOL"://"$USER":"$PASSWORD"@"$HOST":"$MP4DIR" -e "set net:max-retries 1; set net:timeout 20; set ftp:ssl-allow no;put images/$1/allsky-$1.mp4; mv allsky-$1.mp4 $allsky/videos/allsky-$1.mp4; bye"

KeoGram: lftp "$PROTOCOL"://"$USER":"$PASSWORD"@"$HOST":"$KEOGRAM_DIR" \ -e "set net:max-retries 1;set net:timeout 20; set ftp:ssl-allow no; put $OUTPUT; mv $OUTPUT $allsky/keogram/$OUTPUT; bye"

StarTrails: lftp "$PROTOCOL"://"$USER":"$PASSWORD"@"$HOST":"$STARTRAILS_DIR" \ -e "set net:max-retries 1; set net:timeout 20; set ftp:ssl-allow no; put $OUTPUT; mv $OUTPUT $allsky/startrails/$OUTPUT; bye"

Question should there be a $ near >> $allsky/startrails/$OUTPUT; ?

[spacemanbobby]

Been busy this weekend... Will update the LFTP scripts with what Thomas said for the startrails, keograms and videos tuesday.. The image-resize.jpg goes into my images folder now.

I had to modify my ftp login script since the ftp account already logged into the base of allsky... just removed allsky from the paths so the mv command would just move it from allsky base to the specified folders.. I'll post that also on tuesday.

On Sat, Apr 13, 2019 at 2:19 PM gremlinforce007 notifications@github.com wrote:

@spacemanbobby https://github.com/spacemanbobby can you please post the script edits you've done for timelapses, keograms and startrails please ?

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/thomasjacquin/allsky/issues/74#issuecomment-482889209, or mute the thread https://github.com/notifications/unsubscribe-auth/ArTEuvT2P-Fv9_yDUvvN0XBABpbqiZB5ks5vgknlgaJpZM4cn7mC .

[thomasjacquin]

@gremlinforce007 Looking at your Cpanel structure, I think you'll need to remove that dollar sign in front of allsky and it should just work.

[gremlinforce007]

So removing the dollar sign worked for timelapse .. not startrails or keogram any ideas ?

KeoGram: lftp "$PROTOCOL"://"$USER":"$PASSWORD"@"$HOST":"$KEOGRAM_DIR" \ -e "set net:max-retries 1;set net:timeout 20; set ftp:ssl-allow no; put $OUTPUT; mv $OUTPUT allsky/keogram/$OUTPUT; bye"

StarTrails: lftp "$PROTOCOL"://"$USER":"$PASSWORD"@"$HOST":"$STARTRAILS_DIR" \ -e "set net:max-retries 1; set net:timeout 20; set ftp:ssl-allow no; put $OUTPUT; mv $OUTPUT allsky/startrails/$OUTPUT; bye"

[thomasjacquin]

Can you take a screenshot of your cpanel with the content of the allsky directory? Also I think the directory is called keograms on my server. If these directories don’t exist, you’ll have to create them.

[gremlinforce007]

Yep added the s to keogram

[thomasjacquin]

If it still doesn't send, you can try calling scripts/endOfNight.sh manually from the terminal and look for errors.

[spacemanbobby]

Ok.. so here is what I have for settings on my scripts and ftp settings... blanked out my site and password.....

resize-image gets uploaded to the images directory now. the mp4 file gets uploaded to the videos folder now. But keograms and startrails still get dumped in the allsky base directory of my ftp site. I have put the error codes from running the endOfNight.sh script at the bottom. See if you can find something I missed.

FTP/SFTP settings

PROTOCOL='ftp' USER='allsky@webpage.com' PASSWORD='***' HOST='ftp.webpage.com' IMGDIR='/images' MP4DIR='/videos' KEOGRAM_DIR='/keograms' STARTRAILS_DIR='/startrails'

Reason I changed paths is that the FTP account I created in CPanel, logs directly into the allsky

saveImageDay.sh

lftp "$PROTOCOL"://"$USER":"$PASSWORD"@"$HOST":"$IMGDIR" -e "set net:max-retries 1; set net:timeout 20; set ftp:ssl-allow no; put $FILENAME-resize.$EXTENSION; mv $FILENAME-resize.$EXTENSION images/$FILENAME-resize.$EXTENSION; bye"

saveImageNight.sh

lftp "$PROTOCOL"://"$USER":"$PASSWORD"@"$HOST":"$IMGDIR" -e "set net:max-retries 1; set net:timeout 20; set ftp:ssl-allow no; put $FILENAME-resize.$EXTENSION; mv $FILENAME-resize.$EXTENSION images/$FILENAME-resize.$EXTENSION; bye"

timelapse.sh

lftp "$PROTOCOL"://"$USER":"$PASSWORD"@"$HOST":"$MP4DIR" -e "set net:max-retries 1; set ftp:ssl-allow no; put images/$1/allsky-$1.mp4; mv allsky-$1.mp4 $MP4DIR/allsky-$1.mp4; bye"

endOfNight.sh

lftp "$PROTOCOL"://"$USER":"$PASSWORD"@"$HOST":"$KEOGRAM_DIR" -e "set net:max-retries 1; set ftp:ssl-allow no; put $OUTPUT; mv $OUTPUT $KEOGRAM_DIR/$OUTPUT; bye"

lftp "$PROTOCOL"://"$USER":"$PASSWORD"@"$HOST":"$STARTRAILS_DIR" -e "set net:max-retries 1; set ftp:ssl-allow no; put $OUTPUT; mv $OUTPUT $STARTRAILS_DIR/$OUTPUT; bye"

622803 bytes transferred in 1 second (536.7 KiB/s) mv: Access failed: 550 Sorry, but that file doesn't exist (/home/pi/allsky/images/20190416/startrails/startrails-20190416.jpg)

399530 bytes transferred in 1 second (328.1 KiB/s) mv: Access failed: 550 Sorry, but that file doesn't exist (/home/pi/allsky/images/20190416/keogram/keogram-20190416.jpg)

13018800 bytes transferred in 7 seconds (1.82 MiB/s) mv allsky-20190416.mp4=>/videos/allsky-20190416.mp4 [Waiting for response...] rename successful

On Sat, Apr 13, 2019 at 11:40 PM Thomas Jacquin notifications@github.com wrote:

These should work but I haven't tested them. Let me know if they don't and I'll update them.

SaveImageDay.sh and saveImageNight.sh: lftp "$PROTOCOL"://"$USER":"$PASSWORD"@"$HOST":"$IMGDIR" -e "set net:max-retries 1; set net:timeout 20; put $FILENAME-resize.$EXTENSION; mv $FILENAME-resize.$EXTENSION; $IMGDIR/$FILENAME-resize.$EXTENSION; bye"

Timelapse: lftp "$PROTOCOL"://"$USER":"$PASSWORD"@"$HOST" -e "set net:max-retries 1; put images/$1/allsky-$1.mp4; mv allsky-$1.mp4 $MP4DIR/allsky-$1.mp4; bye"

Keogram (in endOfNight.sh): lftp "$PROTOCOL"://"$USER":"$PASSWORD"@"$HOST" -e "set net:max-retries 1; put $OUTPUT; mv $OUTPUT $KEOGRAM_DIR/$OUTPUT; bye"

Startrails (in endOfNight.sh): lftp "$PROTOCOL"://"$USER":"$PASSWORD"@"$HOST" -e "set net:max-retries 1; put $OUTPUT; mv $OUTPUT $STARTRAILS_DIR/$OUTPUT; bye"

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/thomasjacquin/allsky/issues/74#issuecomment-482924355, or mute the thread https://github.com/notifications/unsubscribe-auth/ArTEumwfmAsCvv183Cf6krJc0e-e0Gk9ks5vgs1rgaJpZM4cn7mC .

[thomasjacquin]

Ah yes, I see, it's because $OUTPUT evaluates to home/pi/allsky/images/20190416/keogram/keogram-20190416.jpg instead of keogram-20190416.jpg instead of keogram-20190416.jpg.

Adding a variable like this should work I think. OUTPUT="/home/pi/allsky/images/$LAST_NIGHT/keogram/keogram-$LAST_NIGHT.jpg" KEOGRAM="keogram-$LAST_NIGHT.jpg"

lftp "$PROTOCOL"://"$USER":"$PASSWORD"@"$HOST":"$KEOGRAM_DIR" \ -e "set net:max-retries 1; put $OUTPUT; mv $KEOGRAM $KEOGRAM_DIR/$KEOGRAM; bye"

[spacemanbobby]

Would the same thing be done for the startrails error. that is in the email that you saw this.

On Tue, Apr 16, 2019 at 1:48 PM Thomas Jacquin notifications@github.com wrote:

Ah yes, I see, it's because $OUTPUT evaluates to home/pi/allsky/images/20190416/keogram/keogram-20190416.jpg instead of keogram-20190416.jpg instead of keogram-20190416.jpg.

Adding a variable like this should work I think. OUTPUT="/home/pi/allsky/images/$LAST_NIGHT/keogram/keogram-$LAST_NIGHT.jpg" KEOGRAM="keogram-$LAST_NIGHT.jpg"

lftp "$PROTOCOL"://"$USER":"$PASSWORD"@"$HOST":"$KEOGRAM_DIR" -e "set net:max-retries 1; put $OUTPUT; mv $KEOGRAM $KEOGRAM_DIR/$KEOGRAM; bye"

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/thomasjacquin/allsky/issues/74#issuecomment-483837225, or mute the thread https://github.com/notifications/unsubscribe-auth/ArTEuj4NrajYGE6cpdrG3E58jvP5XPVmks5vhjcKgaJpZM4cn7mC .

[thomasjacquin]

Yes same idea for startrails, just replace KEOGRAM by STARTRAILS

[spacemanbobby]

I made the changes and ran the endofnight script.. Everything uploads to the correct directories now.

Thanks for helping identify these things. I'll post my settings so other user who have webpages like mine may see what needs to be done.

On Tue, Apr 16, 2019 at 1:48 PM Thomas Jacquin notifications@github.com wrote:

Ah yes, I see, it's because $OUTPUT evaluates to home/pi/allsky/images/20190416/keogram/keogram-20190416.jpg instead of keogram-20190416.jpg instead of keogram-20190416.jpg.

Adding a variable like this should work I think. OUTPUT="/home/pi/allsky/images/$LAST_NIGHT/keogram/keogram-$LAST_NIGHT.jpg" KEOGRAM="keogram-$LAST_NIGHT.jpg"

lftp "$PROTOCOL"://"$USER":"$PASSWORD"@"$HOST":"$KEOGRAM_DIR" -e "set net:max-retries 1; put $OUTPUT; mv $KEOGRAM $KEOGRAM_DIR/$KEOGRAM; bye"

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/thomasjacquin/allsky/issues/74#issuecomment-483837225, or mute the thread https://github.com/notifications/unsubscribe-auth/ArTEuj4NrajYGE6cpdrG3E58jvP5XPVmks5vhjcKgaJpZM4cn7mC .

[gremlinforce007]

@spacemanbobby Thanks for your assistance as well, can you kindly post your scripts as i'm still having issues :)

[spacemanbobby]

One thing I need to ask.. Did you create an FTP account on your website? If so.... what directory does it default log into. As I said... Mine logs into my allsky. If your's does the same then maybe the scripts I modified will work... I'll post them tonight... Have to find them first.

On Tue, Apr 16, 2019 at 3:51 PM gremlinforce007 notifications@github.com wrote:

@spacemanbobby https://github.com/spacemanbobby Thanks for your assistance as well, can you kindly post your scripts as i'm still having issues :)

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/thomasjacquin/allsky/issues/74#issuecomment-483872699, or mute the thread https://github.com/notifications/unsubscribe-auth/ArTEurwVws8vgsy4PJbu9Dg2dP6C6Dcwks5vhlQGgaJpZM4cn7mC .

[spacemanbobby]

OK.. here is a cut and paste of all the things I changed... and now it works. So if you want.. cut and paste some of the things I pasted from my scripts over your's. But make a backup copy just in case of the originals.

On my website I created under the allsky directory. 4 folders.. images, videos, keograms, and startrails Make sure your allsky has 755 as chmod settings and the folders under it should inherit those settings.

ftp-settings.sh

FTP/SFTP settings

PROTOCOL='ftp' USER='allsky@webpage.com' PASSWORD='***' HOST='ftp.webpage.com' IMGDIR='/images' MP4DIR='/videos' KEOGRAM_DIR='/keograms' STARTRAILS_DIR='/startrails'

Reason I changed paths is that the FTP account I created in CPanel, logs directly into the allsky directory.

saveImageDay.sh

lftp "$PROTOCOL"://"$USER":"$PASSWORD"@"$HOST":"$IMGDIR" -e "set net:max-retries 1; set net:timeout 20; set ftp:ssl-allow no; put $FILENAME-resize.$EXTENSION; mv $FILENAME-resize.$EXTENSION images/$FILENAME-resize.$EXTENSION; bye" &

saveImageNight.sh

lftp "$PROTOCOL"://"$USER":"$PASSWORD"@"$HOST":"$IMGDIR" -e "set net:max-retries 1; set net:timeout 20; set ftp:ssl-allow no; put $FILENAME-resize.$EXTENSION; mv $FILENAME-resize.$EXTENSION images/$FILENAME-resize.$EXTENSION; bye"

timelapse.sh

lftp "$PROTOCOL"://"$USER":"$PASSWORD"@"$HOST":"$MP4DIR" -e "set net:max-retries 1; set ftp:ssl-allow no; put images/$1/allsky-$1.mp4; mv allsky-$1.mp4 $MP4DIR/allsky-$1.mp4; bye"

endOfNight.sh

OUTPUT="/home/pi/allsky/images/$LAST_NIGHT/keogram/keogram-$LAST_NIGHT.jpg" KEOGRAM="keogram-$LAST_NIGHT.jpg" lftp "$PROTOCOL"://"$USER":"$PASSWORD"@"$HOST":"$KEOGRAM_DIR" -e "set net:max-retries 5; set ftp:ssl-allow no; put $OUTPUT; mv $KEOGRAM $KEOGRAM_DIR/$KEOGRAM; bye"

OUTPUT="/home/pi/allsky/images/$LAST_NIGHT/startrails/startrails-$LAST_NIGHT.jpg" STARTRAILS="startrails-$LAST_NIGHT.jpg" lftp "$PROTOCOL"://"$USER":"$PASSWORD"@"$HOST":"$STARTRAILS_DIR" -e "set net:max-retries 5; set ftp:ssl-allow no; put $OUTPUT; mv $STARTRAILS $STARTRAILS_DIR/$STARTRAILS; bye"

Let your system run through the night and when it is done in the morning, see if it did it's thing.. With these settings and Thomas's help everything now loads to the correct directories. Before he helped, it was just uploading to my base allsky directory. Reason I say wait, is that the system has to generate the keograms, startrails and the video(mp4) from the images that it takes on the Raspberry Pi device... Then when the endOfNight.sh script runs... it gathers up all the images one group at a time and creates the jpg's and mp4 that need to be uploaded via ftp.

On Tue, Apr 16, 2019 at 3:51 PM gremlinforce007 notifications@github.com wrote:

@spacemanbobby https://github.com/spacemanbobby Thanks for your assistance as well, can you kindly post your scripts as i'm still having issues :)

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/thomasjacquin/allsky/issues/74#issuecomment-483872699, or mute the thread https://github.com/notifications/unsubscribe-auth/ArTEurwVws8vgsy4PJbu9Dg2dP6C6Dcwks5vhlQGgaJpZM4cn7mC .

[gremlinforce007]

Hi Team,

My Startrails and keograms are still not working:

FTP/SFTP settings

PROTOCOL='ftp' USER='allsky@webpage.com' PASSWORD='***' HOST='ftp.webpage.com' IMGDIR='/images' MP4DIR='/videos' KEOGRAM_DIR='/keograms' STARTRAILS_DIR='/startrails'

> scripts/endOfNight.sh: line 22: keogram-20190417.jpg: command not found

endOfNight.txt

Can you let me know whats wrong ?

[thomasjacquin]

Try getting rid of the space in KEOGRAM= "keogram-$LAST_NIGHT.jpg"

[gremlinforce007]

FIXED YAY

endOfNight sample.txt saveImageNightsample.txt

[ZebrasHaveBigEars]

ONLY IF YOU HAVE MAJOR FTP PROBLEMS, test your ftp using this simple code saved into test.sh and then run from terminal on your pi from within the directory using ./test.sh. Subcommand "debug" provides lots of help for errors and "dir" tells you the starting path for your allsky directory.

!/bin/bash

lftp " set ssl:verify-certificate no set net:max-retries 1 set net:timeout 20 open ftp://website.com user 'username' 'password' debug cd dir lpwd bye" echo "FTP DONE" date

In fact, I substituted this lftp code into the allsky scripts and simply added the transfer code provided by Thomas into it. After a week of trying to get the original code to work or using more complex code, this simple code was the only way I managed to get it to work and it was very easy to do. The subcommand "set ssl:verify-certificate/ftp.website.com no" did not work for me for some reason.

It should be easy to substitute in the new code for Thomas' slicker code but which is harder to troubleshoot:

1. Make a copy of the original code
2. Put # in front of the original lftp command line
3. Once tested copy in the new lftp code below the original lftp line (not the first line)
4. Put in new code using "cd folder/folder" etc to move to the correct folder in your remote website
5. Check Thomas' original lftp code and put in the appropriate "put" command into the script
6. Make sure you indent the new code to be positioned in the same place as the original
7. Make sure you don't forget the fi command!
8. Save. Test using ./allsky.sh

If anyone wants examples then let me know.

[elineberry75]

Forgive my ignorance but while I'm pretty good at most "techy" things, I'm pretty new to Pi's and Linux. I have the pi up and running with Allsky and an ASI20MC-S and it seems to work great! I can access it via GUI and see the live images but I'm having problems with getting my FTP to work correctly as NOTHING is uploading. I've ran the scripts manually to look for errors and I get the following error: Fatal error: Certificate verification: certificate common name doesn't match requested host name...... I've edited the scripts to use "set ftp:ssl-allow no" like I've read in some of your examples on these posts but it still does not work. I'm using GoDaddy hosting and configured FTP in the cPanel. I can get it to connect without problems in Filezilla using the same credentials I have configured in ftp-setting.sh. Any suggestions?? I think I could figure out other small issues to get it working like it should if I could ever get the FTP to communicate.

Also, on a side note, does sameImageDay(or Night) upload every image as a separate file or does it overwrite it each time to the filename I designated in settings.json? My image name in settings.json is simply "image.jpg" and it is in the allsky main directory which is where my FTP settings are setup to deposit the image. In other words, I do not have a separate directory for images like I do for startrails, MP4, keograms, etc. Will that work or do I need a "images" directory?

Thanks in advance for any help!!

[spacemanbobby]

I'll see if I can send you what I have... I had almost the exact same issue.. Once I got it to connect it wouldn't put things in the right folders... I am busy right now but will look at my email history and send what changes I made.

On Sun, Oct 27, 2019 at 10:29 AM elineberry75 notifications@github.com wrote:

Forgive my ignorance but while I'm pretty good at most "techy" things, I'm pretty new to Pi's and Linux. I have the pi up and running with Allsky and an ASI20MC-S and it seems to work great! I can access it via GUI and see the live images but I'm having problems with getting my FTP to work correctly as NOTHING is uploading. I've ran the scripts manually to look for errors and I get the following error: Fatal error: Certificate verification: certificate common name doesn't match requested host name...... I've edited the scripts to use "set ftp:ssl-allow no" like I've read in some of your examples on these posts but it still does not work. I'm using GoDaddy hosting and configured FTP in the cPanel. I can get it to connect without problems in Filezilla using the same credentials I have configured in ftp-setting.sh. Any suggestions?? I think I could figure out other small issues to get it working like it should if I could ever get the FTP to communicate.

Also, on a side note, does sameImageDay(or Night) upload every image as a separate file or does it overwrite it each time to the filename I designated in settings.json? My image name in settings.json is simply "image.jpg" and it is in the allsky main directory which is where my FTP settings are setup to deposit the image. In other words, I do not have a separate directory for images like I do for startrails, MP4, keograms, etc. Will that work or do I need a "images" directory?

Thanks in advance for any help!!

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/thomasjacquin/allsky/issues/74?email_source=notifications&email_token=AK2MJOXOCKQZOCYTUDNDQFDQQXFY7A5CNFSM4HE7XGBKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOECLDUPI#issuecomment-546716221, or unsubscribe https://github.com/notifications/unsubscribe-auth/AK2MJOXQYOJFECZ63PXNOXTQQXFY7ANCNFSM4HE7XGBA .

[elineberry75]

Thank you. That would be great! I really appreciate it.

[elineberry75]

So, I've been working on it some and although I'm still getting the "Certificate not matching" error, it is uploading the files. The image and video files are being deposited in the correct directories, however the keograms and startrails are not. Like you said, they are going into the allsky root directory. My ftp_settings.sh file is below. Permissions for all of the folders are the same (0755).

!/bin/bash

FTP/SFTP settings

PROTOCOL='ftp' USER='xxxxxxxxx' PASSWORD='xxxxxxxx' HOST='xxxxxxxxxxxxxxxxxx' IMGDIR='/' MP4DIR='/videos' KEOGRAM_DIR='/keograms' STARTRAILS_DIR='/startrails'

[spacemanbobby]

OK.. here is a cut and paste of all the things I changed... and now it works. So if you want.. cut and paste some of the things I pasted from my scripts over your's. But make a backup copy just in case of the originals.

On my website I created under the allsky directory. 4 folders.. images, videos, keograms, and startrails Make sure your allsky has 755 as chmod settings and the folders under it should inherit those settings.

ftp-settings.sh

FTP/SFTP settings

PROTOCOL='ftp' USER='allsky@webpage.com' PASSWORD='***' HOST='ftp.webpage.com' IMGDIR='/images' MP4DIR='/videos' KEOGRAM_DIR='/keograms' STARTRAILS_DIR='/startrails'

Reason I changed paths is that the FTP account I created in CPanel, logs directly into the allsky directory.

saveImageDay.sh

lftp "$PROTOCOL"://"$USER":"$PASSWORD"@"$HOST":"$IMGDIR" -e "set net:max-retries 1; set net:timeout 20; set ftp:ssl-allow no; put $FILENAME-resize.$EXTENSION; mv $FILENAME-resize.$EXTENSION images/$FILENAME-resize.$EXTENSION; bye" &

saveImageNight.sh

lftp "$PROTOCOL"://"$USER":"$PASSWORD"@"$HOST":"$IMGDIR" -e "set net:max-retries 1; set net:timeout 20; set ftp:ssl-allow no; put $FILENAME-resize.$EXTENSION; mv $FILENAME-resize.$EXTENSION images/$FILENAME-resize.$EXTENSION; bye"

timelapse.sh

lftp "$PROTOCOL"://"$USER":"$PASSWORD"@"$HOST":"$MP4DIR" -e "set net:max-retries 1; set ftp:ssl-allow no; put images/$1/allsky-$1.mp4; mv allsky-$1.mp4 $MP4DIR/allsky-$1.mp4; bye"

endOfNight.sh

            OUTPUT="/home/pi/allsky

/images/$LAST_NIGHT/keogram/keogram-$LAST_NIGHT.jpg" KEOGRAM="keogram-$LAST_NIGHT.jpg" lftp "$PROTOCOL"://"$USER":"$PASSWORD"@"$HOST":"$KEOGRAM_DIR" -e "set net:max-retries 5; set ftp:ssl-allow no; put $OUTPUT; mv $KEOGRAM $KEOGRAM_DIR/$KEOGRAM; bye"

            OUTPUT="/home/pi/allsky

/images/$LAST_NIGHT/startrails/startrails-$LAST_NIGHT.jpg" STARTRAILS="startrails-$LAST_NIGHT.jpg" lftp "$PROTOCOL"://"$USER":"$PASSWORD"@"$HOST":"$STARTRAILS_DIR" -e "set net:max-retries 5; set ftp:ssl-allow no; put $OUTPUT; mv $STARTRAILS $STARTRAILS_DIR/$STARTRAILS; bye"

Let your system run through the night and when it is done in the morning, see if it did it's thing.. With these settings and Thomas's help everything now loads to the correct directories. Before he helped, it was just uploading to my base allsky directory. Reason I say wait, is that the system has to generate the keograms, startrails and the video(mp4) from the images that it takes on the Raspberry Pi device... Then when the endOfNight.sh script runs... it gathers up all the images one group at a time and creates the jpg's and mp4 that need to be uploaded via ftp.

On Sun, Oct 27, 2019 at 1:47 PM elineberry75 notifications@github.com wrote:

So, I've been working on it some and although I'm still getting the "Certificate not matching" error, it is uploading the files. The image and video files are being deposited in the correct directories, however the keograms and startrails are not. Like you said, they are going into the allsky root directory. My ftp_settings.sh file is below. Permissions for all of the folders are the same (0755).

!/bin/bash

FTP/SFTP settings

PROTOCOL='ftp' USER='xxxxxxxxx' PASSWORD='xxxxxxxx' HOST='xxxxxxxxxxxxxxxxxx' IMGDIR='/' MP4DIR='/videos' KEOGRAM_DIR='/keograms' STARTRAILS_DIR='/startrails'

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/thomasjacquin/allsky/issues/74?email_source=notifications&email_token=AK2MJOX6WS2EOEAKZ5MPRN3QQX473A5CNFSM4HE7XGBKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOECLHWBA#issuecomment-546732804, or unsubscribe https://github.com/notifications/unsubscribe-auth/AK2MJOQXXB3MZBQZ44QH3OTQQX473ANCNFSM4HE7XGBA .

[elineberry75]

For some reason, the images and videos are correct but the keograms and startrails are still going in the root directory. My files are below. I will let it run through the night and check it tomorrow but when I manually run the scripts, it still puts the startrails and keograms in the root directory. Not sure what is different for those and not the images and videos which seems to be working correctly.

saveImageDay.sh lftp "$PROTOCOL"://"$USER":"$PASSWORD"@"$HOST":"$IMGDIR" -e "set net:max-retries 1; set net:timeout 20; set ftp:ssl-allow no; put $FILENAME-resize.$EXTENSION; mv $FILENAME-resize.$EXTENSION images/$FILENAME-resize.$EXTENSION; bye" &

saveImageNight.sh lftp "$PROTOCOL"://"$USER":"$PASSWORD"@"$HOST":"$IMGDIR" -e "set net:max-retries 1; set net:timeout 20; set ftp:ssl-allow no; put $FILENAME-resize.$EXTENSION; mv $FILENAME-resize.$EXTENSION images/$FILENAME-resize.$EXTENSION; bye" &

timelapse.sh lftp "$PROTOCOL"://"$USER":"$PASSWORD"@"$HOST":"$MP4DIR" -e "set net:max-retries 1; set ftp:ssl-allow no; put images/$1/allsky-$1.mp4; mv allsky-$1.mp4 $MP4DIR/allsky-$1.mp4; bye"

endOfNight.sh lftp "$PROTOCOL"://"$USER":"$PASSWORD"@"$HOST":"$KEOGRAM_DIR" -e "set net:max-retries 5; set ftp:ssl-allow no; put $OUTPUT; mv $KEOGRAM $KEOGRAM_DIR/$KEOGRAM; bye"

lftp "$PROTOCOL"://"$USER":"$PASSWORD"@"$HOST":"$STARTRAILS_DIR" -e "set net:max-retries 5; set ftp:ssl-allow no; put $OUTPUT; mv $STARTRAILS $STARTRAILS_DIR/$STARTRAILS; bye"

[elineberry75]

So, I figured it out with the help of spacemanbobby. Thanks! The problem was with the "mv" command in endOfNight.sh. Here's what I ended up with that worked:

endOfNight.sh lftp "$PROTOCOL"://"$USER":"$PASSWORD"@"$HOST":"$KEOGRAM_DIR" -e "set net:max-retries 5; set ftp:ssl-allow no; put $OUTPUT; mv keogram-$LAST_NIGHT.jpg $KEOGRAM_DIR/keogram-$LAST_NIGHT.jpg; bye"

lftp "$PROTOCOL"://"$USER":"$PASSWORD"@"$HOST":"$STARTRAILS_DIR" -e "set net:max-retries 5; set ftp:ssl-allow no; put $OUTPUT; mv startrails-$LAST_NIGHT.jpg $STARTRAILS_DIR/startrails-$LAST_NIGHT.jpg; bye"

The only thing I see having an error at this point and maybe it doesn't matter is the postData.sh script that is called on at the very beginning of endOfNight.sh. For whatever reason, it does not send the data.json file like it is supposed to.

[spacemanbobby]

Glad I was able to help.

On Sun, Oct 27, 2019 at 7:12 PM elineberry75 notifications@github.com wrote:

So, I figured it out with the help of spacemanbobby. Thanks! The problem was with the "mv" command in endOfNight.sh. Here's what I ended up with that worked:

endOfNight.sh lftp "$PROTOCOL"://"$USER":"$PASSWORD"@"$HOST":"$KEOGRAM_DIR" -e "set net:max-retries 5; set ftp:ssl-allow no; put $OUTPUT; mv keogram-$LAST_NIGHT.jpg $KEOGRAM_DIR/keogram-$LAST_NIGHT.jpg; bye"

lftp "$PROTOCOL"://"$USER":"$PASSWORD"@"$HOST":"$STARTRAILS_DIR" -e "set net:max-retries 5; set ftp:ssl-allow no; put $OUTPUT; mv startrails-$LAST_NIGHT.jpg $STARTRAILS_DIR/startrails-$LAST_NIGHT.jpg; bye"

The only thing I see having an error at this point and maybe it doesn't matter is the postData.sh script that is called on at the very beginning of endOfNight.sh. For whatever reason, it does not send the data.json file like it is supposed to.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/thomasjacquin/allsky/issues/74?email_source=notifications&email_token=AK2MJOQTE7SLNBICTPUHWWDQQZDANA5CNFSM4HE7XGBKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOECLPO7I#issuecomment-546764669, or unsubscribe https://github.com/notifications/unsubscribe-auth/AK2MJOSSRECVWKKD7GCOGWTQQZDANANCNFSM4HE7XGBA .

[maserowik]

Sorry to bring up a old thread but

The only thing I see having an error at this point and maybe it doesn't matter is the postData.sh script that is called on at the very beginning of endOfNight.sh. For whatever reason, it does not send the data.json file like it is supposed to.

on my postData.sh I added to following and the data.json appears to get updated.

lftp "$PROTOCOL"://"$USER":"$PASSWORD"@"$HOST":"$IMGDIR" -e "set net:max-retries 1; set net:timeout 20; set ftp:ssl-allow no; put data.json; mv data.json data.json; bye"

[spacemanbobby]

When you installed the ne version, did you need to modify the .SH files to get the FTP to work. Other than entering your FTP information into the FTP Upload file.

Let me know when you can, thanks.

On Thu, Aug 6, 2020 at 11:22 AM maserowik notifications@github.com wrote:

Sorry to bring up a old thread but

The only thing I see having an error at this point and maybe it doesn't matter is the postData.sh script that is called on at the very beginning of endOfNight.sh. For whatever reason, it does not send the data.json file like it is supposed to.

on my postData.sh I added to following and the data.json appears to get updated.

lftp "$PROTOCOL"://"$USER":"$PASSWORD"@"$HOST":"$IMGDIR" -e "set net:max-retries 1; set net:timeout 20; set ftp:ssl-allow no; put data.json; mv data.json data.json; bye"

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/thomasjacquin/allsky/issues/74#issuecomment-670097021, or unsubscribe https://github.com/notifications/unsubscribe-auth/AK2MJOUDKEPBIZHMVVMIJH3R7LYFPANCNFSM4HE7XGBA .

[maserowik]

When you installed the ne version, did you need to modify the .SH files to get the FTP to work. Other than entering your FTP information into the FTP Upload file. Let me know when you can, thanks. … On Thu, Aug 6, 2020 at 11:22 AM maserowik @.***> wrote: Sorry to bring up a old thread but The only thing I see having an error at this point and maybe it doesn't matter is the postData.sh script that is called on at the very beginning of endOfNight.sh. For whatever reason, it does not send the data.json file like it is supposed to. on my postData.sh I added to following and the data.json appears to get updated. lftp "$PROTOCOL"://"$USER":"$PASSWORD"@"$HOST":"$IMGDIR" -e "set net:max-retries 1; set net:timeout 20; set ftp:ssl-allow no; put data.json; mv data.json data.json; bye" — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#74 (comment)>, or unsubscribe https://github.com/notifications/unsubscribe-auth/AK2MJOUDKEPBIZHMVVMIJH3R7LYFPANCNFSM4HE7XGBA .

Still fighting with setting up the FTP. I followed what was post here but no luck. I can see the files uploaded to my hosting site but they are not moving to the correct directory. The same for the resized image the files are there but not showing up on my website.

If you like to go off list I cam be reached at mserowik@gmail.com

Mike

[thomasjacquin]

@maserowik What's your website address?

[spacemanbobby]

My Website is Spacemanbob.com

/home2/spacemb6/public_html/allsksy <- That is where my Images land... It was all working on my Pi 3 board before it died... I have added the lftp stuff for no ssl... etc.. but now nothing is loading through FTP now.

I know I added an s in allsksy. I was testing things a while back and just kept to that directory.

On Fri, Aug 7, 2020 at 1:22 PM Thomas Jacquin notifications@github.com wrote:

@maserowik https://github.com/maserowik What's your website address?

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/thomasjacquin/allsky/issues/74#issuecomment-670697722, or unsubscribe https://github.com/notifications/unsubscribe-auth/AK2MJOXFHSAUIE667SWXCDLR7RO73ANCNFSM4HE7XGBA .

[maserowik]

@maserowik What's your website address?

n3bsq.com/allsky

[maserowik]

n3bsq.com.docx

[thomasjacquin]

@maserowik In config.js change this line imageName: "domains/n3bsq.com/public_html/allsky/image-resize.jpg" for this one imageName: "image-resize.jpg"

[thomasjacquin]

@spacemanbobby What's the error in the terminal when you launch ./allsky.sh? Did you set UPLOAD_IMG=true in config.sh?

[maserowik]

With much support for the forum and other user, There are too many to list. The allsky website at n3bsq.com/allsky appears to be working with a few issues. when hitting the n3bsq.com/allsky, I get a aurora forecast stating it is not dark yet come back in 00 minutes. not sure how to fix that. Also on the time lapse i see the files there but for some reason unplayable on two of my laptops and one of my desktop.

also for the ssh/ssl issue i tried to add the command to the *.sh files but still not luck. I followed the following

https://www.librebyte.net/en/ftp/lftp-fatal-error-certificate-verification-not-trusted/

I added it to the /etc/lftp.conf file.

one step closer.

[spacemanbobby]

Where is config.js located at.

On Fri, Aug 7, 2020 at 6:28 PM Thomas Jacquin notifications@github.com wrote:

@maserowik https://github.com/maserowik In config.js change this line imageName: "domains/n3bsq.com/public_html/allsky/image-resize.jpg" for this one imageName: "image-resize.jpg"

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/thomasjacquin/allsky/issues/74#issuecomment-670803766, or unsubscribe https://github.com/notifications/unsubscribe-auth/AK2MJOR5SHHQ42N2FVTH5UTR7SS2NANCNFSM4HE7XGBA .

[spacemanbobby]

I got it all working.. Was for some reason not liking the old password I had forever.. When I changed it to a new one.. ftp started.. And the config.js.. I had that figured out when I went to my webpage and modified the location to send the images of the day.. So at this point I'm good.

On Fri, Aug 7, 2020 at 6:30 PM Thomas Jacquin notifications@github.com wrote:

@spacemanbobby https://github.com/spacemanbobby What's the error in the terminal when you launch ./allsky.sh? Did you set UPLOAD_IMG=true in config.sh?

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/thomasjacquin/allsky/issues/74#issuecomment-670804068, or unsubscribe https://github.com/notifications/unsubscribe-auth/AK2MJOSNLF7IBRZ4OHXDK7TR7STEBANCNFSM4HE7XGBA .

[maserowik]

I am sure I have a path issue in the tag "imageName"

When I use FileZilla I land in the following that is where the config.js is located.

I tried it in the location Thomas suggested image-resized.jpg was still unable to see the live image,but when I go to n3bsq.com/allsky/image-resize.jpg i can see the image

Here is my config.js

var config = { title: "Bethel Park, PA", imageName: "domains/n3bsq.com/public_html/image-resize.jpg", location: "Bethel Park, United States", latitude: 40.3044, longitude: -80.0717, az: 180, camera: "ASI224MC", computer: "Raspberry Pi 3", owner: "Michael Serowik", auroraMap: "north", overlaySize: 875, overlayOffsetLeft: 0, overlayOffsetTop: 0, }

From: spacemanbobby notifications@github.com Sent: Sunday, August 9, 2020 1:59 PM To: thomasjacquin/allsky allsky@noreply.github.com Cc: maserowik maserowik@verizon.net; Mention mention@noreply.github.com Subject: Re: [thomasjacquin/allsky] FTP Issue (#74)

Where is config.js located at.

On Fri, Aug 7, 2020 at 6:28 PM Thomas Jacquin <notifications@github.com mailto:notifications@github.com > wrote:

@maserowik https://github.com/maserowik In config.js change this line imageName: "domains/n3bsq.com/public_html/allsky/image-resize.jpg" for this one imageName: "image-resize.jpg"

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/thomasjacquin/allsky/issues/74#issuecomment-670803766, or unsubscribe https://github.com/notifications/unsubscribe-auth/AK2MJOR5SHHQ42N2FVTH5UTR7SS2NANCNFSM4HE7XGBA .

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/thomasjacquin/allsky/issues/74#issuecomment-671082419 , or unsubscribe https://github.com/notifications/unsubscribe-auth/AGEFY5QEUIEHFHH3UDTWPH3R73PWLANCNFSM4HE7XGBA . https://github.com/notifications/beacon/AGEFY5RRMSEUW7DA2BP5AIDR73PWLA5CNFSM4HE7XGBKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOE776PMY.gif

-- This email has been checked for viruses by Avast antivirus software. https://www.avast.com/antivirus

[maserowik]

OK I want to thank again all who assisted me with my allsky project. I done so many changes i am not quite sure i can duplicate what I did. One more was completed today. I was stuck on the loading image on my live view. I changed the path in the config.js and nothing worked. I finally went and cleared my cache on my machine and went to my webhoster and cleared the website cache. again not sure if that did anything but now i can see my live image on the website.

n3bsq.com/allsky now appears to be working correctly.

[spacemanbobby]

Good Job... Mine seems to be working but I have a issue that I didn't have in my Pi3 version.. The camera posts garbled images every so often.. I have the option to delete bad images turned on but it didn't do that on my video upload for the day. Also... is there a way to turn off image stretch without having to take my unit all apart from the box I have it in to get to that file. I suspect it is the Json that was moved to the etc folder.. The allsky doesn't see it now that it is moved.

On Mon, Aug 10, 2020 at 11:33 AM maserowik notifications@github.com wrote:

OK I want to thank again all who assisted me with my allsky project. I done so many changes i am not quite sure i can duplicate what I did. One more was completed today. I was stuck on the loading image on my live view. I changed the path in the config.js and nothing worked. I finally went and cleared my cache on my machine and went to my webhoster and cleared the website cache. again not sure if that did anything but now i can see my live image on the website.

n3bsq.com/allsky now appears to be working correctly.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/thomasjacquin/allsky/issues/74#issuecomment-671517975, or unsubscribe https://github.com/notifications/unsubscribe-auth/AK2MJOWB4RWEQPG4MIIUVK3SAA4ONANCNFSM4HE7XGBA .

[spacemanbobby]

Is anyone else getting this type of effect during the capture during the day. http://spacemanbob.com/allsksy/videos/allsky-20200817.mp4 I have auto gain set to no and auto exposure set to no. Gain is set to 152. Exposure is set to 33 seconds. I have tried all sorts of combo's.. Still getting these flashes... I am working on the Dark issue also.. Had to have the Dark setting turned on for 5 minutes before I turned it off to get something other than pixels all over the place on the image.

asi185mc is my camera.

On Fri, Aug 7, 2020 at 3:15 PM maserowik notifications@github.com wrote:

n3bsq.com.docx https://github.com/thomasjacquin/allsky/files/5043974/n3bsq.com.docx

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/thomasjacquin/allsky/issues/74#issuecomment-670746076, or unsubscribe https://github.com/notifications/unsubscribe-auth/AK2MJOQ6QI7KNDV6PPTACKLR7R4HDANCNFSM4HE7XGBA .

[thomasjacquin]

I have had reports about this kind of behaviour. I believe it is caused by the auto-exposure calculation. It is not an allsky thing and it seems to affect only certain models. I think it's coming from the ZWO library. Since this is not related to FTP issues, can you submit a new issue report for this? Thanks

Try using an older version of allsky/lib/armv7/libASICamera2.a Try replacing it with this one and see if it makes a difference: https://github.com/thomasjacquin/allsky/raw/bd03b5b09f5bac4eaac75a93ddf1c79b489a3b71/lib/armv7/libASICamera2.a