search

aaronwmorris / indi-allsky

Software to manage a Linux-based All Sky Camera.
GNU General Public License v3.0
252 stars 41 forks source link

Web Only Install Not Flushing Expired Exposures #1659

Open cfmorrell opened 2 days ago

cfmorrell commented 2 days ago

I'm running a split setup where my pi is local only and I've got a web only install that's running in AWS. It seems that the web only instance is not cleaning up expired exposures. Even when running ./misc/flush_images.py, the /var/www/html/allsky/images/camera/exposures folder remains untouched. It seems like there may be a service that is include in the main install that is not included in the web only version. I don't have this issue on my pi instance. I was looking for a failure in a log file, but there's no indi-allsky.log file in /var/log/indi-allsky on the web only instance, just the webapp log file.

aaronwmorris commented 2 days ago

By default, the flush images script will only flush images for camera ID 1. If you have multiple camera entries, you will have to run it again for the additional cameras.

cfmorrell commented 2 days ago

I've only got one camera configured. I'll run it again to see, but the automatic cleanup isn't working either.

cfmorrell commented 2 days ago

I see that the flush failed out saying that it was killed, but I didn't kill it. I assume something is missing that is causing it to fail. The camera listed is the correct one.

image
aaronwmorris commented 2 days ago

Can you post your Support Info bundle?

cfmorrell commented 2 days ago

Maybe I've got something bigger going on here. The support bundle webpage doesn't populate anything and when I run the shell script, it errors out somewhere after lsusb.

`#################################

indi-allsky support info

#################################


Distribution: ubuntu
Release: 24.04
Arch: x86_64
Bits: 64

CPUs: 1
Memory: 465076 kB

System: Generic PC

Linux ip-172-31-72-85 6.8.0-1018-aws #20-Ubuntu SMP Thu Oct 10 18:14:42 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
Hostname
ip-172-31-72-85.ec2.internal
ip-172-31-72-85.ec2.internal

Time
Wed Nov 20 15:39:54 UTC 2024

System timezone
Etc/UTC

Uptime
 15:39:54 up 56 min,  2 users,  load average: 0.01, 1.66, 2.16

Memory
               total        used        free      shared  buff/cache   available
Mem:          465076      319016        6596        1560      170268      146060
Swap:              0           0           0

Filesystems
Filesystem     1K-blocks     Used Available Use% Mounted on
/dev/root       29378688 18164036  11198268  62% /
tmpfs             232536        0    232536   0% /dev/shm
tmpfs              93016      896     92120   1% /run
tmpfs               5120        0      5120   0% /run/lock
/dev/xvda16       901520   135272    703120  17% /boot
/dev/xvda15       106832     6246    100586   6% /boot/efi
tmpfs              46504       16     46488   1% /run/user/1000

sysctl info
vm.swappiness = 60

Thermal info

system python: Python 3.12.3

indiserver: /usr/bin/indiserver

IP Info
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host noprefixroute
       valid_lft forever preferred_lft forever
2: enX0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 9001 qdisc fq_codel state UP group default qlen 1000
    link/ether 12:88:08:26:9d:69 brd ff:ff:ff:ff:ff:ff
    inet 172.31.72.85/20 metric 100 brd 172.31.79.255 scope global dynamic enX0
       valid_lft 2009sec preferred_lft 2009sec
    inet6 fe80::1088:8ff:fe26:9d69/64 scope link
       valid_lft forever preferred_lft forever

User info
uid=1000(ubuntu) gid=1000(ubuntu) groups=1000(ubuntu),4(adm),20(dialout),24(cdrom),27(sudo),30(dip),105(lxd)

Process info
ubuntu      1660  0.4  3.9  35652 18176 ?        SNs  15:28   0:03 /home/ubuntu/indi-allsky/virtualenv/indi-allsky/bin/python3 /home/ubuntu/indi-allsky/virtualenv/indi-allsky/bin/gunicorn --config /etc/indi-allsky/gunicorn.conf.py indi_allsky.wsgi
ubuntu      1672  0.8 24.9 684772 115904 ?       SNl  15:31   0:04 /home/ubuntu/indi-allsky/virtualenv/indi-allsky/bin/python3 /home/ubuntu/indi-allsky/virtualenv/indi-allsky/bin/gunicorn --config /etc/indi-allsky/gunicorn.conf.py indi_allsky.wsgi

Check for virtual sessions

USB info

###############

ERROR

###############

The script exited abnormally, please try to run again...`

cfmorrell commented 2 days ago

When I run those next few lines from the support script manually, I get the following:

`Check for virtual sessions

USB info

USB Permissions find: ‘/dev/bus/usb’: No such file or directory

video device Permissions ls: cannot access '/dev/video*': No such file or directory

v4l info Command 'v4l2-ctl' not found, but can be installed with: sudo apt install v4l-utils

Module info Module Size Used by 8021q 45056 0 garp 20480 1 8021q mrp 20480 1 8021q stp 12288 1 garp llc 16384 2 stp,garp crct10dif_pclmul 12288 1 crc32_pclmul 12288 0 polyval_clmulni 12288 0 polyval_generic 12288 1 polyval_clmulni ghash_clmulni_intel 16384 0 sha256_ssse3 32768 0 sha1_ssse3 32768 0 aesni_intel 356352 0 crypto_simd 16384 1 aesni_intel cryptd 24576 2 crypto_simd,ghash_clmulni_intel psmouse 217088 0 binfmt_misc 24576 1 nls_iso8859_1 12288 1 input_leds 12288 0 serio_raw 20480 0 sch_fq_codel 24576 2 nf_conntrack 196608 0 nf_defrag_ipv6 24576 1 nf_conntrack nf_defrag_ipv4 12288 1 nf_conntrack libcrc32c 12288 1 nf_conntrack dm_multipath 45056 0 msr 12288 0 efi_pstore 12288 0 nfnetlink 20480 2 ip_tables 32768 0 x_tables 65536 1 ip_tables autofs4 57344 2`

cfmorrell commented 2 days ago

I turned on your command tracing option and found the following:

`+ echo 'USB info' USB info

Apparently it doesn't like that lsusb returns nothing.

cfmorrell commented 2 days ago

I commented out the lsusb line and got the following support bundle:

#################################

indi-allsky support info

#################################


Distribution: ubuntu
Release: 24.04
Arch: x86_64
Bits: 64

CPUs: 1
Memory: 465076 kB

System: Generic PC

Linux ip-172-31-72-85 6.8.0-1018-aws #20-Ubuntu SMP Thu Oct 10 18:14:42 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
Hostname
ip-172-31-72-85.ec2.internal
ip-172-31-72-85.ec2.internal 

Time
Wed Nov 20 15:51:57 UTC 2024

System timezone
Etc/UTC

Uptime
 15:51:57 up  1:08,  2 users,  load average: 10.17, 4.20, 2.46

Memory
               total        used        free      shared  buff/cache   available
Mem:          465076      331920       33744        1608      130260      133156
Swap:              0           0           0

Filesystems
Filesystem     1K-blocks     Used Available Use% Mounted on
/dev/root       29378688 18170468  11191836  62% /
tmpfs             232536        0    232536   0% /dev/shm
tmpfs              93016      900     92116   1% /run
tmpfs               5120        0      5120   0% /run/lock
/dev/xvda16       901520   135272    703120  17% /boot
/dev/xvda15       106832     6246    100586   6% /boot/efi
tmpfs              46504       16     46488   1% /run/user/1000

sysctl info
vm.swappiness = 60

Thermal info

system python: Python 3.12.3

indiserver: /usr/bin/indiserver

IP Info
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host noprefixroute 
       valid_lft forever preferred_lft forever
2: enX0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 9001 qdisc fq_codel state UP group default qlen 1000
    link/ether 12:88:08:26:9d:69 brd ff:ff:ff:ff:ff:ff
    inet 172.31.72.85/20 metric 100 brd 172.31.79.255 scope global dynamic enX0
       valid_lft 3087sec preferred_lft 3087sec
    inet6 fe80::1088:8ff:fe26:9d69/64 scope link 
       valid_lft forever preferred_lft forever

User info
uid=1000(ubuntu) gid=1000(ubuntu) groups=1000(ubuntu),65534(nogroup)

Process info
ubuntu      2144  1.0  3.9  35652 18560 ?        SNs  15:51   0:00 /home/ubuntu/indi-allsky/virtualenv/indi-allsky/bin/python3 /home/ubuntu/indi-allsky/virtualenv/indi-allsky/bin/gunicorn --config /etc/indi-allsky/gunicorn.conf.py indi_allsky.wsgi
ubuntu      2147  9.9 26.6 682688 123732 ?       SNl  15:51   0:01 /home/ubuntu/indi-allsky/virtualenv/indi-allsky/bin/python3 /home/ubuntu/indi-allsky/virtualenv/indi-allsky/bin/gunicorn --config /etc/indi-allsky/gunicorn.conf.py indi_allsky.wsgi
ubuntu      2168  0.0  0.7   7860  3456 ?        SN   15:51   0:00 /bin/bash /home/ubuntu/indi-allsky/misc/support_info.sh

Check for virtual sessions

USB info

USB Permissions
find: ‘/dev/bus/usb’: No such file or directory

video device Permissions
total 256
drwxrwxr-x  4 ubuntu ubuntu   4096 Nov  8 16:09 ?
-rw-rw-r--  1 ubuntu ubuntu  35149 Sep  2 19:02 LICENSE
-rw-rw-r--  1 ubuntu ubuntu  34661 Nov  8 13:32 README.md
drwxrwxr-x  2 ubuntu ubuntu   4096 Sep  2 19:16 __pycache__
-rwxrwxr-x  1 ubuntu ubuntu   2854 Sep  2 19:02 allsky.py
-rw-rw-r--  1 ubuntu ubuntu    153 Sep  2 19:02 app.py
drwxr-xr-x  2 ubuntu nogroup  4096 Nov  8 15:47 bin
-rwxrwxr-x  1 ubuntu ubuntu   1837 Sep  2 19:02 config.py
drwxrwxr-x  2 ubuntu ubuntu   4096 Sep  2 19:02 content
-rwxrwxr-x  1 ubuntu ubuntu   2691 Sep  2 19:02 darks.py
drwxrwxr-x  2 ubuntu ubuntu   4096 Nov  8 13:32 docker
drwxrwxr-x  4 ubuntu ubuntu   4096 Sep  2 19:02 examples
-rw-rw-r--  1 ubuntu ubuntu   1993 Nov  8 13:32 flask.json_template
drwxrwxr-x  3 ubuntu ubuntu   4096 Sep  2 19:02 html
drwxr-xr-x  4 ubuntu nogroup  4096 Nov  8 15:46 include
drwxrwxr-x 14 ubuntu ubuntu   4096 Nov  9 03:52 indi_allsky
drwxr-xr-x  4 ubuntu nogroup  4096 Nov  8 15:46 lib
lrwxrwxrwx  1 nobody nogroup     3 Nov  8 15:46 lib64 -> lib
drwxrwxr-x 13 ubuntu ubuntu   4096 Sep  2 19:02 licenses
drwxrwxr-x  2 ubuntu ubuntu   4096 Sep  2 19:02 log
drwxrwxr-x  3 ubuntu ubuntu   4096 Sep  2 19:02 migrations
drwxrwxr-x  2 ubuntu ubuntu   4096 Nov 20 15:49 misc
-rw-rw-r--  1 ubuntu ubuntu     98 Sep  2 19:02 passenger_wsgi.py
drwxrwxr-x  2 ubuntu ubuntu   4096 Nov  8 13:32 requirements
drwxrwxr-x  2 ubuntu ubuntu   4096 Nov  8 13:32 service
-rwxrwxr-x  1 ubuntu ubuntu  85669 Nov  8 13:32 setup.sh
drwxrwxr-x  4 ubuntu ubuntu   4096 Nov  8 13:32 testing
drwxrwxr-x  4 ubuntu ubuntu   4096 Nov  8 16:08 venv
drwxrwxr-x  3 ubuntu ubuntu   4096 Nov  8 16:52 virtualenv

v4l info
/home/ubuntu/indi-allsky/misc/support_info.sh: line 186: v4l2-ctl: command not found

Module info
Module                  Size  Used by
tcp_diag               12288  0
inet_diag              32768  1 tcp_diag
8021q                  45056  0
garp                   20480  1 8021q
mrp                    20480  1 8021q
stp                    12288  1 garp
llc                    16384  2 stp,garp
crct10dif_pclmul       12288  1
crc32_pclmul           12288  0
polyval_clmulni        12288  0
polyval_generic        12288  1 polyval_clmulni
ghash_clmulni_intel    16384  0
sha256_ssse3           32768  0
sha1_ssse3             32768  0
aesni_intel           356352  0
crypto_simd            16384  1 aesni_intel
cryptd                 24576  2 crypto_simd,ghash_clmulni_intel
psmouse               217088  0
binfmt_misc            24576  1
nls_iso8859_1          12288  1
input_leds             12288  0
serio_raw              20480  0
sch_fq_codel           24576  2
nf_conntrack          196608  0
nf_defrag_ipv6         24576  1 nf_conntrack
nf_defrag_ipv4         12288  1 nf_conntrack
libcrc32c              12288  1 nf_conntrack
dm_multipath           45056  0
msr                    12288  0
efi_pstore             12288  0
nfnetlink              20480  2
ip_tables              32768  0
x_tables               65536  1 ip_tables
autofs4                57344  2

git status
On branch main
Your branch is up to date with 'origin/main'.

Changes not staged for commit:
  (use "git add <file>..." to update what will be committed)
  (use "git restore <file>..." to discard changes in working directory)
    modified:   misc/flush_images.py
    modified:   misc/support_info.sh

Untracked files:
  (use "git add <file>..." to include in what will be committed)
    bin/
    indi_allsky/bin/
    indi_allsky/lib/
    indi_allsky/lib64
    indi_allsky/pyvenv.cfg
    lib/
    lib64

no changes added to commit (use "git add" and/or "git commit -a")

git log
commit 5316befd964c432b40756267df4d3a2784dcc185
Merge: 6b96ee90 078c6257
Author: Aaron W Morris <aaron@aarmor.net>
Date:   Fri Nov 8 00:27:32 2024 -0600

    Merge pull request #1614 from aaronwmorris/dev

    New functionality: Moon Overlay

indi version: 2.1.0

indi packages
ii  libindi-data                         2.1.0+202410100653~ubuntu24.04.1             all          Instrument-Neutral Device Interface library -- shared data
ii  libindi-dev                          2.1.0+202410100653~ubuntu24.04.1             amd64        Instrument-Neutral Device Interface library -- development files
ii  libindi1:amd64                       2.1.0+202410100653~ubuntu24.04.1             amd64        Instrument-Neutral Device Interface library -- shared library

indi connections

Detected indi properties
looking for *.*.*
connect: Connection refused

libcamera: not detected

libcamera packages

libcamera cameras
libcamera-hello not available

python packages
ii  libpython3-dev:amd64                 3.12.3-0ubuntu2                              amd64        header files and a static library for Python (default)
ii  libpython3-stdlib:amd64              3.12.3-0ubuntu2                              amd64        interactive high-level object-oriented language (default python3 version)
ii  libpython3.11:amd64                  3.11.10-1+noble1                             amd64        Shared Python runtime library (version 3.11)
ii  libpython3.11-dev:amd64              3.11.10-1+noble1                             amd64        Header files and a static library for Python (v3.11)
ii  libpython3.11-minimal:amd64          3.11.10-1+noble1                             amd64        Minimal subset of the Python language (version 3.11)
ii  libpython3.11-stdlib:amd64           3.11.10-1+noble1                             amd64        Interactive high-level object-oriented language (standard library, version 3.11)
ii  libpython3.12-dev:amd64              3.12.3-1ubuntu0.2                            amd64        Header files and a static library for Python (v3.12)
ii  libpython3.12-minimal:amd64          3.12.3-1ubuntu0.2                            amd64        Minimal subset of the Python language (version 3.12)
ii  libpython3.12-stdlib:amd64           3.12.3-1ubuntu0.2                            amd64        Interactive high-level object-oriented language (standard library, version 3.12)
ii  libpython3.12t64:amd64               3.12.3-1ubuntu0.2                            amd64        Shared Python runtime library (version 3.12)
ii  python-apt-common                    2.7.7ubuntu3                                 all          Python interface to libapt-pkg (locales)
ii  python-babel-localedata              2.10.3-3build1                               all          tools for internationalizing Python applications - locale data files
ii  python3                              3.12.3-0ubuntu2                              amd64        interactive high-level object-oriented language (default python3 version)
ii  python3-apport                       2.28.1-0ubuntu3.1                            all          Python 3 library for Apport crash report handling
ii  python3-apt                          2.7.7ubuntu3                                 amd64        Python 3 interface to libapt-pkg
ii  python3-attr                         23.2.0-2                                     all          Attributes without boilerplate (Python 3)
ii  python3-automat                      22.10.0-2                                    all          Self-service finite-state machines for the programmer on the go
ii  python3-babel                        2.10.3-3build1                               all          tools for internationalizing Python applications - Python 3.x
ii  python3-bcrypt                       3.2.2-1build1                                amd64        password hashing library for Python 3
ii  python3-blinker                      1.7.0-1                                      all          Fast, simple object-to-object and broadcast signaling (Python3)
ii  python3-boto3                        1.34.46+dfsg-1ubuntu1                        all          Python interface to Amazon's Web Services - Python 3.x
ii  python3-botocore                     1.34.46+repack-1ubuntu1                      all          Low-level, data-driven core of boto 3 (Python 3)
ii  python3-bpfcc                        0.29.1+ds-1ubuntu7                           all          Python 3 wrappers for BPF Compiler Collection (BCC)
ii  python3-certifi                      2023.11.17-1                                 all          root certificates for validating SSL certs and verifying TLS hosts (python3)
ii  python3-cffi-backend:amd64           1.16.0-2build1                               amd64        Foreign Function Interface for Python 3 calling C code - runtime
ii  python3-chardet                      5.2.0+dfsg-1                                 all          Universal Character Encoding Detector (Python3)
ii  python3-click                        8.1.6-2                                      all          Wrapper around optparse for command line utilities - Python 3.x
ii  python3-colorama                     0.4.6-4                                      all          Cross-platform colored terminal text in Python - Python 3.x
ii  python3-commandnotfound              23.04.0                                      all          Python 3 bindings for command-not-found.
ii  python3-configobj                    5.0.8-3                                      all          simple but powerful config file reader and writer for Python 3
ii  python3-constantly                   23.10.4-1                                    all          Symbolic constants in Python
ii  python3-cryptography                 41.0.7-4ubuntu0.1                            amd64        Python library exposing cryptographic recipes and primitives (Python 3)
ii  python3-dateutil                     2.8.2-3ubuntu1                               all          powerful extensions to the standard Python 3 datetime module
ii  python3-dbus                         1.3.2-5build3                                amd64        simple interprocess messaging system (Python 3 interface)
ii  python3-debconf                      1.5.86ubuntu1                                all          interact with debconf from Python 3
ii  python3-debian                       0.1.49ubuntu2                                all          Python 3 modules to work with Debian-related data formats
ii  python3-dev                          3.12.3-0ubuntu2                              amd64        header files and a static library for Python (default)
ii  python3-distlib                      0.3.8-1                                      all          low-level components of python distutils2/packaging
ii  python3-distro                       1.9.0-1                                      all          Linux OS platform information API
ii  python3-distro-info                  1.7build1                                    all          information about distributions' releases (Python 3 module)
ii  python3-distupgrade                  1:24.04.19                                   all          manage release upgrades
ii  python3-filelock                     3.13.1-1                                     all          platform independent file locking module
ii  python3-gdbm:amd64                   3.12.3-0ubuntu1                              amd64        GNU dbm database support for Python 3.x
ii  python3-gi                           3.48.2-1                                     amd64        Python 3 bindings for gobject-introspection libraries
ii  python3-hamcrest                     2.1.0-1                                      all          Hamcrest framework for matcher objects (Python 3)
ii  python3-httplib2                     0.20.4-3                                     all          comprehensive HTTP client library written for Python3
ii  python3-hyperlink                    21.0.0-5                                     all          Immutable, Pythonic, correct URLs.
ii  python3-idna                         3.6-2ubuntu0.1                               all          Python IDNA2008 (RFC 5891) handling (Python 3)
ii  python3-incremental                  22.10.0-1                                    all          Library for versioning Python projects
ii  python3-jinja2                       3.1.2-1ubuntu1.1                             all          small but fast and easy to use stand-alone template engine
ii  python3-jmespath                     1.0.1-1                                      all          JSON Matching Expressions (Python 3)
ii  python3-json-pointer                 2.0-0ubuntu1                                 all          resolve JSON pointers - Python 3.x
ii  python3-jsonpatch                    1.32-3                                       all          library to apply JSON patches - Python 3.x
ii  python3-jsonschema                   4.10.3-2ubuntu1                              all          An(other) implementation of JSON Schema (Draft 3, 4, 6, 7)
ii  python3-jwt                          2.7.0-1                                      all          Python 3 implementation of JSON Web Token
ii  python3-launchpadlib                 1.11.0-6                                     all          Launchpad web services client library (Python 3)
ii  python3-lazr.restfulclient           0.14.6-1                                     all          client for lazr.restful-based web services (Python 3)
ii  python3-lazr.uri                     1.0.6-3                                      all          library for parsing, manipulating, and generating URIs
ii  python3-magic                        2:0.4.27-3                                   all          python3 interface to the libmagic file type identification library
ii  python3-markdown-it                  3.0.0-2                                      all          Python port of markdown-it and some its associated plugins
ii  python3-markupsafe                   2.1.5-1build2                                amd64        HTML/XHTML/XML string library
ii  python3-mdurl                        0.1.2-1                                      all          Python port of the JavaScript mdurl package
ii  python3-minimal                      3.12.3-0ubuntu2                              amd64        minimal subset of the Python language (default python3 version)
ii  python3-netaddr                      0.8.0-2ubuntu1                               all          manipulation of various common network address notations (Python 3)
ii  python3-netifaces:amd64              0.11.0-2build3                               amd64        portable network interface information - Python 3.x
ii  python3-netplan                      1.0.1-1ubuntu2~24.04.1                       amd64        Declarative network configuration Python bindings
ii  python3-newt:amd64                   0.52.24-2ubuntu2                             amd64        NEWT module for Python3
ii  python3-oauthlib                     3.2.2-1                                      all          generic, spec-compliant implementation of OAuth for Python3
ii  python3-openssl                      23.2.0-1                                     all          Python 3 wrapper around the OpenSSL library
ii  python3-packaging                    24.0-1                                       all          core utilities for python3 packages
ii  python3-pexpect                      4.9-2                                        all          Python 3 module for automating interactive applications
ii  python3-pip                          24.0+dfsg-1ubuntu1.1                         all          Python package installer
ii  python3-pip-whl                      24.0+dfsg-1ubuntu1.1                         all          Python package installer (pip wheel)
ii  python3-pkg-resources                68.1.2-2ubuntu1.1                            all          Package Discovery and Resource Access using pkg_resources
ii  python3-platformdirs                 4.2.0-1                                      all          determining appropriate platform-specific directories (Python 3)
ii  python3-problem-report               2.28.1-0ubuntu3.1                            all          Python 3 library to handle problem reports
ii  python3-ptyprocess                   0.7.0-5                                      all          Run a subprocess in a pseudo terminal from Python 3
ii  python3-pyasn1                       0.4.8-4                                      all          ASN.1 library for Python (Python 3 module)
ii  python3-pyasn1-modules               0.2.8-1                                      all          Collection of protocols modules written in ASN.1 language (Python 3)
ii  python3-pygments                     2.17.2+dfsg-1                                all          syntax highlighting package written in Python 3
ii  python3-pyparsing                    3.1.1-1                                      all          alternative to creating and executing simple grammars - Python 3.x
ii  python3-pyrsistent:amd64             0.20.0-1build2                               amd64        persistent/functional/immutable data structures for Python
ii  python3-requests                     2.31.0+dfsg-1ubuntu1                         all          elegant and simple HTTP library for Python3, built for human beings
ii  python3-rich                         13.7.1-1                                     all          render rich text, tables, progress bars, syntax highlighting, markdown and more
ii  python3-s3transfer                   0.10.1-1ubuntu2                              all          Amazon S3 Transfer Manager for Python3
ii  python3-serial                       3.5-2                                        all          pyserial - module encapsulating access for the serial port
ii  python3-service-identity             24.1.0-1                                     all          Service identity verification for pyOpenSSL (Python 3 module)
ii  python3-setuptools                   68.1.2-2ubuntu1.1                            all          Python3 Distutils Enhancements
ii  python3-setuptools-whl               68.1.2-2ubuntu1.1                            all          Python Distutils Enhancements (wheel package)
ii  python3-six                          1.16.0-4                                     all          Python 2 and 3 compatibility library
ii  python3-software-properties          0.99.48                                      all          manage the repositories that you install software from
ii  python3-systemd                      235-1build4                                  amd64        Python 3 bindings for systemd
ii  python3-tk:amd64                     3.12.3-0ubuntu1                              amd64        Tkinter - Writing Tk applications with Python 3.x
ii  python3-twisted                      24.3.0-1ubuntu0.1                            all          Event-based framework for internet applications
ii  python3-typing-extensions            4.10.0-1                                     all          Backported and Experimental Type Hints for Python
ii  python3-tz                           2024.1-2                                     all          Python3 version of the Olson timezone database
ii  python3-update-manager               1:24.04.9                                    all          Python 3.x module for update-manager
ii  python3-urllib3                      2.0.7-1ubuntu0.1                             all          HTTP library with thread-safe connection pooling for Python3
ii  python3-venv                         3.12.3-0ubuntu2                              amd64        venv module for python3 (default python3 version)
ii  python3-virtualenv                   20.25.0+ds-2                                 all          Python virtual environment creator
ii  python3-wadllib                      1.3.6-5                                      all          Python 3 library for navigating WADL files
ii  python3-wheel                        0.42.0-2                                     all          built-package format for Python
ii  python3-wheel-whl                    0.42.0-2                                     all          built-package format for Python (wheel wheel)
ii  python3-yaml                         6.0.1-2build2                                amd64        YAML parser and emitter for Python3
ii  python3-zope.interface               6.1-1build1                                  amd64        Interfaces for Python3
ii  python3.11                           3.11.10-1+noble1                             amd64        Interactive high-level object-oriented language (version 3.11)
ii  python3.11-dev                       3.11.10-1+noble1                             amd64        Header files and a static library for Python (v3.11)
ii  python3.11-distutils                 3.11.10-1+noble1                             all          distutils package for Python (version 3.11)
ii  python3.11-lib2to3                   3.11.10-1+noble1                             all          lib2to3 package for Python (version 3.11)
ii  python3.11-minimal                   3.11.10-1+noble1                             amd64        Minimal subset of the Python language (version 3.11)
ii  python3.11-venv                      3.11.10-1+noble1                             amd64        Interactive high-level object-oriented language (pyvenv binary, version 3.11)
ii  python3.12                           3.12.3-1ubuntu0.2                            amd64        Interactive high-level object-oriented language (version 3.12)
ii  python3.12-dev                       3.12.3-1ubuntu0.2                            amd64        Header files and a static library for Python (v3.12)
ii  python3.12-minimal                   3.12.3-1ubuntu0.2                            amd64        Minimal subset of the Python language (version 3.12)
ii  python3.12-venv                      3.12.3-1ubuntu0.2                            amd64        Interactive high-level object-oriented language (pyvenv binary, version 3.12)

Detected indi-allsky virtualenv
virtualenv python: Python 3.12.3
virtualenv PATH: /home/ubuntu/indi-allsky/virtualenv/indi-allsky/bin:/usr/local/bin:/usr/bin:/bin
flask command: /home/ubuntu/indi-allsky/virtualenv/indi-allsky/bin/flask

virtualenv python modules
alembic==1.14.0
argon2-cffi==23.1.0
argon2-cffi-bindings==21.2.0
asciitree==0.3.3
astroalign==2.6.0
astropy==6.1.5
astropy-iers-data==0.2024.11.4.0.33.34
astropy_healpix==1.0.3
astroscrappy==1.2.0
bcrypt==4.2.0
blinker==1.8.2
Bottleneck==1.4.2
ccdproc==2.4.2
certifi==2024.8.30
cffi==1.17.1
charset-normalizer==3.4.0
click==8.1.7
cloudpickle==3.1.0
cryptography==43.0.3
dask==2024.10.0
dbus-python==1.3.2
ephem==4.1.6
fasteners==0.19
Flask==3.0.3
Flask-Login==0.6.3
Flask-Migrate==4.0.7
Flask-SQLAlchemy==3.1.1
Flask-WTF==1.2.2
fsspec==2024.10.0
greenlet==3.1.1
gunicorn==23.0.0
idna==3.10
imageio==2.36.0
inotify==0.2.10
is-safe-url==1.0
itsdangerous==2.2.0
Jinja2==3.1.4
jplephem==2.22
lazy_loader==0.4
locket==1.0.0
lxml==5.3.0
Mako==1.3.6
MarkupSafe==3.0.2
networkx==3.4.2
nose==1.3.7
numcodecs==0.13.1
numpy==1.26.4
opencv-python-headless==4.10.0.84
packaging==24.2
partd==1.4.2
passlib==1.7.4
pillow==11.0.0
prettytable==3.12.0
psutil==6.1.0
pycparser==2.22
pycurl==7.45.3
pyerfa==2.0.1.4
pytz==2024.2
PyYAML==6.0.2
reproject==0.14.0
requests==2.32.3
scikit-image==0.24.0
scipy==1.14.1
semantic-version==2.10.0
sep-pjw==1.3.7
setuptools==75.3.0
setuptools-rust==1.10.2
sgp4==2.23
shapely==2.0.6
skyfield==1.49
SQLAlchemy==2.0.36
tifffile==2024.9.20
toolz==1.0.0
typing_extensions==4.12.2
urllib3==2.2.3
wcwidth==0.2.13
Werkzeug==3.1.3
wheel==0.45.0
WTForms==3.2.1
zarr==2.18.3

indi-allsky config (passwords redacted) 2024-11-20 15:52:01,128 [INFO] MainProcess config._dump() [1094]: Dumping config

{
  "ENCRYPT_PASSWORDS_comment": "Do not manually adjust",
  "ENCRYPT_PASSWORDS": false,
  "CAMERA_INTERFACE": "indi",
  "INDI_SERVER": "localhost",
  "INDI_PORT": 7624,
  "INDI_CAMERA_NAME": "",
  "OWNER": "REDACTED",
  "LENS_NAME": "AllSky Lens",
  "LENS_FOCAL_LENGTH": 2.5,
  "LENS_FOCAL_RATIO": 2.0,
  "LENS_IMAGE_CIRCLE": 4000,
  "LENS_OFFSET_X": 0,
  "LENS_OFFSET_Y": 0,
  "LENS_ALTITUDE": 90.0,
  "LENS_AZIMUTH": 0.0,
  "CCD_CONFIG": {
    "NIGHT": {
      "GAIN": 100,
      "BINNING": 1
    },
    "MOONMODE": {
      "GAIN": 75,
      "BINNING": 1
    },
    "DAY": {
      "GAIN": 0,
      "BINNING": 1
    }
  },
  "INDI_CONFIG_DEFAULTS": {
    "SWITCHES": {},
    "PROPERTIES": {},
    "TEXT": {}
  },
  "INDI_CONFIG_DAY": {},
  "CCD_EXPOSURE_MAX": 15.0,
  "CCD_EXPOSURE_DEF": 0.0,
  "CCD_EXPOSURE_MIN": 0.0,
  "CCD_EXPOSURE_MIN_DAY": 0.0,
  "CCD_BIT_DEPTH": 0,
  "EXPOSURE_PERIOD": 15.0,
  "EXPOSURE_PERIOD_DAY": 15.0,
  "FOCUS_MODE": false,
  "FOCUS_DELAY": 4.0,
  "CFA_PATTERN": "",
  "SCNR_ALGORITHM": "",
  "WBR_FACTOR": 1.0,
  "WBG_FACTOR": 1.0,
  "WBB_FACTOR": 1.0,
  "AUTO_WB": false,
  "SATURATION_FACTOR": 1.0,
  "CCD_COOLING": false,
  "CCD_TEMP": 15.0,
  "TEMP_DISPLAY": "c",
  "PRESSURE_DISPLAY": "hPa",
  "CCD_TEMP_SCRIPT": "",
  "GPS_ENABLE": false,
  "TARGET_ADU": 75,
  "TARGET_ADU_DAY": 75,
  "TARGET_ADU_DEV": 10,
  "TARGET_ADU_DEV_DAY": 20,
  "ADU_ROI": [],
  "ADU_FOV_DIV": 4,
  "DETECT_STARS": true,
  "DETECT_STARS_THOLD": 0.6,
  "DETECT_METEORS": false,
  "DETECT_MASK": "",
  "DETECT_DRAW": false,
  "LOGO_OVERLAY": "",
  "SQM_ROI": [],
  "SQM_FOV_DIV": 4,
  "LOCATION_NAME": "",
  "LOCATION_LATITUDE": 33,
  "LOCATION_LONGITUDE": -84,
  "LOCATION_ELEVATION": 300,
  "CAPTURE_PAUSE": false,
  "TIMELAPSE_ENABLE": true,
  "TIMELAPSE_SKIP_FRAMES": 4,
  "TIMELAPSE": {
    "PRE_PROCESSOR": "wrap_keogram",
    "IMAGE_CIRCLE": 2000,
    "KEOGRAM_RATIO": 0.15
  },
  "DAYTIME_CAPTURE": true,
  "DAYTIME_CAPTURE_SAVE": true,
  "DAYTIME_TIMELAPSE": true,
  "DAYTIME_CONTRAST_ENHANCE": false,
  "NIGHT_CONTRAST_ENHANCE": false,
  "CONTRAST_ENHANCE_16BIT": false,
  "CLAHE_CLIPLIMIT": 3.0,
  "CLAHE_GRIDSIZE": 8,
  "NIGHT_SUN_ALT_DEG": -6.0,
  "NIGHT_MOONMODE_ALT_DEG": 0.0,
  "NIGHT_MOONMODE_PHASE": 33.0,
  "WEB_NONLOCAL_IMAGES": false,
  "WEB_LOCAL_IMAGES_ADMIN": false,
  "WEB_EXTRA_TEXT": "",
  "WEB_STATUS_TEMPLATE": "Status: {status:s}\nLat: {latitude:0.1f}/Long: {longitude:0.1f}\nSidereal: {sidereal_time:s}\nMode: {mode:s}\nSun: {sun_alt:0.1f}&deg; {sun_dir:s}\nMoon: {moon_alt:0.1f}&deg; {moon_dir:s}\nPhase: {moon_phase_str:s} <span data-bs-toggle=\"tooltip\" data-bs-placement=\"right\" title=\"{moon_phase:0.0f}%\">{moon_glyph:s}</span>\nSmoke: {smoke_rating:s} {smoke_rating_status}\nKp-index: {kpindex:0.2f} {kpindex_rating:s} {kpindex_trend:s} {kpindex_status:s}\nAurora: {ovation_max:d}% {ovation_max_status}",
  "HEALTHCHECK": {
    "DISK_USAGE": 90.0,
    "SWAP_USAGE": 90.0
  },
  "IMAGE_STRETCH": {
    "CLASSNAME": "",
    "MODE1_GAMMA": 3.0,
    "MODE1_STDDEVS": 2.25,
    "MODE2_SHADOWS": 0.0,
    "MODE2_MIDTONES": 0.35,
    "MODE2_HIGHLIGHTS": 1.0,
    "SPLIT": false,
    "MOONMODE": false,
    "DAYTIME": false
  },
  "KEOGRAM_ANGLE": 0.0,
  "KEOGRAM_H_SCALE": 100,
  "KEOGRAM_V_SCALE": 33,
  "KEOGRAM_CROP_TOP": 0,
  "KEOGRAM_CROP_BOTTOM": 0,
  "KEOGRAM_LABEL": true,
  "STARTRAILS_MAX_ADU": 65,
  "STARTRAILS_MASK_THOLD": 190,
  "STARTRAILS_PIXEL_THOLD": 1.0,
  "STARTRAILS_MIN_STARS": 0,
  "STARTRAILS_TIMELAPSE": true,
  "STARTRAILS_TIMELAPSE_MINFRAMES": 250,
  "STARTRAILS_SUN_ALT_THOLD": -15.0,
  "STARTRAILS_MOONMODE_THOLD": true,
  "STARTRAILS_MOON_ALT_THOLD": 91.0,
  "STARTRAILS_MOON_PHASE_THOLD": 101.0,
  "STARTRAILS_USE_DB_DATA": true,
  "IMAGE_CALIBRATE_DARK": true,
  "IMAGE_CALIBRATE_BPM": false,
  "IMAGE_EXIF_PRIVACY": false,
  "IMAGE_FILE_TYPE": "jpg",
  "IMAGE_FILE_COMPRESSION": {
    "jpg": 90,
    "png": 5,
    "tif": 5,
    "jpeg": 90
  },
  "IMAGE_FOLDER": "/var/www/html/allsky/images",
  "IMAGE_LABEL_TEMPLATE": "# size:30 [Use 60 for higher resolution cameras]\n# xy:-15,15 (Upper Right)\n# anchor:ra (Right Justified)\n# color:150,0,0\n{timestamp:%Y.%m.%d %H:%M:%S}\n# color:100,100,0\nLat {latitude:0.0f} Long {longitude:0.0f}\n# color:150,150,150\nTiangong {tiangong_up:s} [{tiangong_next_h:0.1f}h/{tiangong_next_alt:0.0f}°]\nHubble {hst_up:s} [{hst_next_h:0.1f}h/{hst_next_alt:0.0f}°]\nISS {iss_up:s} [{iss_next_h:0.1f}h/{iss_next_alt:0.0f}°]\n# xy:-15,-240 (Lower Right) [Use -15,-450 for size 60]\n# color:175,175,0\nSun {sun_alt:0.0f}°\n# color:125,0,0\nMercury {mercury_alt:0.0f}°\n# color:100,150,150\nVenus {venus_alt:0.0f}°\n# color:150,0,0\nMars {mars_alt:0.0f}°\n# color:100,100,0\nJupiter {jupiter_alt:0.0f}°\n# color:100,100,150\nSaturn {saturn_alt:0.0f}°\n# color:150,150,150\nMoon {moon_phase:0.0f}% {moon_alt:0.0f}°\n# xy:15,-120 (Lower Left)  [Use 15,-210 for size 60]\n# anchor:la (Left Justified)\n# color:0,150,150\nStars {stars:d}\n# color:150,50,50\nKp-index {kpindex:0.2f}\n# color:150,150,150\nSmoke {smoke_rating:s}\n# xy:15,15 (Upper Left)\n# color:0,150,0\nExposure {exposure:0.6f}\n# color:150,50,0\nGain {gain:d}\n# color:50,50,150\nCamera {temp:0.1f}°{temp_unit:s}\n# color:150,0,150\nStretch {stretch:s}\nStacking {stack_method:s}\n# color:200,200,200 (default color)\n# additional labels will be added here",
  "URL_TEMPLATE": "https://{bucket}.s3.{region}.{host}",
  "IMAGE_EXTRA_TEXT": "",
  "IMAGE_CROP_ROI": [],
  "IMAGE_ROTATE": "",
  "IMAGE_ROTATE_ANGLE": 0,
  "IMAGE_FLIP_V": true,
  "IMAGE_FLIP_H": true,
  "IMAGE_SCALE": 100,
  "NIGHT_GRAYSCALE": false,
  "DAYTIME_GRAYSCALE": false,
  "MOON_OVERLAY": {
    "ENABLE": false,
    "X": 200,
    "Y": 200,
    "SCALE": 0.5
  },
  "IMAGE_CIRCLE_MASK": {
    "ENABLE": false,
    "DIAMETER": 1500,
    "OFFSET_X": 0,
    "OFFSET_Y": 0,
    "BLUR": 35,
    "OPACITY": 100,
    "OUTLINE": false
  },
  "FISH2PANO": {
    "ENABLE": false,
    "DIAMETER": 3000,
    "OFFSET_X": 0,
    "OFFSET_Y": 0,
    "ROTATE_ANGLE": -90,
    "SCALE": 0.5,
    "MODULUS": 2,
    "FLIP_H": false,
    "ENABLE_CARDINAL_DIRS": true,
    "DIRS_OFFSET_BOTTOM": 25,
    "OPENCV_FONT_SCALE": 0.8,
    "PIL_FONT_SIZE": 30
  },
  "IMAGE_SAVE_FITS": false,
  "IMAGE_SAVE_FITS_PRE_DARK": false,
  "IMAGE_EXPORT_RAW": "",
  "IMAGE_EXPORT_FOLDER": "/var/www/html/allsky/images/export",
  "IMAGE_EXPORT_FLIP_V": false,
  "IMAGE_EXPORT_FLIP_H": false,
  "IMAGE_STACK_METHOD": "maximum",
  "IMAGE_STACK_COUNT": 1,
  "IMAGE_STACK_ALIGN": false,
  "IMAGE_ALIGN_DETECTSIGMA": 5,
  "IMAGE_ALIGN_POINTS": 50,
  "IMAGE_ALIGN_SOURCEMINAREA": 10,
  "IMAGE_STACK_SPLIT": false,
  "THUMBNAILS": {
    "IMAGES_AUTO": true
  },
  "IMAGE_EXPIRE_DAYS": 30,
  "IMAGE_RAW_EXPIRE_DAYS": 10,
  "IMAGE_FITS_EXPIRE_DAYS": 10,
  "TIMELAPSE_EXPIRE_DAYS": 365,
  "TIMELAPSE_OVERWRITE": false,
  "IMAGE_QUEUE_MAX": 3,
  "IMAGE_QUEUE_MIN": 1,
  "IMAGE_QUEUE_BACKOFF": 0.5,
  "FFMPEG_FRAMERATE": 25,
  "FFMPEG_BITRATE": "5000k",
  "FFMPEG_VFSCALE": "",
  "FFMPEG_CODEC": "libx264",
  "FFMPEG_EXTRA_OPTIONS": "-level 3.1",
  "FITSHEADERS": [
    [
      "INSTRUME",
      "indi-allsky"
    ],
    [
      "OBSERVER",
      ""
    ],
    [
      "SITE",
      ""
    ],
    [
      "OBJECT",
      ""
    ],
    [
      "NOTES",
      ""
    ]
  ],
  "IMAGE_LABEL_SYSTEM": "pillow",
  "TEXT_PROPERTIES": {
    "DATE_FORMAT": "%Y%m%d %H:%M:%S",
    "FONT_FACE": "FONT_HERSHEY_SIMPLEX",
    "FONT_AA": "LINE_AA",
    "FONT_SCALE": 0.8,
    "FONT_THICKNESS": 1,
    "FONT_OUTLINE": true,
    "FONT_HEIGHT": 30,
    "FONT_X": 30,
    "FONT_Y": 30,
    "FONT_COLOR": [
      200,
      200,
      200
    ],
    "PIL_FONT_FILE": "fonts-freefont-ttf/FreeMonoBold.ttf",
    "PIL_FONT_CUSTOM": "",
    "PIL_FONT_SIZE": 30
  },
  "CARDINAL_DIRS": {
    "ENABLE": true,
    "FONT_COLOR": [
      255,
      0,
      0
    ],
    "SWAP_NS": false,
    "SWAP_EW": false,
    "CHAR_NORTH": "N",
    "CHAR_EAST": "E",
    "CHAR_WEST": "W",
    "CHAR_SOUTH": "S",
    "DIAMETER": 4000,
    "OFFSET_X": 0,
    "OFFSET_Y": 0,
    "OFFSET_TOP": 15,
    "OFFSET_LEFT": 15,
    "OFFSET_RIGHT": 15,
    "OFFSET_BOTTOM": 15,
    "OPENCV_FONT_SCALE": 0.5,
    "PIL_FONT_SIZE": 20,
    "OUTLINE_CIRCLE": false
  },
  "ORB_PROPERTIES": {
    "MODE": "ha",
    "RADIUS": 9,
    "SUN_COLOR": [
      200,
      200,
      0
    ],
    "MOON_COLOR": [
      128,
      128,
      128
    ],
    "AZ_OFFSET": 0.0,
    "RETROGRADE": false
  },
  "UPLOAD_WORKERS": 2,
  "FILETRANSFER": {
    "CLASSNAME": "pycurl_sftp",
    "HOST": "",
    "PORT": 0,
    "USERNAME": "",
    "PASSWORD": "REDACTED",
    "PASSWORD_E": "REDACTED",
    "PRIVATE_KEY": "",
    "PUBLIC_KEY": "",
    "CONNECT_TIMEOUT": 10.0,
    "TIMEOUT": 60.0,
    "CERT_BYPASS": true,
    "REMOTE_IMAGE_NAME": "image.{ext}",
    "REMOTE_PANORAMA_NAME": "panorama.{ext}",
    "REMOTE_IMAGE_FOLDER": "/home/allsky/upload/allsky",
    "REMOTE_PANORAMA_FOLDER": "/home/allsky/upload/allsky",
    "REMOTE_RAW_FOLDER": "/home/allsky/upload/allsky/export",
    "REMOTE_FITS_FOLDER": "/home/allsky/upload/allsky/fits",
    "REMOTE_METADATA_NAME": "latest_metadata.json",
    "REMOTE_METADATA_FOLDER": "/home/allsky/upload/allsky",
    "REMOTE_VIDEO_FOLDER": "/home/allsky/upload/allsky/videos",
    "REMOTE_MINI_VIDEO_FOLDER": "/home/allsky/upload/allsky/videos",
    "REMOTE_KEOGRAM_FOLDER": "/home/allsky/upload/allsky/keograms",
    "REMOTE_STARTRAIL_FOLDER": "/home/allsky/upload/allsky/startrails",
    "REMOTE_STARTRAIL_VIDEO_FOLDER": "/home/allsky/upload/allsky/videos",
    "REMOTE_PANORAMA_VIDEO_FOLDER": "/home/allsky/upload/allsky/videos",
    "REMOTE_ENDOFNIGHT_FOLDER": "/home/allsky/upload/allsky",
    "UPLOAD_IMAGE": 0,
    "UPLOAD_PANORAMA": 0,
    "UPLOAD_RAW": false,
    "UPLOAD_FITS": false,
    "UPLOAD_METADATA": false,
    "UPLOAD_VIDEO": false,
    "UPLOAD_MINI_VIDEO": false,
    "UPLOAD_KEOGRAM": false,
    "UPLOAD_STARTRAIL": false,
    "UPLOAD_STARTRAIL_VIDEO": false,
    "UPLOAD_PANORAMA_VIDEO": false,
    "UPLOAD_ENDOFNIGHT": false,
    "FORCE_IPV4": false,
    "FORCE_IPV6": false,
    "LIBCURL_OPTIONS": {}
  },
  "S3UPLOAD": {
    "ENABLE": false,
    "CLASSNAME": "boto3_s3",
    "ACCESS_KEY": "",
    "SECRET_KEY": "REDACTED",
    "SECRET_KEY_E": "REDACTED",
    "CREDS_FILE": "",
    "BUCKET": "change-me",
    "REGION": "us-east-2",
    "NAMESPACE": "",
    "HOST": "amazonaws.com",
    "PORT": 0,
    "CONNECT_TIMEOUT": 10.0,
    "TIMEOUT": 60.0,
    "URL_TEMPLATE": "https://{bucket}.s3.{region}.{host}",
    "ACL": "",
    "STORAGE_CLASS": "STANDARD",
    "TLS": true,
    "CERT_BYPASS": false,
    "UPLOAD_FITS": false,
    "UPLOAD_RAW": false
  },
  "MQTTPUBLISH": {
    "ENABLE": false,
    "TRANSPORT": "tcp",
    "HOST": "localhost",
    "PORT": 8883,
    "USERNAME": "indi-allsky",
    "PASSWORD": "REDACTED",
    "PASSWORD_E": "REDACTED",
    "BASE_TOPIC": "indi-allsky",
    "QOS": 0,
    "TLS": true,
    "CERT_BYPASS": true,
    "PUBLISH_IMAGE": true
  },
  "SYNCAPI": {
    "ENABLE": false,
    "BASEURL": "https://example.com/indi-allsky",
    "USERNAME": "",
    "APIKEY": "REDACTED",
    "APIKEY_E": "REDACTED",
    "CERT_BYPASS": false,
    "POST_S3": false,
    "EMPTY_FILE": false,
    "UPLOAD_IMAGE": 1,
    "UPLOAD_PANORAMA": 1,
    "CONNECT_TIMEOUT": 10.0,
    "TIMEOUT": 60.0
  },
  "YOUTUBE": {
    "ENABLE": false,
    "SECRETS_FILE": "",
    "PRIVACY_STATUS": "private",
    "TITLE_TEMPLATE": "Allsky {asset_label} - {day_date:%Y-%m-%d} - {timeofday}",
    "DESCRIPTION_TEMPLATE": "",
    "CATEGORY": 22,
    "TAGS": [
      "timelapse",
      "allsky",
      "astronomy"
    ],
    "UPLOAD_VIDEO": false,
    "UPLOAD_MINI_VIDEO": false,
    "UPLOAD_STARTRAIL_VIDEO": false,
    "UPLOAD_PANORAMA_VIDEO": false
  },
  "LIBCAMERA": {
    "IMAGE_FILE_TYPE": "dng",
    "IMAGE_FILE_TYPE_DAY": "dng",
    "AWB": "auto",
    "AWB_DAY": "auto",
    "AWB_ENABLE": false,
    "AWB_ENABLE_DAY": false,
    "CAMERA_ID": 0,
    "EXTRA_OPTIONS": "",
    "EXTRA_OPTIONS_DAY": ""
  },
  "PYCURL_CAMERA": {
    "URL": "",
    "IMAGE_FILE_TYPE": "jpg",
    "USERNAME": "",
    "PASSWORD": "REDACTED",
    "PASSWORD_E": "REDACTED"
  },
  "ACCUM_CAMERA": {
    "SUB_EXPOSURE_MAX": 1.0,
    "EVEN_EXPOSURES": true
  },
  "FOCUSER": {
    "CLASSNAME": "",
    "GPIO_PIN_1": "D17",
    "GPIO_PIN_2": "D18",
    "GPIO_PIN_3": "D27",
    "GPIO_PIN_4": "D22"
  },
  "DEW_HEATER": {
    "CLASSNAME": "",
    "ENABLE_DAY": false,
    "PIN_1": "D12",
    "INVERT_OUTPUT": false,
    "LEVEL_DEF": 100,
    "THOLD_ENABLE ": false,
    "MANUAL_TARGET": 0.0,
    "TEMP_USER_VAR_SLOT": 10,
    "LEVEL_LOW": 33,
    "LEVEL_MED": 66,
    "LEVEL_HIGH": 100,
    "THOLD_DIFF_LOW": 15,
    "THOLD_DIFF_MED": 10,
    "THOLD_DIFF_HIGH": 5,
    "THOLD_ENABLE": false
  },
  "FAN": {
    "CLASSNAME": "",
    "ENABLE_NIGHT": false,
    "PIN_1": "D13",
    "INVERT_OUTPUT": false,
    "LEVEL_DEF": 100,
    "THOLD_ENABLE ": false,
    "TARGET": 30.0,
    "TEMP_USER_VAR_SLOT": 10,
    "LEVEL_LOW": 33,
    "LEVEL_MED": 66,
    "LEVEL_HIGH": 100,
    "THOLD_DIFF_LOW": 0,
    "THOLD_DIFF_MED": 5,
    "THOLD_DIFF_HIGH": 10,
    "THOLD_ENABLE": false
  },
  "GENERIC_GPIO": {
    "A_CLASSNAME": "",
    "A_PIN_1": "D21",
    "A_INVERT_OUTPUT": false
  },
  "TEMP_SENSOR": {
    "A_CLASSNAME": "",
    "A_LABEL": "Sensor A",
    "A_PIN_1": "D5",
    "A_USER_VAR_SLOT": 10,
    "A_I2C_ADDRESS": "0x77",
    "B_CLASSNAME": "",
    "B_LABEL": "Sensor B",
    "B_PIN_1": "D6",
    "B_USER_VAR_SLOT": 15,
    "B_I2C_ADDRESS": "0x76",
    "C_CLASSNAME": "",
    "C_LABEL": "Sensor C",
    "C_PIN_1": "D16",
    "C_USER_VAR_SLOT": 20,
    "C_I2C_ADDRESS": "0x40",
    "OPENWEATHERMAP_APIKEY": "REDACTED",
    "OPENWEATHERMAP_APIKEY_E": "REDACTED",
    "WUNDERGROUND_APIKEY": "REDACTED",
    "WUNDERGROUND_APIKEY_E": "REDACTED",
    "MQTT_TRANSPORT": "tcp",
    "MQTT_HOST": "localhost",
    "MQTT_PORT": 8883,
    "MQTT_USERNAME": "indi-allsky",
    "MQTT_PASSWORD": "REDACTED",
    "MQTT_PASSWORD_E": "REDACTED",
    "MQTT_TLS": true,
    "MQTT_CERT_BYPASS": true,
    "TSL2561_GAIN_NIGHT": 1,
    "TSL2561_GAIN_DAY": 0,
    "TSL2561_INT_NIGHT": 1,
    "TSL2561_INT_DAY": 1,
    "TSL2591_GAIN_NIGHT": "GAIN_MED",
    "TSL2591_GAIN_DAY": "GAIN_LOW",
    "TSL2591_INT_NIGHT": "INTEGRATIONTIME_100MS",
    "TSL2591_INT_DAY": "INTEGRATIONTIME_100MS",
    "VEML7700_GAIN_NIGHT": "ALS_GAIN_1",
    "VEML7700_GAIN_DAY": "ALS_GAIN_1_8",
    "VEML7700_INT_NIGHT": "ALS_100MS",
    "VEML7700_INT_DAY": "ALS_100MS",
    "SI1145_VIS_GAIN_NIGHT": "GAIN_ADC_CLOCK_DIV_32",
    "SI1145_VIS_GAIN_DAY": "GAIN_ADC_CLOCK_DIV_1",
    "SI1145_IR_GAIN_NIGHT": "GAIN_ADC_CLOCK_DIV_32",
    "SI1145_IR_GAIN_DAY": "GAIN_ADC_CLOCK_DIV_1",
    "LTR390_GAIN_NIGHT": "GAIN_9X",
    "LTR390_GAIN_DAY": "GAIN_1X"
  },
  "CHARTS": {
    "CUSTOM_SLOT_1": 10,
    "CUSTOM_SLOT_2": 11,
    "CUSTOM_SLOT_3": 12,
    "CUSTOM_SLOT_4": 13
  },
  "ADSB": {
    "ENABLE": false,
    "DUMP1090_URL": "https://localhost/dump1090/data/aircraft.json",
    "CERT_BYPASS": true,
    "USERNAME": "",
    "PASSWORD": "REDACTED",
    "PASSWORD_E": "REDACTED",
    "ALT_DEG_MIN": 20.0,
    "LABEL_ENABLE": true,
    "LABEL_LIMIT": 10,
    "AIRCRAFT_LABEL_TEMPLATE": "{id:s} {distance:0.1f}km {alt:0.1f}° {dir:s}",
    "IMAGE_LABEL_TEMPLATE_PREFIX": "# xy:15,300 (Left)\n# anchor:la (Left Justified)\n# color:200,200,200\nAircraft"
  },
  "SATELLITE_TRACK": {
    "ENABLE": false,
    "DAYTIME_TRACK": false,
    "ALT_DEG_MIN": 20.0,
    "LABEL_ENABLE": true,
    "LABEL_LIMIT": 10,
    "SAT_LABEL_TEMPLATE": "{title:s} {alt:0.1f}° {dir:s}",
    "IMAGE_LABEL_TEMPLATE_PREFIX": "# xy:-15,200 (Right)\n# anchor:ra (Right Justified)\n# color:200,200,200\nSatellites"
  }
}

#################################

end support info

#################################

aaronwmorris commented 2 days ago

I will fix the support info script. I was mainly interested in your memory, but the support info gives a lot of other info as well.

It sounds like the Linux kernel out of memory [OOM] is killing the script. 512MB is a limited environment, but I would still expect it to run.

cfmorrell commented 2 days ago

I'm running it in an AWS t2.nano instance. I'll bump the memory and see what happens.

cfmorrell commented 21 hours ago

I upgraded to a t2.micro instance which provide 1G of memory. When I try to run the flush_images script, it pegs the CPU and becomes unresponsive until I reboot the VM. I've tried monitoring memory externally, but don't have external visibility and lose the ability to see inside once everything is pegged. CPU consumption stays at 100% until I intervene.

image

aaronwmorris commented 20 hours ago

I just reviewed the code and I need to do some optimizations to the CLI flush script. I had already applied the optimizations to the web based flush operations, but it looks like I forgot to update the flush script.

Try running the flush from the web interface, it should function a bit better.

cfmorrell commented 13 hours ago

It did work from the web interface. I'll let it run for a while and see if it manages to keep things cleaned up automagically.