search

JVital2013 / vitality-goes

Web App for showcasing Geostationary Weather Satellite Data
GNU General Public License v3.0
69 stars 6 forks source link

Question about GOES18 entires #45

Closed pumatrax closed 11 months ago

pumatrax commented 11 months ago

Hi,

After my latest update I noticed I have some FD entries for GOES18, but they have an error. I dont see a GOES18 folder on my media card so I dont think I am downloading anything for it.

How can I get this working. I was trying to figure out if I see settings for GOES18 but I not too familiar with the configs to know for sure whats happening.

Screen Shot 2023-07-28 at 12 00 37 PM

JVital2013 commented 11 months ago

Is your main config.ini the same as it was here?

If so, look below for what the GOES-18 Relay section should look like in abi.ini (assuming a semi-standard goesproc-goes.conf config. Does yours look similar? The path for each is the important bit.

If so, we'll move on to the next troubleshooting step.

[fdgoes18_16]
path = {GOES16}/goes18/fd/ch13/
title = "GOES 18 - Channel 13 (Clean Longwave IR Relay)"
videoPath = GOES18Ch13.mp4

[fdgoes18e_16]
path = {GOES16}/goes18/fd/ch13_enhanced/
title = "GOES 18 - Channel 13 (Relay; Enhanced)"
videoPath = GOES18Ch13Enhanced.mp4

[fdgoes18Sanchez_16]
path = {GOES16}/goes18/fd/sanchez/
title = "GOES 18 - Sanchez False Color (Relay)"
videoPath = GOES18Sanchez.mp4

[compositeWestEast]
path = {GOES16}/composite/
title = "GOES West/East Sanchez Composite"
videoPath = Composite.mp4
pumatrax commented 11 months ago

Hi,

Yes, I do have that in my abi.ini.

I am realizing I didnt update my goesproc-goesr.conf file and I am using an older one I am posting below. I tried the latest one which I do see handlers for goes18, but I get an error when trying to run goesproc.

pi@hampi:~ $ goesproc -c /usr/local/share/goestools/goesproc-goes.conf -m packet --subscribe tcp://127.0.0.1:5004 Invalid image handler origin: goes18 

######################
#  General Section   #
######################

# EMWIN
[[handler]]
type = "emwin"
directory = "/media/SDCARD/emwin"

# Images relayed from Himawari-8.
[[handler]]
type = "image"
origin = "himawari8"
directory = "/media/SDCARD/himawari8/{region:short|lower}"
filename = "Himawari8_{region:short}_{channel:short}_{time:%Y%m%dT%H%M%SZ}"
format = "jpg"
json = false

  [[handler.map]]
  path = "/usr/local/share/goestools/ne/ne_50m_admin_0_countries_lakes.json"

  [[handler.map]]
  path = "/usr/local/share/goestools/ne/ne_50m_admin_1_states_provinces_lakes.json"

# NWS text (weather reports).
[[handler]]
type = "text"
origin = "nws"
directory = "/media/SDCARD/nws"
filename = "{time:%Y%m%dT%H%M%SZ}_{awips:nnn}{awips:xxx}"
json = false

# NWS images.
[[handler]]
type = "image"
origin = "nws"
directory = "/media/SDCARD/nws"
filename = "{time:%Y%m%dT%H%M%SZ}_{filename}"
format = "png"
json = false

# Miscellaneous text.
[[handler]]
type = "text"
origin = "other"
directory = "/media/SDCARD/text"
filename = "{time:%Y%m%dT%H%M%SZ}_{filename}"
json = false

####################
#  GOES-15 Relay   #
####################

# Store relayed GOES-15 full disks
[[handler]]
type = "image"
origin = "goes15"
regions = [ "fd" ]
directory = "/media/SDCARD/goes15/{region:short|lower}"
filename = "GOES15_{region:short}_{channel:short}_{time:%Y%m%dT%H%M%SZ}"
crop = [ -2374, 2371, -1357, 1347 ]
format = "jpg"
json = false

  [[handler.map]]
  path = "/usr/local/share/goestools/ne/ne_50m_admin_0_countries_lakes.json"

  [[handler.map]]
  path = "/usr/local/share/goestools/ne/ne_50m_admin_1_states_provinces_lakes.json"

# Store relayed GOES-15 northern hemisphere region
[[handler]]
type = "image"
origin = "goes15"
regions = [ "nh" ]
directory = "/media/SDCARD/goes15/{region:short|lower}"
filename = "GOES15_{region:short}_{channel:short}_{time:%Y%m%dT%H%M%SZ}"
crop = [ -1864, 1447, -1357, -3 ]
format = "jpg"
json = false

  [[handler.map]]
  path = "/usr/local/share/goestools/ne/ne_50m_admin_0_countries_lakes.json"

  [[handler.map]]
  path = "/usr/local/share/goestools/ne/ne_50m_admin_1_states_provinces_lakes.json"

# Store relayed GOES-15 southern hemisphere region
[[handler]]
type = "image"
origin = "goes15"
regions = [ "sh" ]
directory = "/media/SDCARD/goes15/{region:short|lower}"
filename = "GOES15_{region:short}_{channel:short}_{time:%Y%m%dT%H%M%SZ}"
crop = [ -1864, 896, -19, 1043 ]
format = "jpg"
json = false

  [[handler.map]]
  path = "/usr/local/share/goestools/ne/ne_50m_admin_0_countries_lakes.json"

  [[handler.map]]
  path = "/usr/local/share/goestools/ne/ne_50m_admin_1_states_provinces_lakes.json"

# Store relayed GOES-15 US region
[[handler]]
type = "image"
origin = "goes15"
regions = [ "us" ]
directory = "/media/SDCARD/goes15/{region:short|lower}"
filename = "GOES15_{region:short}_{channel:short}_{time:%Y%m%dT%H%M%SZ}"
crop = [ -1312, 1542, -1327, -345 ]
format = "jpg"
json = false

  [[handler.map]]
  path = "/usr/local/share/goestools/ne/ne_50m_admin_0_countries_lakes.json"

  [[handler.map]]
  path = "/usr/local/share/goestools/ne/ne_50m_admin_1_states_provinces_lakes.json"

# Store relayed GOES-15 special regions
# No crop specified because it is expected to move around
[[handler]]
type = "image"
origin = "goes15"
regions = [ "si00", "si01", "si02", "si03", "si04" ]
directory = "/media/SDCARD/goes15/{region:short|lower}"
filename = "GOES15_{region:short}_{channel:short}_{time:%Y%m%dT%H%M%SZ}"
format = "jpg"
json = false

  [[handler.map]]
  path = "/usr/local/share/goestools/ne/ne_50m_admin_0_countries_lakes.json"

  [[handler.map]]
  path = "/usr/local/share/goestools/ne/ne_50m_admin_1_states_provinces_lakes.json"

# The following handler takes the same crop from the FD, NH, and US
# products to get more frequent imagery of a smaller area on the
# northern hemisphere. The crop region is a combination of the NH and
# US crop regions.
[[handler]]
type = "image"
origin = "goes15"
regions = [ "fd", "nh", "us" ]
crop = [ -1312, 1447, -1327, -345 ]
directory = "/media/SDCARD/goes15/combine-north"
filename = "GOES15_{channel:short}_{time:%Y%m%dT%H%M%SZ}_{region:short}"
format = "jpg"
json = false

  [[handler.map]]
  path = "/usr/local/share/goestools/ne/ne_50m_admin_0_countries_lakes.json"

  [[handler.map]]
  path = "/usr/local/share/goestools/ne/ne_50m_admin_1_states_provinces_lakes.json"

# The following handler takes the same crop from the FD and SH
# products to get more frequent imagery of a smaller area on the
# southern hemisphere.
[[handler]]
type = "image"
origin = "goes15"
regions = [ "fd", "sh" ]
crop = [ -1864, 896, -19, 1043 ]
directory = "/media/SDCARD/goes15/combine-south"
filename = "GOES15_{channel:short}_{time:%Y%m%dT%H%M%SZ}_{region:short}"
format = "jpg"
json = false

  [[handler.map]]
  path = "/usr/local/share/goestools/ne/ne_50m_admin_0_countries_lakes.json"

  [[handler.map]]
  path = "/usr/local/share/goestools/ne/ne_50m_admin_1_states_provinces_lakes.json"

##############
#  GOES-16   #
##############

# Store all original GOES-16 products.
[[handler]]
type = "image"
origin = "goes16"
directory = "/media/SDCARD/goes16/{region:short|lower}/{channel:short|lower}"
filename = "GOES16_{region:short}_{channel:short}_{time:%Y%m%dT%H%M%SZ}"
format = "jpg"
json = false

  [[handler.map]]
  path = "/usr/local/share/goestools/ne/ne_50m_admin_0_countries_lakes.json"

  [[handler.map]]
  path = "/usr/local/share/goestools/ne/ne_50m_admin_1_states_provinces_lakes.json"

# GOES-16 ABI false color.
[[handler]]
type = "image"
origin = "goes16"
regions = [ "fd", "m1", "m2" ]
channels = [ "ch02", "ch13" ]
directory = "/media/SDCARD/goes16/{region:short|lower}/fc"
filename = "GOES16_{region:short}_FC_{time:%Y%m%dT%H%M%SZ}"
format = "jpg"
json = false

  [handler.remap.ch02]
  path = "/usr/local/share/goestools/wxstar/wxstar_goes16_ch02_curve.png"

  [handler.lut]
  path = "/usr/local/share/goestools/wxstar/wxstar_goes16_lut.png"

  [[handler.map]]
  path = "/usr/local/share/goestools/ne/ne_50m_admin_0_countries_lakes.json"

  [[handler.map]]
  path = "/usr/local/share/goestools/ne/ne_50m_admin_1_states_provinces_lakes.json"

# GOES-16 ABI RGB-enhanced
[[handler]]
type = "image"
origin = "goes16"
regions = [ "fd", "m1", "m2" ]
channels = [ "ch07", "ch08", "ch09", "ch13", "ch14", "ch15" ]
directory = "/media/SDCARD/goes16/{region:short|lower}/{channel:short|lower}_enhanced"
filename = "GOES16_{region:short}_{channel:short}_enhanced_{time:%Y%m%dT%H%M%SZ}"
format = "jpg"
json = false

  ## The following gradients are rough approximations of the 
  ## McIDAS RGB enhancements used by NOAA/NESDIS/STAR on their site..
  ##
  ## For more info:
  ##
  ##   https://www.star.nesdis.noaa.gov/GOES/GOES16_FullDisk.php 
  ##   http://cimss.ssec.wisc.edu/goes/visit/water_vapor_enhancement.html
  ##   http://cimss.ssec.wisc.edu/goes/visit/enhanced_v_enhancements.html

  ## Shortwave IR (Channel 7)
  [handler.gradient.ch07]
  points = [
    { units = 400, color = "#000000" },
    { units = 250, color = "#b9b9b9" },
    { units = 249.999, color = "#00ffff" },
    { units = 240, color = "#000080" },
    { units = 230, color = "#00ff00" },
    { units = 220, color = "#ffff00" },
    { units = 210, color = "#ff0000" },
    { units = 200, color = "#000000" },
    { units = 190, color = "#ffffff" }
  ]

  ## Water Vapor (Channels 8 and 9)
  [handler.gradient.ch08]
  points = [
    { units = 276, color = "#000000" },
    { units = 275.9, color = "#ff0000" },
    { units = 258, color = "#ffff00" },
    { units = 250, color = "#000070" },
    { units = 233, color = "#ffffff" },
    { units = 195, color = "#408020" },
    { units = 178, color = "#00ffff" }
  ]
  [handler.gradient.ch09]
  points = [
    { units = 276, color = "#000000" },
    { units = 275.9, color = "#ff0000" },
    { units = 258, color = "#ffff00" },
    { units = 250, color = "#000070" },
    { units = 233, color = "#ffffff" },
    { units = 195, color = "#408020" },
    { units = 178, color = "#00ffff" }
  ]

  ## Longwave IR (Channels 13, 14, and 15)
  [handler.gradient.ch13]
  points = [
    { units = 333, color = "#000000" },
    { units = 238, color = "#b9b9b9" },
    { units = 237.999, color = "#00ffff" },
    { units = 228, color = "#000080" },
    { units = 218, color = "#00ff00" },
    { units = 208, color = "#ffff00" },
    { units = 198, color = "#ff0000" },
    { units = 188, color = "#000000" },
    { units = 178, color = "#ffffff" }
  ]
  [handler.gradient.ch14]
  points = [
    { units = 333, color = "#000000" },
    { units = 238, color = "#b9b9b9" },
    { units = 237.999, color = "#00ffff" },
    { units = 228, color = "#000080" },
    { units = 218, color = "#00ff00" },
    { units = 208, color = "#ffff00" },
    { units = 198, color = "#ff0000" },
    { units = 188, color = "#000000" },
    { units = 178, color = "#ffffff" }
  ]
  [handler.gradient.ch15]
  points = [
    { units = 333, color = "#000000" },
    { units = 238, color = "#b9b9b9" },
    { units = 237.999, color = "#00ffff" },
    { units = 228, color = "#000080" },
    { units = 218, color = "#00ff00" },
    { units = 208, color = "#ffff00" },
    { units = 198, color = "#ff0000" },
    { units = 188, color = "#000000" },
    { units = 178, color = "#ffffff" }
  ]

  [[handler.map]]
  path = "/usr/local/share/goestools/ne/ne_50m_admin_0_countries_lakes.json"

  [[handler.map]]
  path = "/usr/local/share/goestools/ne/ne_50m_admin_1_states_provinces_lakes.json"

#GOES-16 Level 2 Images
[[handler]]
type = "image"
origin = "goes16"
products = [ "sst", "lst", "dsi", "tpw" ]
directory = "/media/SDCARD/goes16/non-cmip/{region:short|lower}/{product:short|lower}"
filename = "GOES16_{region:short}_{product:short}_{time:%Y%m%dT%H%M%SZ}"
format = "jpg"
json = false

  [[handler.map]]
  path = "/usr/local/share/goestools/ne/ne_50m_admin_0_countries_lakes.json"
  color = "#000000"

  [[handler.map]]
  path = "/usr/local/share/goestools/ne/ne_50m_admin_1_states_provinces_lakes.json"
  color = "#000000"

  ## The following gradients are rough approximations of the 
  ## McIDAS RGB enhancements used by NOAA/NESDIS/STAR on their site..
  ##
  ## For more info:
  ##
  ## https://www.ospo.noaa.gov/data/sst/contour/global.cf.gif (SST)
  ## https://www.goes-r.gov/products/baseline-LST.html (LST)
  ## http://cimss.ssec.wisc.edu/goes/OCLOFactSheetPDFs/ABIQuickGuide_BaselineDerivedStabilityIndices.pdf (DSI)
  ## https://www.goes-r.gov/products/baseline-total-precipitable-water.html (TPW)

  # Skin Sea Surface Temperature (Degrees K)
  [handler.gradient.SST]
  points = [
    { units = 180, color = "#ffffff" },
    { units = 270.65, color = "#ffffff" },
    { units = 273.25, color = "#b005c6" },
    { units = 275.5, color = "#8f06e4" },
    { units = 277.75, color = "#6c1ff7" },
    { units = 280, color = "#486afa" },
    { units = 282.25, color = "#24b4fc" },
    { units = 284.5, color = "#00ffff" },
    { units = 287.25, color = "#00e696" },
    { units = 289, color = "#00d54b" },
    { units = 291.3, color = "#0cc600" },
    { units = 293.6, color = "#59d800" },
    { units = 295.85, color = "#a5ea00" },
    { units = 298.1, color = "#f2fc00" },
    { units = 300.35, color = "#ffc900" },
    { units = 302.6, color = "#ff9400" },
    { units = 304.85, color = "#ff5500" },
    { units = 307.1, color = "#ff1500" },
    { units = 340, color = "#ffffff" }
  ]

  # Skin Land Surface Temperature (Degrees K)
  [handler.gradient.LST]
  points = [
    { units = 215, color = "#102469" },
    { units = 220, color = "#0002b5" },
    { units = 240, color = "#0359fa" },
    { units = 260, color = "#03eee9" },
    { units = 280, color = "#87f36c" },
    { units = 300, color = "#fee502" },
    { units = 320, color = "#f34900" },
    { units = 342, color = "#7f1100" },
    { units = 353, color = "#ffffff" }
  ]

  # CAPE Derived Stability Index (Joules/kg)
  [handler.gradient.DSI]
  points = [
    { units = 0, color = "#543e20" },
    { units = 500, color = "#a58154" },
    { units = 750, color = "#cfa370" },
    { units = 1000, color = "#c3afc2" },
    { units = 1500, color = "#8181c5" },
    { units = 1750, color = "#6363a3" },
    { units = 2000, color = "#969656" },
    { units = 2500, color = "#fffc02" },
    { units = 2750, color = "#ffd327" },
    { units = 3000, color = "#ff9063" },
    { units = 3500, color = "#ff231e" },
    { units = 4000, color = "#b10032" },
    { units = 4250, color = "#680063" },
    { units = 4500, color = "#8d0090" },
    { units = 4961.3914, color = "#ea00ef" },
    { units = 4980.9245, color = "#000000" }
  ]

  # Total Precipitable Water (mm)
  [handler.gradient.TPW]
  points = [
    { units = 0, color = "#3a290b" },
    { units = 11, color = "#d1a777" },
    { units = 12, color = "#8999ee" },
    { units = 22, color = "#584c96" },
    { units = 23, color = "#9a6a5c" },
    { units = 32, color = "#72a429" },
    { units = 33, color = "#97c03c" },
    { units = 43, color = "#f4fe00" },
    { units = 44, color = "#fd775e" },
    { units = 53, color = "#982a19" },
    { units = 54, color = "#6f0069" },
    { units = 65, color = "#fb00ee" },
    { units = 66, color = "#ffc8ff" },
    { units = 69, color = "#f0bbef" },
    { units = 99, color = "#f069ef" },
    { units = 99.6187, color = "#ffffff" },
  ]

# GOES-16 ABI Non-CMIP RGB-enhanced (White Borders)
[[handler]]
type = "image"
origin = "goes16"
products = [ "rrqpe", "acht", "acha" ]
directory = "/media/SDCARD/goes16/non-cmip/{region:short|lower}/{product:short|lower}"
filename = "GOES16_{region:short}_{product:short}_{time:%Y%m%dT%H%M%SZ}"
format = "jpg"
json = false

  [[handler.map]]
  path = "/usr/local/share/goestools/ne/ne_50m_admin_0_countries_lakes.json"

  [[handler.map]]
  path = "/usr/local/share/goestools/ne/ne_50m_admin_1_states_provinces_lakes.json"

  ## The following gradients are rough approximations of the 
  ## McIDAS RGB enhancements used by NOAA/NESDIS/STAR on their site..
  ##
  ## For more info:
  ##
  ## https://www.goes-r.gov/products/baseline-rainfall-rate-qpe.html (RRQPE)
  ## https://cimss.ssec.wisc.edu/goes/blog/archives/32657 (ACHT)
  ## https://catalog.data.gov/dataset/noaa-goes-r-series-advanced-baseline-imager-abi-level-2-cloud-top-height-acha

  # Rainfall Rate (mm/hr)
  [handler.gradient.RRQPE]
  points = [
    { units = 0, color = "#000000" },
    { units = 6.35, color = "#303030" },
    { units = 12.6, color = "#303030" },
    { units = 12.7, color = "#009cff" },
    { units = 25.3, color = "#050dc8" },
    { units = 25.4, color = "#36ef31" },
    { units = 38.1, color = "#1e8f01" },
    { units = 40.64, color = "#fff92e" },
    { units = 50.8, color = "#f23027" },
    { units = 53.34, color = "#ff00f8" },
    { units = 63.5, color = "#c168c6" },
    { units = 66.04, color = "#fcfcfc" },
    { units = 100, color = "#ffffff" }
  ]

  # Cloud top Height (Degrees K)
  [handler.gradient.ACHT]
   points = [
    { units = 180, color = "#000000" },
    { units = 193, color = "#ffe300" },
    { units = 213, color = "#81ff00" },
    { units = 233, color = "#00ff23" },
    { units = 253, color = "#00ffbb" },
    { units = 273, color = "#00abff" },
    { units = 293, color = "#0011ff" },
    { units = 313, color = "#7500eb" },
    { units = 321, color = "#000000" },
  ]

  # Cloud Top Height Algorithm (Meters)
    [handler.gradient.ACHA]
   points = [
    { units = 0, color = "#000000" },
    { units = 1500, color = "#5e10b1" },
    { units = 3000, color = "#360ae5" },
    { units = 6050, color = "#0d85e4" },
    { units = 9100, color = "#16f2b4" },
    { units = 12200, color = "#19f108" },
    { units = 15250, color = "#e4ff2b" },
    { units = 19845, color = "#ef630e" },
    { units = 19923, color = "#000000" },
  ]

##############
#  GOES-17   #
##############

# Store all original GOES-17 products.
[[handler]]
type = "image"
origin = "goes17"
directory = "/media/SDCARD/goes17/{region:short|lower}/{channel:short|lower}"
filename = "GOES17_{region:short}_{channel:short}_{time:%Y%m%dT%H%M%SZ}"
format = "jpg"
json = false

  [[handler.map]]
  path = "/usr/local/share/goestools/ne/ne_50m_admin_0_countries_lakes.json"

  [[handler.map]]
  path = "/usr/local/share/goestools/ne/ne_50m_admin_1_states_provinces_lakes.json"

# GOES-17 ABI false color.
[[handler]]
type = "image"
origin = "goes17"
regions = [ "fd", "m1", "m2" ]
channels = [ "ch02", "ch13" ]
directory = "/media/SDCARD/goes17/{region:short|lower}/fc"
filename = "GOES17_{region:short}_FC_{time:%Y%m%dT%H%M%SZ}"
format = "jpg"
json = false

  # This reuses the GOES-16 contrast curve assuming it is identical
  [handler.remap.ch02]
  path = "/usr/local/share/goestools/wxstar/wxstar_goes16_ch02_curve.png"

  # This reuses the GOES-16 LUT assuming it is identical
  [handler.lut]
  path = "/usr/local/share/goestools/wxstar/wxstar_goes16_lut.png"

  [[handler.map]]
  path = "/usr/local/share/goestools/ne/ne_50m_admin_0_countries_lakes.json"

  [[handler.map]]
  path = "/usr/local/share/goestools/ne/ne_50m_admin_1_states_provinces_lakes.json"

# GOES-17 ABI RGB-enhanced
[[handler]]
type = "image"
origin = "goes17"
regions = [ "fd", "m1", "m2" ]
channels = [ "ch07", "ch08", "ch09", "ch13", "ch14", "ch15" ]
directory = "/media/SDCARD/goes17/{region:short|lower}/{channel:short|lower}_enhanced"
filename = "GOES17_{region:short}_{channel:short}_enhanced_{time:%Y%m%dT%H%M%SZ}"
format = "jpg"
json = false

  ## The following gradients are rough approximations of the 
  ## McIDAS RGB enhancements used by NOAA/NESDIS/STAR on their site..
  ##
  ## For more info:
  ##
  ##   https://www.star.nesdis.noaa.gov/GOES/GOES16_FullDisk.php 
  ##   http://cimss.ssec.wisc.edu/goes/visit/water_vapor_enhancement.html
  ##   http://cimss.ssec.wisc.edu/goes/visit/enhanced_v_enhancements.html

  ## Shortwave IR (Channel 7)
  [handler.gradient.ch07]
  points = [
    { units = 400, color = "#000000" },
    { units = 250, color = "#b9b9b9" },
    { units = 249.999, color = "#00ffff" },
    { units = 240, color = "#000080" },
    { units = 230, color = "#00ff00" },
    { units = 220, color = "#ffff00" },
    { units = 210, color = "#ff0000" },
    { units = 200, color = "#000000" },
    { units = 190, color = "#ffffff" }
  ]

  ## Water Vapor (Channels 8 and 9)
  [handler.gradient.ch08]
  points = [
    { units = 276, color = "#000000" },
    { units = 275.9, color = "#ff0000" },
    { units = 258, color = "#ffff00" },
    { units = 250, color = "#000070" },
    { units = 233, color = "#ffffff" },
    { units = 195, color = "#408020" },
    { units = 178, color = "#00ffff" }
  ]
  [handler.gradient.ch09]
  points = [
    { units = 276, color = "#000000" },
    { units = 275.9, color = "#ff0000" },
    { units = 258, color = "#ffff00" },
    { units = 250, color = "#000070" },
    { units = 233, color = "#ffffff" },
    { units = 195, color = "#408020" },
    { units = 178, color = "#00ffff" }
  ]

  ## Longwave IR (Channels 13, 14, and 15)
  [handler.gradient.ch13]
  points = [
    { units = 333, color = "#000000" },
    { units = 238, color = "#b9b9b9" },
    { units = 237.999, color = "#00ffff" },
    { units = 228, color = "#000080" },
    { units = 218, color = "#00ff00" },
    { units = 208, color = "#ffff00" },
    { units = 198, color = "#ff0000" },
    { units = 188, color = "#000000" },
    { units = 178, color = "#ffffff" }
  ]
  [handler.gradient.ch14]
  points = [
    { units = 333, color = "#000000" },
    { units = 238, color = "#b9b9b9" },
    { units = 237.999, color = "#00ffff" },
    { units = 228, color = "#000080" },
    { units = 218, color = "#00ff00" },
    { units = 208, color = "#ffff00" },
    { units = 198, color = "#ff0000" },
    { units = 188, color = "#000000" },
    { units = 178, color = "#ffffff" }
  ]
  [handler.gradient.ch15]
  points = [
    { units = 333, color = "#000000" },
    { units = 238, color = "#b9b9b9" },
    { units = 237.999, color = "#00ffff" },
    { units = 228, color = "#000080" },
    { units = 218, color = "#00ff00" },
    { units = 208, color = "#ffff00" },
    { units = 198, color = "#ff0000" },
    { units = 188, color = "#000000" },
    { units = 178, color = "#ffffff" }
  ]

  [[handler.map]]
  path = "/usr/local/share/goestools/ne/ne_50m_admin_0_countries_lakes.json"

  [[handler.map]]
  path = "/usr/local/share/goestools/ne/ne_50m_admin_1_states_provinces_lakes.json"

#GOES-17 Level 2 Images
[[handler]]
type = "image"
origin = "goes17"
products = [ "sst", "lst", "dsi", "tpw" ]
directory = "/media/SDCARD/goes17/non-cmip/{region:short|lower}/{product:short|lower}"
filename = "GOES17_{region:short}_{product:short}_{time:%Y%m%dT%H%M%SZ}"
format = "jpg"
json = false

  [[handler.map]]
  path = "/usr/local/share/goestools/ne/ne_50m_admin_0_countries_lakes.json"
  color = "#000000"

  [[handler.map]]
  path = "/usr/local/share/goestools/ne/ne_50m_admin_1_states_provinces_lakes.json"
  color = "#000000"

  ## The following gradients are rough approximations of the 
  ## McIDAS RGB enhancements used by NOAA/NESDIS/STAR on their site..
  ##
  ## For more info:
  ##
  ## https://www.ospo.noaa.gov/data/sst/contour/global.cf.gif (SST)
  ## https://www.goes-r.gov/products/baseline-LST.html (LST)
  ## http://cimss.ssec.wisc.edu/goes/OCLOFactSheetPDFs/ABIQuickGuide_BaselineDerivedStabilityIndices.pdf (DSI)
  ## https://www.goes-r.gov/products/baseline-total-precipitable-water.html (TPW)

  # Skin Sea Surface Temperature (Degrees K)
  [handler.gradient.SST]
  points = [
    { units = 180, color = "#ffffff" },
    { units = 270.65, color = "#ffffff" },
    { units = 273.25, color = "#b005c6" },
    { units = 275.5, color = "#8f06e4" },
    { units = 277.75, color = "#6c1ff7" },
    { units = 280, color = "#486afa" },
    { units = 282.25, color = "#24b4fc" },
    { units = 284.5, color = "#00ffff" },
    { units = 287.25, color = "#00e696" },
    { units = 289, color = "#00d54b" },
    { units = 291.3, color = "#0cc600" },
    { units = 293.6, color = "#59d800" },
    { units = 295.85, color = "#a5ea00" },
    { units = 298.1, color = "#f2fc00" },
    { units = 300.35, color = "#ffc900" },
    { units = 302.6, color = "#ff9400" },
    { units = 304.85, color = "#ff5500" },
    { units = 307.1, color = "#ff1500" },
    { units = 340, color = "#ffffff" }
  ]

  # Skin Land Surface Temperature (Degrees K)
  [handler.gradient.LST]
  points = [
    { units = 215, color = "#102469" },
    { units = 220, color = "#0002b5" },
    { units = 240, color = "#0359fa" },
    { units = 260, color = "#03eee9" },
    { units = 280, color = "#87f36c" },
    { units = 300, color = "#fee502" },
    { units = 320, color = "#f34900" },
    { units = 342, color = "#7f1100" },
    { units = 353, color = "#ffffff" }
  ]

  # CAPE Derived Stability Index (Joules/kg)
  [handler.gradient.DSI]
  points = [
    { units = 0, color = "#543e20" },
    { units = 500, color = "#a58154" },
    { units = 750, color = "#cfa370" },
    { units = 1000, color = "#c3afc2" },
    { units = 1500, color = "#8181c5" },
    { units = 1750, color = "#6363a3" },
    { units = 2000, color = "#969656" },
    { units = 2500, color = "#fffc02" },
    { units = 2750, color = "#ffd327" },
    { units = 3000, color = "#ff9063" },
    { units = 3500, color = "#ff231e" },
    { units = 4000, color = "#b10032" },
    { units = 4250, color = "#680063" },
    { units = 4500, color = "#8d0090" },
    { units = 4961.3914, color = "#ea00ef" },
    { units = 4980.9245, color = "#000000" }
  ]

  # Total Precipitable Water (mm)
  [handler.gradient.TPW]
  points = [
    { units = 0, color = "#3a290b" },
    { units = 11, color = "#d1a777" },
    { units = 12, color = "#8999ee" },
    { units = 22, color = "#584c96" },
    { units = 23, color = "#9a6a5c" },
    { units = 32, color = "#72a429" },
    { units = 33, color = "#97c03c" },
    { units = 43, color = "#f4fe00" },
    { units = 44, color = "#fd775e" },
    { units = 53, color = "#982a19" },
    { units = 54, color = "#6f0069" },
    { units = 65, color = "#fb00ee" },
    { units = 66, color = "#ffc8ff" },
    { units = 69, color = "#f0bbef" },
    { units = 99, color = "#f069ef" },
    { units = 99.6187, color = "#ffffff" },
  ]

# GOES-17 ABI Non-CMIP RGB-enhanced (White Borders)
[[handler]]
type = "image"
origin = "goes17"
products = [ "rrqpe", "acht", "acha" ]
directory = "/media/SDCARD/goes17/non-cmip/{region:short|lower}/{product:short|lower}"
filename = "GOES17_{region:short}_{product:short}_{time:%Y%m%dT%H%M%SZ}"
format = "jpg"
json = false

  [[handler.map]]
  path = "/usr/local/share/goestools/ne/ne_50m_admin_0_countries_lakes.json"

  [[handler.map]]
  path = "/usr/local/share/goestools/ne/ne_50m_admin_1_states_provinces_lakes.json"

  ## The following gradients are rough approximations of the 
  ## McIDAS RGB enhancements used by NOAA/NESDIS/STAR on their site..
  ##
  ## For more info:
  ##
  ## https://www.goes-r.gov/products/baseline-rainfall-rate-qpe.html (RRQPE)
  ## https://cimss.ssec.wisc.edu/goes/blog/archives/32657 (ACHT)
  ## https://catalog.data.gov/dataset/noaa-goes-r-series-advanced-baseline-imager-abi-level-2-cloud-top-height-acha

  # Rainfall Rate (mm/hr)
  [handler.gradient.RRQPE]
  points = [
    { units = 0, color = "#000000" },
    { units = 6.35, color = "#303030" },
    { units = 12.6, color = "#303030" },
    { units = 12.7, color = "#009cff" },
    { units = 25.3, color = "#050dc8" },
    { units = 25.4, color = "#36ef31" },
    { units = 38.1, color = "#1e8f01" },
    { units = 40.64, color = "#fff92e" },
    { units = 50.8, color = "#f23027" },
    { units = 53.34, color = "#ff00f8" },
    { units = 63.5, color = "#c168c6" },
    { units = 66.04, color = "#fcfcfc" },
    { units = 100, color = "#ffffff" }
  ]

  # Cloud top Height (Degrees K)
  [handler.gradient.ACHT]
   points = [
    { units = 180, color = "#000000" },
    { units = 193, color = "#ffe300" },
    { units = 213, color = "#81ff00" },
    { units = 233, color = "#00ff23" },
    { units = 253, color = "#00ffbb" },
    { units = 273, color = "#00abff" },
    { units = 293, color = "#0011ff" },
    { units = 313, color = "#7500eb" },
    { units = 321, color = "#000000" },
  ]

  # Cloud Top Height Algorithm (Meters)
    [handler.gradient.ACHA]
   points = [
    { units = 0, color = "#000000" },
    { units = 1500, color = "#5e10b1" },
    { units = 3000, color = "#360ae5" },
    { units = 6050, color = "#0d85e4" },
    { units = 9100, color = "#16f2b4" },
    { units = 12200, color = "#19f108" },
    { units = 15250, color = "#e4ff2b" },
    { units = 19845, color = "#ef630e" },
    { units = 19923, color = "#000000" },
  ]
JVital2013 commented 11 months ago

If you're getting errors about goes18 being an invalid origin, you must be running an old version of goestools. Goestools was only updated on Mar 16, 2022 to support GOES-18 and GOES-19.

Update goestools by recompiling from https://github.com/pietern/goestools/ and the issue should go away

pumatrax commented 11 months ago

I update goestool and that did the job. I havent done any updates for over a year.

Things are working now, thanks again!

I think the final thing is I am now trying to run the Sanchez.sh and I get an error saying: Invalid underlay path: /tmp/underlay.jpg

I don't know if that's normal.

Thanks for all your help so far. 

[2023-07-30 13:14:37] Creating GOES16_FD_sanchez_20230730T080020Z.jpg...
/home/pi/vitality-goes/scripts-linux/Sanchez.sh: line 87:  9063 Killed                  xplanet -config "$(dirname "$(readlink -fm "$0")")/Resources/xplanet-$satelliteMonth" -body earth -projection rectangular -num_times 1 -geometry 21600x10800 -date $thisDate.$thisTime -output /tmp/underlay.jpg
Invalid underlay path: /tmp/underlay.jpg
JVital2013 commented 11 months ago

Looks like the key line is the one above it, that says line 87: 9063 Killed xplanet ...

The Linux Kernel is killing xplanet for some reason - probably due to not enough RAM on your system. The Sanchez script works with very high resolution underlays. You can try reducing the underlay resolution from 21600x10800 to 10800x5400 by updating xplanet's -geometry argument on:

Also, it looks like you may have an old version of Sanchez.sh since xplanet does not get called on line 87 anymore (unless you modified the script). I'd recommend updating Sanchez.sh

pumatrax commented 11 months ago

I am running a RPI 4 with 4GB memory. These are some high resolutions so I get it. The computer crashes at times when Sanchez.sh, it might be overheating since it sits out. I did try lowering the resolution but the same is happening.

I compared my Sanchez.sh with the one here and it's the same. This is line 87: for srcImg in $(find "$sanchezSrcPath16" -type f)

My paths looks correct in scriptconfig.ini and is located in the scripts folder where I execute Sanchez.sh. I also noticed that I don't have the /tmp/underlay.jpg in the /tmp folder

It seems like the xplanet command is a new command after the killed. It sits there for a few seconds then throws the Invalid underlay path: /tmp/underlay.jpg. Then the another jpg is processed and I get the ./Sanchez.sh: line 87: 6466 Killed\

Seems like its two errors. 

[2023-07-30 18:13:08] Creating GOES16_FD_sanchez_20230730T150020Z.jpg...
./Sanchez.sh: line 87:  6466 Killed                  xplanet -config "$(dirname "$(readlink -fm "$0")")/Resources/xplanet-$satelliteMonth" -body earth -projection rectangular -num_times 1 -geometry 10800x5400 -date $thisDate.$thisTime -output /tmp/underlay.jpg
Invalid underlay path: /tmp/underlay.jpg
[2023-07-30 18:13:39] Creating GOES16_FD_sanchez_20230730T153020Z.jpg...
./Sanchez.sh: line 87:  6752 Killed                  xplanet -config "$(dirname "$(readlink -fm "$0")")/Resources/xplanet-$satelliteMonth" -body earth -projection rectangular -num_times 1 -geometry 10800x5400 -date $thisDate.$thisTime -output /tmp/underlay.jpg
Invalid underlay path: /tmp/underlay.jpg
[2023-07-30 18:14:21] Creating GOES16_FD_sanchez_20230720T080021Z.jpg...
./Sanchez.sh: line 87:  6964 Killed                  xplanet -config "$(dirname "$(readlink -fm "$0")")/Resources/xplanet-$satelliteMonth" -body earth -projection rectangular -num_times 1 -geometry 10800x5400 -date $thisDate.$thisTime -output /tmp/underlay.jpg
Invalid underlay path: /tmp/underlay.jpg
[2023-07-30 18:14:54] Creating GOES16_FD_sanchez_20230720T083021Z.jpg...
./Sanchez.sh: line 87:  7167 Killed                  xplanet -config "$(dirname "$(readlink -fm "$0")")/Resources/xplanet-$satelliteMonth" -body earth -projection rectangular -num_times 1 -geometry 10800x5400 -date $thisDate.$thisTime -output /tmp/underlay.jpg
Invalid underlay path: /tmp/underlay.jpg
[2023-07-30 18:15:28] Creating GOES16_FD_sanchez_20230720T090021Z.jpg...
./Sanchez.sh: line 87:  7459 Killed                  xplanet -config "$(dirname "$(readlink -fm "$0")")/Resources/xplanet-$satelliteMonth" -body earth -projection rectangular -num_times 1 -geometry 10800x5400 -date $thisDate.$thisTime -output /tmp/underlay.jpg
Invalid underlay path: /tmp/underlay.jpg
[2023-07-30 18:15:59] Creating GOES16_FD_sanchez_20230720T093021Z.jpg...
./Sanchez.sh: line 87:  7659 Killed                  xplanet -config "$(dirname "$(readlink -fm "$0")")/Resources/xplanet-$satelliteMonth" -body earth -projection rectangular -num_times 1 -geometry 10800x5400 -date $thisDate.$thisTime -output /tmp/underlay.jpg
Invalid underlay path: /tmp/underlay.jpg
[2023-07-30 18:16:37] Creating GOES16_FD_sanchez_20230720T100021Z.jpg...
pumatrax commented 11 months ago

Hi,

I noticed that I was was executing the programs from a different location where this latest goestools build put the files. Before it was /usr/bin, not its /usr/local/bin. I am not sure if that's related to my problem but I will allow it to download new products first before checking the Sanchez script again. I deleted the old versions.

Curious, this is how I am executing both goestools executables. I have desktop shortcuts that run both programs from the autostart folder.

"/usr/local/bin/goesproc" -c "/usr/local/share/goestools/goesproc-goes.conf" -m packet --subscribe tcp://127.0.0.1:5004
"/usr/local/bin/goesrecv" -v -i 1 -c "/home/pi/goesrecv.conf"

Let me know if that looks good.

JVital2013 commented 11 months ago

The path for goesrecv/goesproc looks fine - I've had it change on me too before. It has to do with how the cmake command is run; no big deal. Either works.

There are two errors, you're right:

  1. xplanet is being killed due to not enough memory
  2. Sanchez itself crashes due to a missing underlay (which is missing because xplanet crashed)

It looks like you successfully lowered the resolution within the script, but it's still crashing... hmm. You may need to lower the resolution of the source underlays as well. In the same folder as Sanchez.sh, there's a folder called "Resources." Resize each of these images to be 10800x5400 as well - keep their same name, though - and try again.

image

Strictly speaking, none of the secondary scripts are supported on Raspberry Pi (including Sanchez.sh). This is documented in the system requirements section. By chaining at image resolution we can probably make it work, but your mileage may vary

pumatrax commented 11 months ago

Hi,

Yes, it's definitely a memory issue. It's odd because I believe I have created a Sanchez file right after I updated. otherwise, I never used the feature until recently. I tried to resize those files with convert and the sizes are too big for the imagemagik program to resize.

So, I had a thought....

Increase the swap file. Its now at 1GB and I see the files processing. I even see the underlay.jpg in /tmp folder.

I guess this should do it on the ticket. Thanks for all your help.

Screen Shot 2023-07-31 at 10 46 54 AM

JVital2013 commented 11 months ago

That'll work - might be a bit slow, but it'll work!