search

Unidata / awips2

Weather forecasting display and analysis package developed by NWS/Raytheon, released as open source software by Unidata.
http://unidata.github.io/awips2/
Other
177 stars 67 forks source link

ingestGrib not working? #633

Closed GarryLai closed 10 months ago

GarryLai commented 10 months ago

I plase ECMWF grib2 20231230000000-0h-oper-fc.grib2 into /awips2/data_store/ingest, but it did not show on Product Browser.

OS: CentOS7.9 in WSL2 (also same in Virtual Box)

INFO  2023-12-30 18:38:23,652 3491 [main] Main:
**************************************************
* AWIPS II EDEX ESB Platform                     *
* Version: 20.3.2-1                              *
* redhat Company                               *
*------------------------------------------------*
* Build Date  : 12-11-2023                       *
* Build Time  : 22:44:29 UTC                     *
* Build System: fa69127f4460                     *
**************************************************
INFO  2023-12-30 18:38:23,657 3492 [main] Main: EDEX_VERSION: 20.3.2
INFO  2023-12-30 18:38:23,716 3493 [EDEXMain] Executor: EDEX run configuration: ingestGrib
INFO  2023-12-30 18:38:23,716 3494 [EDEXMain] Executor: EDEX site configuration: OAX
INFO  2023-12-30 18:38:24,554 3495 [EDEXMain] Executor:

EDEX configuration files:
-----------------------
edex, edex-datastore, edex-db

Spring-enabled Plugins:
-----------------------
database-common, derived-parameters-python-common, event-common, eventbus-common, grib-decode, grid-common, grid-staticdata-process, gridcoverage-common, level-common, levelhandler-common, parameter-common, persist-ingest, stats-common, time-common

INFO  2023-12-30 18:38:31,598 3496 [EDEXMain] JAXBManager: JAXB context for PersistencePathKeySet inited in: 15 ms
INFO  2023-12-30 18:38:31,713 3497 [EDEXMain] log: EDEX: EDEX - Loaded Filter Patterns from configuredHandlers.xml
INFO  2023-12-30 18:38:31,780 3498 [EDEXMain] JAXBManager: JAXB context for CompositeModel inited in: 8 ms
INFO  2023-12-30 18:38:32,104 3499 [EDEXMain] JAXBManager: JAXB context for AccumulationConfigs inited in: 13 ms
INFO  2023-12-30 18:38:32,416 3500 [EDEXMain] LRUCacheFactory: Detected and using LRUCacheFactory: camel-caffeine-lrucache
INFO  2023-12-30 18:38:35,044 3501 [EDEXMain] Reflections: Reflections took 1236 ms to scan 271 urls, producing 41 keys and 3562 values
INFO  2023-12-30 18:38:35,406 3502 [EDEXMain] DatabaseClassAnnotationFinder: EDEX - Found 240 db classes in 1718 ms
INFO  2023-12-30 18:39:01,174 3503 [EDEXMain] QpidBrokerRestImpl: EDEX - Refreshing queue list
INFO  2023-12-30 18:39:35,634 3504 [EDEXMain] CachePluginRegistry: Ignite cache name has been set to none for topo
INFO  2023-12-30 18:39:35,739 3505 [EDEXMain] PublishExternalEvent: EDEX - Publishing externally marked events to URI: jms-generic:topic:externalEventTopic
INFO  2023-12-30 18:39:36,596 3506 [EDEXMain] JAXBManager: JAXB context for StatisticsConfig inited in: 20 ms
INFO  2023-12-30 18:39:37,162 3507 [EDEXMain] JAXBManager: JAXB context for ParameterList inited in: 17 ms
INFO  2023-12-30 18:39:37,808 3508 [EDEXMain] JAXBManager: JAXB context for RawRequestFilters inited in: 13 ms
INFO  2023-12-30 18:39:38,337 3509 [EDEXMain] JAXBManager: JAXB context for Grib1ParameterSet inited in: 17 ms
INFO  2023-12-30 18:39:38,610 3510 [EDEXMain] GribModelLookup: Initializing grib models
INFO  2023-12-30 18:39:39,003 3511 [EDEXMain] GribModelLookup: Grib models initialized: 392ms
INFO  2023-12-30 18:39:43,671 3512 [EDEXMain] GribSpatialCache: EDEX - Initializing grib grid coverages
INFO  2023-12-30 18:39:43,686 3513 [EDEXMain] JAXBManager: JAXB context for SubGridDef inited in: 15 ms
INFO  2023-12-30 18:39:43,750 3514 [EDEXMain] JAXBManager: JAXB context for GridCoverage inited in: 64 ms
INFO  2023-12-30 18:39:45,912 3515 [EDEXMain] JAXBManager: JAXB context for DefaultSubGridCenterPoint inited in: 6 ms
INFO  2023-12-30 18:39:45,918 3516 [EDEXMain] GribSpatialCache: EDEX - Default sub grid location is wfo center point [41.377182/-96.646906]
INFO  2023-12-30 18:39:45,931 3517 [EDEXMain] GribSpatialCache: EDEX - Grib grid coverages initialized: 2260 ms
INFO  2023-12-30 18:39:46,186 3518 [EDEXMain] CachePluginRegistry: Ignite cache name has been set to gridDataStore for grid
INFO  2023-12-30 18:39:47,092 3519 [EDEXMain] AutowiredLifecycleStrategy: Autowired property: exchangeFormatter on component: log as exactly one instance of type: org.apache.camel.spi.ExchangeFormatter (org.apache.camel.support.processor.DefaultExchangeFormatter) found in the registry
INFO  2023-12-30 18:39:47,390 3520 [EDEXMain] AbstractCamelContext: Apache Camel 3.7.0 (persist-camel) is starting
INFO  2023-12-30 18:39:47,447 3521 [EDEXMain] AbstractCamelContext: StreamCaching is not in use. If using streams then it's recommended to enable stream caching. See more details at http://camel.apache.org/stream-caching.html
INFO  2023-12-30 18:39:47,490 3522 [EDEXMain] AbstractCamelContext: Total 8 routes, of which 0 are started
INFO  2023-12-30 18:39:47,490 3523 [EDEXMain] AbstractCamelContext: Apache Camel 3.7.0 (persist-camel) started in 100ms
INFO  2023-12-30 18:39:47,682 3524 [EDEXMain] AutowiredLifecycleStrategy: Autowired property: exchangeFormatter on component: log as exactly one instance of type: org.apache.camel.spi.ExchangeFormatter (org.apache.camel.support.processor.DefaultExchangeFormatter) found in the registry
INFO  2023-12-30 18:39:47,760 3525 [EDEXMain] SedaEndpoint: Endpoint vm://edex.alertVizNotification is using shared queue: vm://edex.alertVizNotification with size: 1000
INFO  2023-12-30 18:39:47,789 3526 [EDEXMain] SedaEndpoint: Endpoint vm://edex.alarmAlertNotification is using shared queue: vm://edex.alarmAlertNotification with size: 1000
INFO  2023-12-30 18:39:47,791 3527 [EDEXMain] AbstractCamelContext: Apache Camel 3.7.0 (camel) is starting
INFO  2023-12-30 18:39:47,793 3528 [EDEXMain] AbstractCamelContext: StreamCaching is not in use. If using streams then it's recommended to enable stream caching. See more details at http://camel.apache.org/stream-caching.html
INFO  2023-12-30 18:39:47,891 3529 [EDEXMain] AbstractCamelContext: Total 3 routes, of which 0 are started
INFO  2023-12-30 18:39:47,891 3530 [EDEXMain] AbstractCamelContext: Apache Camel 3.7.0 (camel) started in 99ms
INFO  2023-12-30 18:39:48,054 3531 [EDEXMain] AutowiredLifecycleStrategy: Autowired property: exchangeFormatter on component: log as exactly one instance of type: org.apache.camel.spi.ExchangeFormatter (org.apache.camel.support.processor.DefaultExchangeFormatter) found in the registry
INFO  2023-12-30 18:39:48,069 3532 [EDEXMain] AbstractCamelContext: Apache Camel 3.7.0 (clusteredCamel) is starting
INFO  2023-12-30 18:39:48,070 3533 [EDEXMain] AbstractCamelContext: StreamCaching is not in use. If using streams then it's recommended to enable stream caching. See more details at http://camel.apache.org/stream-caching.html
INFO  2023-12-30 18:39:48,071 3534 [EDEXMain] AbstractCamelContext: Total 1 routes, of which 0 are started
INFO  2023-12-30 18:39:48,071 3535 [EDEXMain] AbstractCamelContext: Apache Camel 3.7.0 (clusteredCamel) started in 2ms
INFO  2023-12-30 18:39:48,171 3536 [EDEXMain] AutowiredLifecycleStrategy: Autowired property: exchangeFormatter on component: log as exactly one instance of type: org.apache.camel.spi.ExchangeFormatter (org.apache.camel.support.processor.DefaultExchangeFormatter) found in the registry
INFO  2023-12-30 18:39:48,193 3537 [EDEXMain] AbstractCamelContext: Apache Camel 3.7.0 (grid-staticdata-process) is starting
INFO  2023-12-30 18:39:48,194 3538 [EDEXMain] AbstractCamelContext: StreamCaching is not in use. If using streams then it's recommended to enable stream caching. See more details at http://camel.apache.org/stream-caching.html
INFO  2023-12-30 18:39:48,196 3539 [EDEXMain] AbstractCamelContext: Total 1 routes, of which 0 are started
INFO  2023-12-30 18:39:48,196 3540 [EDEXMain] AbstractCamelContext: Apache Camel 3.7.0 (grid-staticdata-process) started in 2ms
INFO  2023-12-30 18:39:48,461 3541 [EDEXMain] AutowiredLifecycleStrategy: Autowired property: exchangeFormatter on component: log as exactly one instance of type: org.apache.camel.spi.ExchangeFormatter (org.apache.camel.support.processor.DefaultExchangeFormatter) found in the registry
INFO  2023-12-30 18:39:48,533 3542 [EDEXMain] AbstractCamelContext: Apache Camel 3.7.0 (grib-decode) is starting
INFO  2023-12-30 18:39:48,536 3543 [EDEXMain] AbstractCamelContext: StreamCaching is not in use. If using streams then it's recommended to enable stream caching. See more details at http://camel.apache.org/stream-caching.html
INFO  2023-12-30 18:39:48,564 3544 [EDEXMain] AbstractCamelContext: Total 5 routes, of which 0 are started
INFO  2023-12-30 18:39:48,565 3545 [EDEXMain] AbstractCamelContext: Apache Camel 3.7.0 (grib-decode) started in 30ms
INFO  2023-12-30 18:39:48,653 3546 [EDEXMain] AutowiredLifecycleStrategy: Autowired property: exchangeFormatter on component: log as exactly one instance of type: org.apache.camel.spi.ExchangeFormatter (org.apache.camel.support.processor.DefaultExchangeFormatter) found in the registry
INFO  2023-12-30 18:39:48,668 3547 [EDEXMain] AbstractCamelContext: Apache Camel 3.7.0 (grid-common-camel) is starting
INFO  2023-12-30 18:39:48,668 3548 [EDEXMain] AbstractCamelContext: StreamCaching is not in use. If using streams then it's recommended to enable stream caching. See more details at http://camel.apache.org/stream-caching.html
INFO  2023-12-30 18:39:48,671 3549 [EDEXMain] AbstractCamelContext: Total 2 routes, of which 0 are started
INFO  2023-12-30 18:39:48,671 3550 [EDEXMain] AbstractCamelContext: Apache Camel 3.7.0 (grid-common-camel) started in 3ms
INFO  2023-12-30 18:39:48,673 3551 [EDEXMain] RequestHandlerAutoDetector: 18 IRequestHandlers were detected.
INFO  2023-12-30 18:39:48,679 3552 [EDEXMain] RequestHandlerAutoDetector: 8 IRequestHandlers were explicitly registered through Spring XML.
INFO  2023-12-30 18:39:48,681 3553 [EDEXMain] RequestHandlerAutoDetector: Successfully auto-registered 10 IRequestHandlers.
INFO  2023-12-30 18:39:48,691 3554 [EDEXMain] Executor: Waiting for async startup dependencies to complete...
INFO  2023-12-30 18:39:48,694 3555 [EDEXMain] Executor: Async startup dependencies are complete...
INFO  2023-12-30 18:39:48,698 3556 [EDEXMain] ContextManager: EDEX - Context Manager starting contexts
INFO  2023-12-30 18:39:48,714 3557 [EDEXMain] ContextManager: EDEX - Took 12ms to generate depedency mapping.
INFO  2023-12-30 18:39:48,820 3558 [pool-2-thread-3] InternalRouteStartupManager: Route: reloadTimer started and consuming from: timer://reloadTimer
INFO  2023-12-30 18:39:48,845 3559 [pool-2-thread-2] InternalRouteStartupManager: Route: monitorClusteredContexts started and consuming from: timer://monitorClusterContexts
INFO  2023-12-30 18:39:48,849 3560 [pool-2-thread-3] InternalRouteStartupManager: Route: logFailureAsInfo started and consuming from: direct-vm://logFailureAsInfo
INFO  2023-12-30 18:39:48,856 3561 [pool-2-thread-3] InternalRouteStartupManager: Route: logFailedData started and consuming from: direct-vm://logFailedData
INFO  2023-12-30 18:39:48,874 3562 [pool-2-thread-3] InternalRouteStartupManager: Route: notificationTimer started and consuming from: timer://notificationTimer
INFO  2023-12-30 18:39:48,888 3563 [pool-2-thread-3] InternalRouteStartupManager: Route: notificationAggregation started and consuming from: direct-vm://stageNotification
INFO  2023-12-30 18:39:48,893 3564 [pool-2-thread-3] InternalRouteStartupManager: Route: indexAlert started and consuming from: direct-vm://indexAlert
INFO  2023-12-30 18:39:48,894 3565 [pool-2-thread-1] InternalRouteStartupManager: Route: alarmAlertNotify started and consuming from: vm://edex.alarmAlertNotification
INFO  2023-12-30 18:39:48,895 3566 [pool-2-thread-3] InternalRouteStartupManager: Route: persistIndexAlert started and consuming from: direct-vm://persistIndexAlert
INFO  2023-12-30 18:39:48,896 3567 [pool-2-thread-3] InternalRouteStartupManager: Route: persistIndex started and consuming from: direct-vm://persistIndex
INFO  2023-12-30 18:39:48,900 3568 [pool-2-thread-1] InternalRouteStartupManager: Route: alertVizNotify started and consuming from: vm://edex.alertVizNotification
INFO  2023-12-30 18:39:48,931 3569 [pool-2-thread-2] InternalRouteStartupManager: Route: gridPersistIndexAlert started and consuming from: direct-vm://gridPersistIndexAlert
INFO  2023-12-30 18:39:54,145 3570 [AmqpProvider :(1):[amqps://localhost:5672]] JmsConnection: Connection ID:cb70fe00-36ac-4846-bb37-50707bebbb16:1 connected to server: amqps://localhost:5672
INFO  2023-12-30 18:39:54,160 3571 [pool-2-thread-5] InternalRouteStartupManager: Route: gridStaticDataGenerationRoute started and consuming from: jms-durable://grid-staticdata-generate
INFO  2023-12-30 18:39:54,160 3572 [pool-2-thread-4] InternalRouteStartupManager: Route: purgeGridCoverageCaches started and consuming from: jms-generic://topic:purgeGridCoverageCaches
INFO  2023-12-30 18:39:54,160 3573 [pool-2-thread-2] InternalRouteStartupManager: Route: purgeGridCoverageCaches started and consuming from: jms-generic://topic:purgeGridCoverageCaches
INFO  2023-12-30 18:39:54,163 3574 [pool-2-thread-1] InternalRouteStartupManager: Route: edexUtilityNotify started and consuming from: jms-generic://topic:edex.alerts.utility
INFO  2023-12-30 18:39:54,173 3575 [pool-2-thread-4] InternalRouteStartupManager: Route: purgeGridInfoCache started and consuming from: jms-generic://topic:purgeGridInfoCache
INFO  2023-12-30 18:39:54,193 3576 [pool-2-thread-2] InternalRouteStartupManager: Route: gridPostProcessRoute started and consuming from: jms-durable://queue:Grid.PostProcess
INFO  2023-12-30 18:39:54,233 3577 [pool-2-thread-2] InternalRouteStartupManager: Route: gribDecodeIngestRoute started and consuming from: jms-durable://queue:Ingest.GribDecode
INFO  2023-12-30 18:39:54,241 3578 [pool-2-thread-2] InternalRouteStartupManager: Route: gribSplitIngestRoute started and consuming from: jms-durable://queue:Ingest.GribSplit
INFO  2023-12-30 18:39:54,242 3579 [EDEXMain] Executor:
**************************************************
* EDEX ESB is now operational                    *
* Total startup time: 1m30s
**************************************************
INFO  2023-12-30 18:39:54,280 3580 [purgeGridCoverageCaches-1] QpidUFConnection: EDEX - Created new Qpid session (transacted = false, acknowledgeMode = 1)
INFO  2023-12-30 18:39:54,285 3581 [grid-staticdata-generate-1] QpidUFConnection: EDEX - Created new Qpid session (transacted = false, acknowledgeMode = 1)
INFO  2023-12-30 18:39:54,401 3582 [purgeGridInfoCache-1] QpidUFConnection: EDEX - Created new Qpid session (transacted = false, acknowledgeMode = 1)
INFO  2023-12-30 18:39:54,401 3583 [purgeGridCoverageCaches-1] QpidUFConnection: EDEX - Created new Qpid session (transacted = false, acknowledgeMode = 1)
INFO  2023-12-30 18:39:54,401 3584 [Ingest.GribDecode-5] QpidUFConnection: EDEX - Created new Qpid session (transacted = false, acknowledgeMode = 1)
INFO  2023-12-30 18:39:54,401 3585 [Ingest.GribDecode-8] QpidUFConnection: EDEX - Created new Qpid session (transacted = false, acknowledgeMode = 1)
INFO  2023-12-30 18:39:54,401 3586 [Grid.PostProcess-1] QpidUFConnection: EDEX - Created new Qpid session (transacted = false, acknowledgeMode = 1)
INFO  2023-12-30 18:39:54,401 3587 [Ingest.GribDecode-7] QpidUFConnection: EDEX - Created new Qpid session (transacted = false, acknowledgeMode = 1)
INFO  2023-12-30 18:39:54,401 3588 [edex.alerts.utility-1] QpidUFConnection: EDEX - Created new Qpid session (transacted = false, acknowledgeMode = 1)
INFO  2023-12-30 18:39:54,473 3589 [Ingest.GribDecode-6] QpidUFConnection: EDEX - Created new Qpid session (transacted = false, acknowledgeMode = 1)
INFO  2023-12-30 18:39:54,473 3590 [Ingest.GribDecode-4] QpidUFConnection: EDEX - Created new Qpid session (transacted = false, acknowledgeMode = 1)
INFO  2023-12-30 18:39:54,474 3591 [Ingest.GribSplit-2] QpidUFConnection: EDEX - Created new Qpid session (transacted = false, acknowledgeMode = 1)
INFO  2023-12-30 18:39:54,479 3592 [Ingest.GribSplit-1] QpidUFConnection: EDEX - Created new Qpid session (transacted = false, acknowledgeMode = 1)
INFO  2023-12-30 18:39:54,483 3593 [Ingest.GribDecode-2] QpidUFConnection: EDEX - Created new Qpid session (transacted = false, acknowledgeMode = 1)
INFO  2023-12-30 18:39:54,483 3594 [Ingest.GribDecode-1] QpidUFConnection: EDEX - Created new Qpid session (transacted = false, acknowledgeMode = 1)
INFO  2023-12-30 18:39:54,484 3595 [Ingest.GribDecode-3] QpidUFConnection: EDEX - Created new Qpid session (transacted = false, acknowledgeMode = 1)
INFO  2023-12-30 18:39:54,904 3596 [purgeGridCoverageCaches-1] QpidUFSession: EDEX - Created consumer amq.topic/purgeGridCoverageCaches
INFO  2023-12-30 18:39:54,914 3597 [grid-staticdata-generate-1] QpidUFSession: EDEX - Created consumer grid-staticdata-generate
INFO  2023-12-30 18:39:55,249 3598 [purgeGridInfoCache-1] QpidUFSession: EDEX - Created consumer amq.topic/purgeGridInfoCache
INFO  2023-12-30 18:39:55,252 3599 [purgeGridCoverageCaches-1] QpidUFSession: EDEX - Created consumer amq.topic/purgeGridCoverageCaches
INFO  2023-12-30 18:39:55,253 3600 [Ingest.GribDecode-8] QpidUFSession: EDEX - Created consumer Ingest.GribDecode
INFO  2023-12-30 18:39:55,253 3601 [Ingest.GribDecode-5] QpidUFSession: EDEX - Created consumer Ingest.GribDecode
INFO  2023-12-30 18:39:55,259 3602 [Grid.PostProcess-1] QpidUFSession: EDEX - Created consumer Grid.PostProcess
INFO  2023-12-30 18:39:55,261 3603 [edex.alerts.utility-1] QpidUFSession: EDEX - Created consumer amq.topic/edex.alerts.utility
INFO  2023-12-30 18:39:55,261 3604 [Ingest.GribDecode-2] QpidUFSession: EDEX - Created consumer Ingest.GribDecode
INFO  2023-12-30 18:39:55,261 3605 [Ingest.GribDecode-6] QpidUFSession: EDEX - Created consumer Ingest.GribDecode
INFO  2023-12-30 18:39:55,261 3606 [Ingest.GribDecode-7] QpidUFSession: EDEX - Created consumer Ingest.GribDecode
INFO  2023-12-30 18:39:55,262 3607 [Ingest.GribDecode-4] QpidUFSession: EDEX - Created consumer Ingest.GribDecode
INFO  2023-12-30 18:39:55,262 3608 [Ingest.GribDecode-1] QpidUFSession: EDEX - Created consumer Ingest.GribDecode
INFO  2023-12-30 18:39:55,262 3609 [Ingest.GribSplit-2] QpidUFSession: EDEX - Created consumer Ingest.GribSplit
INFO  2023-12-30 18:39:55,262 3610 [Ingest.GribDecode-3] QpidUFSession: EDEX - Created consumer Ingest.GribDecode
INFO  2023-12-30 18:39:55,262 3611 [Ingest.GribSplit-1] QpidUFSession: EDEX - Created consumer Ingest.GribSplit
tiffanycmeyer13 commented 10 months ago

Hello,

That isn't the correct location to put the file. Try placing the file in /awips2/edex/data/manual

GarryLai commented 10 months ago

Hello,

That isn't the correct location to put the file. Try placing the file in /awips2/edex/data/manual

Thanks.