InnoZ / MAS_Interface

Apache License 2.0
1 stars 0 forks source link

Sidekiq-Error Prignitz #74

Open 00Bock opened 6 years ago

00Bock commented 6 years ago

NoMethodError: undefined method `calculate_od_relations_and_modal_split' for nil:NilClass

image

kjoscha commented 6 years ago

Der Fehler undefined method 'calculate_od_relations_and_modal_split' for nil:NilClass bedeutet nur, dass MatSim nichts in die Datenbank geschrieben hat und daher die Ruby-Methode "calculate_od_relations_and_modal_split" auf nil ausgeführt wird (Ich fange das demnächst mal ab). Es wird irgendein Fehler im Java-Code sein, der evtl. aus dem Matsim-Log hervorgeht.

00Bock commented 6 years ago

der MATSim am Rechner mit DB-Anbindung lief gut bis, es das Port-Forwarding unterbrochen wurde:

bbock@playground:~$ packet_write_wait: Connection to 192.168.0.215 port 22: Broken pipe
bbock@InnoZinOz:~$

Zur vollständigen Dokumentation kopiere ich noch den MATSim log hier rein:

2017-08-09 12:49:41,028  INFO Config:131 context=[file:/home/bbock/Repositories/MAS/innoz-toolbox/]
2017-08-09 12:49:41,139  INFO Config:131 context=[file:/home/bbock/Repositories/MAS/innoz-toolbox/]
2017-08-09 12:49:41,223  INFO Main:55 Starting scenario geneartion with Main
2017-08-09 12:49:41,224  INFO Main:67 Added survey area with AGKZ '12070'
2017-08-09 12:49:41,224  INFO Main:78 Scenario year set to 2017
2017-08-09 12:49:41,224  INFO Main:80 Starting controller...
2017-08-09 12:49:41,224  INFO Controller:59 Starting scenario generation...
2017-08-09 12:49:42,374  INFO Logger:? dataFileCache open start
2017-08-09 12:49:43,009  INFO Controller:74 Executing task com.innoz.toolbox.run.controller.task.ReadGeodataTask@24c08328
2017-08-09 12:49:43,013  INFO PsqlAdapter:46 Connecting to database geodata as user matsim...
2017-08-09 12:49:43,079  INFO DatabaseReader:229 Reading administrative borders from database...
2017-08-09 12:49:43,582  INFO DatabaseReader:437 Reading osm data...
2017-08-09 12:49:43,585  INFO DatabaseReader:487 Processing osm polygon data...
2017-08-09 12:55:15,539  INFO MultithreadedModule:117 Starting 1 threads for algo threads of type com.innoz.toolbox.run.parallelization.DataProcessingAlgoThread
2017-08-09 12:55:37,995  INFO MultithreadedModule:139 all 1 threads finished.
2017-08-09 12:55:38,022  INFO MultithreadedModule:117 Starting 1 threads for algo threads of type com.innoz.toolbox.run.parallelization.DataProcessingAlgoThread
2017-08-09 13:48:50,436  INFO MultithreadedModule:139 all 1 threads finished.
2017-08-09 13:48:50,436  INFO DatabaseReader:564 Processing osm point data...
2017-08-09 13:49:25,716  INFO MultithreadedModule:117 Starting 1 threads for algo threads of type com.innoz.toolbox.run.parallelization.DataProcessingAlgoThread
2017-08-09 13:49:25,832  INFO MultithreadedModule:139 all 1 threads finished.
2017-08-09 13:49:26,001  INFO MultithreadedModule:117 Starting 1 threads for algo threads of type com.innoz.toolbox.run.parallelization.BuildingThread
Aug 09, 2017 1:49:41 PM org.geotools.referencing.factory.DeferredAuthorityFactory disposeBackingStore
INFO: Disposing class org.geotools.referencing.factory.epsg.ThreadedHsqlEpsgFactory backing store
2017-08-09 13:49:41,958  INFO Logger:? Database closed
2017-08-09 13:49:51,270  INFO MultithreadedModule:139 all 1 threads finished.
2017-08-09 13:49:51,270  INFO DatabaseReader:475 Done.
2017-08-09 13:49:51,271  INFO PsqlAdapter:46 Connecting to database population as user matsim...
2017-08-09 13:49:51,305  INFO Controller:74 Executing task com.innoz.toolbox.run.controller.task.NetworkGenerationTask@4fb10904
2017-08-09 13:49:51,339  INFO DatabaseReader:718 Reading osm ways from database...
2017-08-09 13:49:51,339  INFO PsqlAdapter:46 Connecting to database geodata as user matsim...
2017-08-09 13:53:01,743  INFO DatabaseReader:797 Done.
2017-08-09 14:17:48,947  INFO NetworkImpl:156  node # 1
2017-08-09 14:17:48,976  INFO NetworkImpl:156  node # 2
2017-08-09 14:17:48,978  INFO NetworkImpl:156  node # 4
2017-08-09 14:17:48,979  INFO NetworkImpl:156  node # 8
2017-08-09 14:17:48,980  INFO NetworkImpl:156  node # 16
2017-08-09 14:17:48,984  INFO NetworkImpl:156  node # 32
2017-08-09 14:17:48,986  INFO NetworkImpl:156  node # 64
2017-08-09 14:17:48,992  INFO NetworkImpl:156  node # 128
2017-08-09 14:17:49,005  INFO NetworkImpl:156  node # 256
2017-08-09 14:17:49,013  INFO NetworkImpl:156  node # 512
2017-08-09 14:17:49,025  INFO NetworkImpl:156  node # 1024
2017-08-09 14:17:49,046  INFO NetworkImpl:156  node # 2048
2017-08-09 14:17:49,097  INFO NetworkImpl:156  node # 4096
2017-08-09 14:17:49,168  INFO NetworkImpl:156  node # 8192
2017-08-09 14:17:49,268  INFO NetworkImpl:156  node # 16384
2017-08-09 14:17:49,441  INFO NetworkImpl:156  node # 32768
2017-08-09 14:17:49,722  INFO NetworkImpl:152  link # 1
2017-08-09 14:17:49,723  INFO NetworkImpl:152  link # 2
2017-08-09 14:17:49,725  INFO NetworkImpl:152  link # 4
2017-08-09 14:17:49,726  INFO NetworkImpl:152  link # 8
2017-08-09 14:17:49,729  INFO NetworkImpl:152  link # 16
2017-08-09 14:17:49,733  INFO NetworkImpl:152  link # 32
2017-08-09 14:17:49,738  INFO NetworkImpl:152  link # 64
2017-08-09 14:17:49,748  INFO NetworkImpl:152  link # 128
2017-08-09 14:17:49,769  INFO NetworkImpl:152  link # 256
2017-08-09 14:17:49,804  INFO NetworkImpl:152  link # 512
2017-08-09 14:17:49,863  INFO NetworkImpl:152  link # 1024
2017-08-09 14:17:49,938  INFO NetworkImpl:152  link # 2048
2017-08-09 14:17:50,026  INFO NetworkImpl:152  link # 4096
2017-08-09 14:17:50,206  INFO NetworkImpl:152  link # 8192
2017-08-09 14:17:50,292  WARN NetworkCreatorFromPsql:485 Could not parse freespeed tag: signals. Ignoring it.
2017-08-09 14:17:50,294  WARN LinkImpl:131 [freespeed=0.0 of link id 10074 may cause problems]
2017-08-09 14:17:50,296  WARN LinkImpl:133  Future occurences of this logging statement are suppressed.
2017-08-09 14:17:50,596  INFO NetworkImpl:152  link # 16384
2017-08-09 14:17:50,920  WARN NetworkCreatorFromPsql:485 Could not parse freespeed tag: AT:rural. Ignoring it.
2017-08-09 14:17:51,100  INFO NetworkImpl:152  link # 32768
2017-08-09 14:17:51,370  WARN NetworkCreatorFromPsql:485 Could not parse freespeed tag: AT:urban. Ignoring it.
2017-08-09 14:17:51,455  INFO NetworkImpl:152  link # 65536
2017-08-09 14:18:00,279  INFO NetworkCreatorFromPsql:443 Conversion statistics:
2017-08-09 14:18:00,279  INFO NetworkCreatorFromPsql:444 OSM nodes:    3860511
2017-08-09 14:18:00,279  INFO NetworkCreatorFromPsql:445 OSM ways:     639218
2017-08-09 14:18:00,279  INFO NetworkCreatorFromPsql:446 MATSim nodes: 61503
2017-08-09 14:18:00,280  INFO NetworkCreatorFromPsql:447 MATSim links: 117817
2017-08-09 14:18:00,316  INFO NetworkCleaner:118 running org.matsim.core.network.algorithms.NetworkCleaner algorithm...
2017-08-09 14:18:00,316  INFO NetworkCleaner:121   checking 61503 nodes and 117817 links for dead-ends...
2017-08-09 14:18:00,521  INFO NetworkCleaner:139     The biggest cluster consists of 50797 nodes.
2017-08-09 14:18:00,521  INFO NetworkCleaner:140   done.
2017-08-09 14:18:00,618  INFO NetworkCleaner:155   resulting network contains 50797 nodes and 97132 links.
2017-08-09 14:18:00,618  INFO NetworkCleaner:157 done.
2017-08-09 14:18:02,293  INFO Controller:74 Executing task com.innoz.toolbox.run.controller.task.DemandGenerationTask@42bf56be
2017-08-09 14:18:02,335  INFO CommuterDatabaseParser:37 Parsing commuter data
2017-08-09 14:18:02,335  INFO PsqlAdapter:46 Connecting to database surveyed_mobility as user matsim...
org.postgresql.util.PSQLException: The connection attempt failed.
    at org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:240)
    at org.postgresql.core.ConnectionFactory.openConnection(ConnectionFactory.java:64)
    at org.postgresql.jdbc2.AbstractJdbc2Connection.<init>(AbstractJdbc2Connection.java:143)
    at org.postgresql.jdbc3.AbstractJdbc3Connection.<init>(AbstractJdbc3Connection.java:29)
    at org.postgresql.jdbc3g.AbstractJdbc3gConnection.<init>(AbstractJdbc3gConnection.java:21)
    at org.postgresql.jdbc4.AbstractJdbc4Connection.<init>(AbstractJdbc4Connection.java:38)
    at org.postgresql.jdbc4.Jdbc4Connection.<init>(Jdbc4Connection.java:24)
    at org.postgresql.Driver.makeConnection(Driver.java:412)
    at org.postgresql.Driver.connect(Driver.java:280)
    at java.sql.DriverManager.getConnection(DriverManager.java:664)
    at java.sql.DriverManager.getConnection(DriverManager.java:247)
    at com.innoz.toolbox.config.psql.PsqlAdapter.createConnection(PsqlAdapter.java:48)
    at com.innoz.toolbox.io.database.CommuterDatabaseParser.run(CommuterDatabaseParser.java:42)
    at com.innoz.toolbox.run.controller.task.DemandGenerationTask.run(DemandGenerationTask.java:54)
    at com.innoz.toolbox.run.controller.Controller.lambda$0(Controller.java:76)
    at java.lang.Thread.run(Thread.java:748)
Caused by: java.net.SocketException: Connection reset
    at java.net.SocketInputStream.read(SocketInputStream.java:210)
    at java.net.SocketInputStream.read(SocketInputStream.java:141)
    at org.postgresql.core.VisibleBufferedInputStream.readMore(VisibleBufferedInputStream.java:143)
    at org.postgresql.core.VisibleBufferedInputStream.ensureBytes(VisibleBufferedInputStream.java:112)
    at org.postgresql.core.VisibleBufferedInputStream.read(VisibleBufferedInputStream.java:71)
    at org.postgresql.core.PGStream.ReceiveChar(PGStream.java:282)
    at org.postgresql.core.v3.ConnectionFactoryImpl.doAuthentication(ConnectionFactoryImpl.java:393)
    at org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:188)
    ... 15 more
2017-08-09 14:35:42,539  INFO NetworkImpl:409 building QuadTree for nodes: xrange(652105.4334166056,797822.563833598); yrange(5562599.3753156215,5916723.056315505)
2017-08-09 14:35:42,599  INFO NetworkImpl:418 Building QuadTree took 0.073 seconds.
2017-08-09 14:36:07,134  INFO DemandGenerationTask:71 Selected type of population: SURVEY
2017-08-09 14:36:07,272  INFO SurveyDatabaseParserV2:53 Parsing surveys database to create a synthetic population
2017-08-09 14:36:07,272  INFO PsqlAdapter:46 Connecting to database surveyed_mobility as user matsim...
org.postgresql.util.PSQLException: Connection refused. Check that the hostname and port are correct and that the postmaster is accepting TCP/IP connections.
    at org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:222)
    at org.postgresql.core.ConnectionFactory.openConnection(ConnectionFactory.java:64)
    at org.postgresql.jdbc2.AbstractJdbc2Connection.<init>(AbstractJdbc2Connection.java:143)
    at org.postgresql.jdbc3.AbstractJdbc3Connection.<init>(AbstractJdbc3Connection.java:29)
    at org.postgresql.jdbc3g.AbstractJdbc3gConnection.<init>(AbstractJdbc3gConnection.java:21)
    at org.postgresql.jdbc4.AbstractJdbc4Connection.<init>(AbstractJdbc4Connection.java:38)
    at org.postgresql.jdbc4.Jdbc4Connection.<init>(Jdbc4Connection.java:24)
    at org.postgresql.Driver.makeConnection(Driver.java:412)
    at org.postgresql.Driver.connect(Driver.java:280)
    at java.sql.DriverManager.getConnection(DriverManager.java:664)
    at java.sql.DriverManager.getConnection(DriverManager.java:247)
    at com.innoz.toolbox.config.psql.PsqlAdapter.createConnection(PsqlAdapter.java:48)
    at com.innoz.toolbox.io.database.SurveyDatabaseParserV2.run(SurveyDatabaseParserV2.java:56)
    at com.innoz.toolbox.scenarioGeneration.population.algorithm.SurveyBasedDemandGenerator.createCompletePopulation(SurveyBasedDemandGenerator.java:91)
    at com.innoz.toolbox.scenarioGeneration.population.algorithm.SurveyBasedDemandGenerator.run(SurveyBasedDemandGenerator.java:72)
    at com.innoz.toolbox.run.controller.task.DemandGenerationTask.run(DemandGenerationTask.java:98)
    at com.innoz.toolbox.run.controller.Controller.lambda$0(Controller.java:76)
    at java.lang.Thread.run(Thread.java:748)
Caused by: java.net.ConnectException: Connection refused (Connection refused)
    at java.net.PlainSocketImpl.socketConnect(Native Method)
    at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350)
    at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206)
    at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188)
    at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
    at java.net.Socket.connect(Socket.java:589)
    at org.postgresql.core.PGStream.<init>(PGStream.java:61)
    at org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:110)
    ... 17 more
2017-08-09 14:36:07,422  INFO SurveyBasedDemandGenerator:329 0 persons created...
2017-08-09 14:36:07,479  INFO PopulationWriter:139 Population written to: /home/bbock/workspace/scenarios/12070_2017/plans.xml.gz
2017-08-09 14:36:07,480  INFO Counter:67 [PopulationWriter] dumped person # 0
2017-08-09 14:36:07,480  INFO Controller:74 Executing task com.innoz.toolbox.run.controller.task.ConfigCreatorTask@71731421
java.lang.NullPointerException
    at com.innoz.toolbox.scenarioGeneration.config.InitialConfigCreator.addBasicModeRoutingParams(InitialConfigCreator.java:131)
    at com.innoz.toolbox.scenarioGeneration.config.InitialConfigCreator.adapt(InitialConfigCreator.java:61)
    at com.innoz.toolbox.run.controller.task.ConfigCreatorTask.run(ConfigCreatorTask.java:23)
    at com.innoz.toolbox.run.controller.Controller.lambda$0(Controller.java:76)
    at java.lang.Thread.run(Thread.java:748)
2017-08-09 14:36:07,512  INFO Controller:74 Executing task com.innoz.toolbox.run.controller.task.WriteOutputTask@1bd0231c
2017-08-09 14:36:08,803  INFO PopulationWriter:139 Population written to: /home/bbock/workspace/scenarios/12070_2017/plans.xml.gz
2017-08-09 14:36:08,804  INFO Counter:67 [PopulationWriter] dumped person # 0
2017-08-09 14:36:08,848  INFO PsqlAdapter:46 Connecting to database mas_interface_development as user matsim...
org.postgresql.util.PSQLException: Connection refused. Check that the hostname and port are correct and that the postmaster is accepting TCP/IP connections.
    at org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:222)
    at org.postgresql.core.ConnectionFactory.openConnection(ConnectionFactory.java:64)
    at org.postgresql.jdbc2.AbstractJdbc2Connection.<init>(AbstractJdbc2Connection.java:143)
    at org.postgresql.jdbc3.AbstractJdbc3Connection.<init>(AbstractJdbc3Connection.java:29)
    at org.postgresql.jdbc3g.AbstractJdbc3gConnection.<init>(AbstractJdbc3gConnection.java:21)
    at org.postgresql.jdbc4.AbstractJdbc4Connection.<init>(AbstractJdbc4Connection.java:38)
    at org.postgresql.jdbc4.Jdbc4Connection.<init>(Jdbc4Connection.java:24)
    at org.postgresql.Driver.makeConnection(Driver.java:412)
    at org.postgresql.Driver.connect(Driver.java:280)
    at java.sql.DriverManager.getConnection(DriverManager.java:664)
    at java.sql.DriverManager.getConnection(DriverManager.java:247)
    at com.innoz.toolbox.config.psql.PsqlAdapter.createConnection(PsqlAdapter.java:48)
    at com.innoz.toolbox.io.pgsql.MatsimPsqlAdapter.writeScenarioToPsql(MatsimPsqlAdapter.java:117)
    at com.innoz.toolbox.run.controller.task.WriteOutputTask.run(WriteOutputTask.java:34)
    at com.innoz.toolbox.run.controller.Controller.lambda$0(Controller.java:76)
    at java.lang.Thread.run(Thread.java:748)
Caused by: java.net.ConnectException: Connection refused (Connection refused)
    at java.net.PlainSocketImpl.socketConnect(Native Method)
    at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350)
    at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206)
    at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188)
    at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
    at java.net.Socket.connect(Socket.java:589)
    at org.postgresql.core.PGStream.<init>(PGStream.java:61)
    at org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:110)
    ... 15 more
kjoscha commented 6 years ago

das ist aber ein anderes Issue als das oben (Pringitz), oder? Beim letzten scheint es ja nur ein Problem mit der Pipe zu geben, wie du selbst schreibst.

00Bock commented 6 years ago

das war der Versuch, den MATSim-Starter mit der Prignitz zu starten- also hat schon mit dem Issue zu tun. Mir ist halt noch nie die Pipe abgeschmiert.. aber daran wird es wohl gelegen haben. Ich probiere es bei gelegenheit nochmal.