search

jiyuuchc / TrackMate-Lacss

A plugin of a plugin. A cell detector for TrackMate
https://imagej.net/plugins/trackmate/detectors/trackmate-lacss
GNU General Public License v3.0
1 stars 1 forks source link

BUG: Multithread error on initiation #17

Open Nick-Kuang opened 5 months ago

Nick-Kuang commented 5 months ago

Python Side:

LacssDetector: UNKNOWN: Exception calling application: Unable to allocate 2.94 MiB for an array with shape (770000,) and data type float32LacssDetector: DEADLINE_EXCEEDED: deadline exceeded after 89.921922700s. [closed=[], committed=[wait_for_ready, buffered_nanos=22463276300, remote_addr=localhost/127.0.0.1:50051]]LacssDetector: DEADLINE_EXCEEDED: deadline exceeded after 89.921981700s. [closed=[], committed=[wait_for_ready, buffered_nanos=22813444200, remote_addr=localhost/127.0.0.1:50051]]LacssDetector: DEADLINE_EXCEEDED: deadline exceeded after 89.921947100s. [closed=[], committed=[wait_for_ready, buffered_nanos=23386175500, remote_addr=localhost/127.0.0.1:50051]]LacssDetector: DEADLINE_EXCEEDED: deadline exceeded after 89.921939200s. [closed=[], committed=[wait_for_ready, buffered_nanos=22495847300, remote_addr=localhost/127.0.0.1:50051]]LacssDetector: DEADLINE_EXCEEDED: deadline exceeded after 89.921897600s. [closed=[], committed=[wait_for_ready, buffered_nanos=23609353900, remote_addr=localhost/127.0.0.1:50051]]LacssDetector: DEADLINE_EXCEEDED: deadline exceeded after 89.921949000s. [closed=[], committed=[wait_for_ready, buffered_nanos=24893953300, remote_addr=localhost/127.0.0.1:50051]]LacssDetector: DEADLINE_EXCEEDED: deadline exceeded after 89.921951800s. [closed=[], committed=[wait_for_ready, buffered_nanos=24636653100, remote_addr=localhost/127.0.0.1:50051]]LacssDetector: DEADLINE_EXCEEDED: deadline exceeded after 89.921958000s. [closed=[], committed=[wait_for_ready, buffered_nanos=23195343600, remote_addr=localhost/127.0.0.1:50051]]LacssDetector: DEADLINE_EXCEEDED: deadline exceeded after 89.921951900s. [closed=[], committed=[wait_for_ready, buffered_nanos=23831476500, remote_addr=localhost/127.0.0.1:50051]]LacssDetector: DEADLINE_EXCEEDED: deadline exceeded after 89.921933100s. [closed=[], committed=[wait_for_ready, buffered_nanos=22719696900, remote_addr=localhost/127.0.0.1:50051]]LacssDetector: DEADLINE_EXCEEDED: deadline exceeded after 89.941080700s. [closed=[], committed=[wait_for_ready, buffered_nanos=23195337100, remote_addr=localhost/127.0.0.1:50051]]LacssDetector: DEADLINE_EXCEEDED: Deadline ExceededLacssDetector: DEADLINE_EXCEEDED: deadline exceeded after 89.921906800s. [closed=[], committed=[wait_for_ready, buffered_nanos=23624589600, remote_addr=localhost/127.0.0.1:50051]]LacssDetector: DEADLINE_EXCEEDED: deadline exceeded after 89.921931700s. [closed=[], committed=[wait_for_ready, buffered_nanos=23528981200, remote_addr=localhost/127.0.0.1:50051]]LacssDetector: DEADLINE_EXCEEDED: deadline exceeded after 89.921937500s. [closed=[], committed=[wait_for_ready, buffered_nanos=22671754000, remote_addr=localhost/127.0.0.1:50051]]Detection failed after 0 frames: nullFound 0 spots prior failure. null Detection done in 91.4 s. LacssDetector: DEADLINE_EXCEEDED: Deadline Exceeded

From Java Logger:

[INFO] Reading available sites from https://imagej.net/ Mar 28, 2024 10:57:46 AM io.grpc.internal.ManagedChannelOrphanWrapper$ManagedChannelReference cleanQueue SEVERE: ~~~ Previous channel ManagedChannelImpl{logId=7, target=localhost:50051} was not shutdown properly!!! ~~~ Make sure to call shutdown()/shutdownNow() and wait until awaitTermination() returns true. java.lang.RuntimeException: ManagedChannel allocation site at io.grpc.internal.ManagedChannelOrphanWrapper$ManagedChannelReference.(ManagedChannelOrphanWrapper.java:102) at io.grpc.internal.ManagedChannelOrphanWrapper.(ManagedChannelOrphanWrapper.java:60) at io.grpc.internal.ManagedChannelOrphanWrapper.(ManagedChannelOrphanWrapper.java:51) at io.grpc.internal.ManagedChannelImplBuilder.build(ManagedChannelImplBuilder.java:631) at io.grpc.internal.AbstractManagedChannelImplBuilder.build(AbstractManagedChannelImplBuilder.java:297) at fiji.plugin.trackmate.detector.lacss.LacssClient.(LacssClient.java:43) at fiji.plugin.trackmate.detector.lacss.LacssDetectorFactory.getClient(LacssDetectorFactory.java:181) at fiji.plugin.trackmate.detector.lacss.LacssDetectorFactory.getDetector(LacssDetectorFactory.java:216) at fiji.plugin.trackmate.TrackMate$1.call(TrackMate.java:507) at fiji.plugin.trackmate.TrackMate$1.call(TrackMate.java:498) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748)

Mar 28, 2024 10:57:46 AM io.grpc.internal.ManagedChannelOrphanWrapper$ManagedChannelReference cleanQueue SEVERE: ~~~ Previous channel ManagedChannelImpl{logId=12, target=localhost:50051} was not shutdown properly!!! ~~~ Make sure to call shutdown()/shutdownNow() and wait until awaitTermination() returns true. java.lang.RuntimeException: ManagedChannel allocation site at io.grpc.internal.ManagedChannelOrphanWrapper$ManagedChannelReference.(ManagedChannelOrphanWrapper.java:102) at io.grpc.internal.ManagedChannelOrphanWrapper.(ManagedChannelOrphanWrapper.java:60) at io.grpc.internal.ManagedChannelOrphanWrapper.(ManagedChannelOrphanWrapper.java:51) at io.grpc.internal.ManagedChannelImplBuilder.build(ManagedChannelImplBuilder.java:631) at io.grpc.internal.AbstractManagedChannelImplBuilder.build(AbstractManagedChannelImplBuilder.java:297) at fiji.plugin.trackmate.detector.lacss.LacssClient.(LacssClient.java:43) at fiji.plugin.trackmate.detector.lacss.LacssDetectorFactory.getClient(LacssDetectorFactory.java:181) at fiji.plugin.trackmate.detector.lacss.LacssDetectorFactory.getDetector(LacssDetectorFactory.java:216) at fiji.plugin.trackmate.TrackMate$1.call(TrackMate.java:507) at fiji.plugin.trackmate.TrackMate$1.call(TrackMate.java:498) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748)

Mar 28, 2024 10:57:46 AM io.grpc.internal.ManagedChannelOrphanWrapper$ManagedChannelReference cleanQueue SEVERE: ~~~ Previous channel ManagedChannelImpl{logId=16, target=localhost:50051} was not shutdown properly!!! ~~~ Make sure to call shutdown()/shutdownNow() and wait until awaitTermination() returns true. java.lang.RuntimeException: ManagedChannel allocation site at io.grpc.internal.ManagedChannelOrphanWrapper$ManagedChannelReference.(ManagedChannelOrphanWrapper.java:102) at io.grpc.internal.ManagedChannelOrphanWrapper.(ManagedChannelOrphanWrapper.java:60) at io.grpc.internal.ManagedChannelOrphanWrapper.(ManagedChannelOrphanWrapper.java:51) at io.grpc.internal.ManagedChannelImplBuilder.build(ManagedChannelImplBuilder.java:631) at io.grpc.internal.AbstractManagedChannelImplBuilder.build(AbstractManagedChannelImplBuilder.java:297) at fiji.plugin.trackmate.detector.lacss.LacssClient.(LacssClient.java:43) at fiji.plugin.trackmate.detector.lacss.LacssDetectorFactory.getClient(LacssDetectorFactory.java:181) at fiji.plugin.trackmate.detector.lacss.LacssDetectorFactory.getDetector(LacssDetectorFactory.java:216) at fiji.plugin.trackmate.TrackMate$1.call(TrackMate.java:507) at fiji.plugin.trackmate.TrackMate$1.call(TrackMate.java:498) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748)

Mar 28, 2024 10:57:46 AM io.grpc.internal.ManagedChannelOrphanWrapper$ManagedChannelReference cleanQueue SEVERE: ~~~ Previous channel ManagedChannelImpl{logId=9, target=localhost:50051} was not shutdown properly!!! ~~~ Make sure to call shutdown()/shutdownNow() and wait until awaitTermination() returns true. java.lang.RuntimeException: ManagedChannel allocation site at io.grpc.internal.ManagedChannelOrphanWrapper$ManagedChannelReference.(ManagedChannelOrphanWrapper.java:102) at io.grpc.internal.ManagedChannelOrphanWrapper.(ManagedChannelOrphanWrapper.java:60) at io.grpc.internal.ManagedChannelOrphanWrapper.(ManagedChannelOrphanWrapper.java:51) at io.grpc.internal.ManagedChannelImplBuilder.build(ManagedChannelImplBuilder.java:631) at io.grpc.internal.AbstractManagedChannelImplBuilder.build(AbstractManagedChannelImplBuilder.java:297) at fiji.plugin.trackmate.detector.lacss.LacssClient.(LacssClient.java:43) at fiji.plugin.trackmate.detector.lacss.LacssDetectorFactory.getClient(LacssDetectorFactory.java:181) at fiji.plugin.trackmate.detector.lacss.LacssDetectorFactory.getDetector(LacssDetectorFactory.java:216) at fiji.plugin.trackmate.TrackMate$1.call(TrackMate.java:507) at fiji.plugin.trackmate.TrackMate$1.call(TrackMate.java:498) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748)

Mar 28, 2024 10:57:46 AM io.grpc.internal.ManagedChannelOrphanWrapper$ManagedChannelReference cleanQueue SEVERE: ~~~ Previous channel ManagedChannelImpl{logId=2, target=localhost:50051} was not shutdown properly!!! ~~~ Make sure to call shutdown()/shutdownNow() and wait until awaitTermination() returns true. java.lang.RuntimeException: ManagedChannel allocation site at io.grpc.internal.ManagedChannelOrphanWrapper$ManagedChannelReference.(ManagedChannelOrphanWrapper.java:102) at io.grpc.internal.ManagedChannelOrphanWrapper.(ManagedChannelOrphanWrapper.java:60) at io.grpc.internal.ManagedChannelOrphanWrapper.(ManagedChannelOrphanWrapper.java:51) at io.grpc.internal.ManagedChannelImplBuilder.build(ManagedChannelImplBuilder.java:631) at io.grpc.internal.AbstractManagedChannelImplBuilder.build(AbstractManagedChannelImplBuilder.java:297) at fiji.plugin.trackmate.detector.lacss.LacssClient.(LacssClient.java:43) at fiji.plugin.trackmate.detector.lacss.LacssDetectorFactory.getClient(LacssDetectorFactory.java:181) at fiji.plugin.trackmate.detector.lacss.LacssDetectorFactory.getDetector(LacssDetectorFactory.java:216) at fiji.plugin.trackmate.TrackMate$1.call(TrackMate.java:507) at fiji.plugin.trackmate.TrackMate$1.call(TrackMate.java:498) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748)

Mar 28, 2024 10:57:46 AM io.grpc.internal.ManagedChannelOrphanWrapper$ManagedChannelReference cleanQueue SEVERE: ~~~ Previous channel ManagedChannelImpl{logId=15, target=localhost:50051} was not shutdown properly!!! ~~~ Make sure to call shutdown()/shutdownNow() and wait until awaitTermination() returns true. java.lang.RuntimeException: ManagedChannel allocation site at io.grpc.internal.ManagedChannelOrphanWrapper$ManagedChannelReference.(ManagedChannelOrphanWrapper.java:102) at io.grpc.internal.ManagedChannelOrphanWrapper.(ManagedChannelOrphanWrapper.java:60) at io.grpc.internal.ManagedChannelOrphanWrapper.(ManagedChannelOrphanWrapper.java:51) at io.grpc.internal.ManagedChannelImplBuilder.build(ManagedChannelImplBuilder.java:631) at io.grpc.internal.AbstractManagedChannelImplBuilder.build(AbstractManagedChannelImplBuilder.java:297) at fiji.plugin.trackmate.detector.lacss.LacssClient.(LacssClient.java:43) at fiji.plugin.trackmate.detector.lacss.LacssDetectorFactory.getClient(LacssDetectorFactory.java:181) at fiji.plugin.trackmate.detector.lacss.LacssDetectorFactory.getDetector(LacssDetectorFactory.java:216) at fiji.plugin.trackmate.TrackMate$1.call(TrackMate.java:507) at fiji.plugin.trackmate.TrackMate$1.call(TrackMate.java:498) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748)

Mar 28, 2024 10:57:46 AM io.grpc.internal.ManagedChannelOrphanWrapper$ManagedChannelReference cleanQueue SEVERE: ~~~ Previous channel ManagedChannelImpl{logId=13, target=localhost:50051} was not shutdown properly!!! ~~~ Make sure to call shutdown()/shutdownNow() and wait until awaitTermination() returns true. java.lang.RuntimeException: ManagedChannel allocation site at io.grpc.internal.ManagedChannelOrphanWrapper$ManagedChannelReference.(ManagedChannelOrphanWrapper.java:102) at io.grpc.internal.ManagedChannelOrphanWrapper.(ManagedChannelOrphanWrapper.java:60) at io.grpc.internal.ManagedChannelOrphanWrapper.(ManagedChannelOrphanWrapper.java:51) at io.grpc.internal.ManagedChannelImplBuilder.build(ManagedChannelImplBuilder.java:631) at io.grpc.internal.AbstractManagedChannelImplBuilder.build(AbstractManagedChannelImplBuilder.java:297) at fiji.plugin.trackmate.detector.lacss.LacssClient.(LacssClient.java:43) at fiji.plugin.trackmate.detector.lacss.LacssDetectorFactory.getClient(LacssDetectorFactory.java:181) at fiji.plugin.trackmate.detector.lacss.LacssDetectorFactory.getDetector(LacssDetectorFactory.java:216) at fiji.plugin.trackmate.TrackMate$1.call(TrackMate.java:507) at fiji.plugin.trackmate.TrackMate$1.call(TrackMate.java:498) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748)

Mar 28, 2024 10:57:46 AM io.grpc.internal.ManagedChannelOrphanWrapper$ManagedChannelReference cleanQueue SEVERE: ~~~ Previous channel ManagedChannelImpl{logId=6, target=localhost:50051} was not shutdown properly!!! ~~~ Make sure to call shutdown()/shutdownNow() and wait until awaitTermination() returns true. java.lang.RuntimeException: ManagedChannel allocation site at io.grpc.internal.ManagedChannelOrphanWrapper$ManagedChannelReference.(ManagedChannelOrphanWrapper.java:102) at io.grpc.internal.ManagedChannelOrphanWrapper.(ManagedChannelOrphanWrapper.java:60) at io.grpc.internal.ManagedChannelOrphanWrapper.(ManagedChannelOrphanWrapper.java:51) at io.grpc.internal.ManagedChannelImplBuilder.build(ManagedChannelImplBuilder.java:631) at io.grpc.internal.AbstractManagedChannelImplBuilder.build(AbstractManagedChannelImplBuilder.java:297) at fiji.plugin.trackmate.detector.lacss.LacssClient.(LacssClient.java:43) at fiji.plugin.trackmate.detector.lacss.LacssDetectorFactory.getClient(LacssDetectorFactory.java:181) at fiji.plugin.trackmate.detector.lacss.LacssDetectorFactory.getDetector(LacssDetectorFactory.java:216) at fiji.plugin.trackmate.TrackMate$1.call(TrackMate.java:507) at fiji.plugin.trackmate.TrackMate$1.call(TrackMate.java:498) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748)

Mar 28, 2024 10:57:46 AM io.grpc.internal.ManagedChannelOrphanWrapper$ManagedChannelReference cleanQueue SEVERE: ~~~ Previous channel ManagedChannelImpl{logId=3, target=localhost:50051} was not shutdown properly!!! ~~~ Make sure to call shutdown()/shutdownNow() and wait until awaitTermination() returns true. java.lang.RuntimeException: ManagedChannel allocation site at io.grpc.internal.ManagedChannelOrphanWrapper$ManagedChannelReference.(ManagedChannelOrphanWrapper.java:102) at io.grpc.internal.ManagedChannelOrphanWrapper.(ManagedChannelOrphanWrapper.java:60) at io.grpc.internal.ManagedChannelOrphanWrapper.(ManagedChannelOrphanWrapper.java:51) at io.grpc.internal.ManagedChannelImplBuilder.build(ManagedChannelImplBuilder.java:631) at io.grpc.internal.AbstractManagedChannelImplBuilder.build(AbstractManagedChannelImplBuilder.java:297) at fiji.plugin.trackmate.detector.lacss.LacssClient.(LacssClient.java:43) at fiji.plugin.trackmate.detector.lacss.LacssDetectorFactory.getClient(LacssDetectorFactory.java:181) at fiji.plugin.trackmate.detector.lacss.LacssDetectorFactory.getDetector(LacssDetectorFactory.java:216) at fiji.plugin.trackmate.TrackMate$1.call(TrackMate.java:507) at fiji.plugin.trackmate.TrackMate$1.call(TrackMate.java:498) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748)

Mar 28, 2024 10:57:46 AM io.grpc.internal.ManagedChannelOrphanWrapper$ManagedChannelReference cleanQueue SEVERE: ~~~ Previous channel ManagedChannelImpl{logId=14, target=localhost:50051} was not shutdown properly!!! ~~~ Make sure to call shutdown()/shutdownNow() and wait until awaitTermination() returns true. java.lang.RuntimeException: ManagedChannel allocation site at io.grpc.internal.ManagedChannelOrphanWrapper$ManagedChannelReference.(ManagedChannelOrphanWrapper.java:102) at io.grpc.internal.ManagedChannelOrphanWrapper.(ManagedChannelOrphanWrapper.java:60) at io.grpc.internal.ManagedChannelOrphanWrapper.(ManagedChannelOrphanWrapper.java:51) at io.grpc.internal.ManagedChannelImplBuilder.build(ManagedChannelImplBuilder.java:631) at io.grpc.internal.AbstractManagedChannelImplBuilder.build(AbstractManagedChannelImplBuilder.java:297) at fiji.plugin.trackmate.detector.lacss.LacssClient.(LacssClient.java:43) at fiji.plugin.trackmate.detector.lacss.LacssDetectorFactory.getClient(LacssDetectorFactory.java:181) at fiji.plugin.trackmate.detector.lacss.LacssDetectorFactory.getDetector(LacssDetectorFactory.java:216) at fiji.plugin.trackmate.TrackMate$1.call(TrackMate.java:507) at fiji.plugin.trackmate.TrackMate$1.call(TrackMate.java:498) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748)

Mar 28, 2024 10:57:46 AM io.grpc.internal.ManagedChannelOrphanWrapper$ManagedChannelReference cleanQueue SEVERE: ~~~ Previous channel ManagedChannelImpl{logId=5, target=localhost:50051} was not shutdown properly!!! ~~~ Make sure to call shutdown()/shutdownNow() and wait until awaitTermination() returns true. java.lang.RuntimeException: ManagedChannel allocation site at io.grpc.internal.ManagedChannelOrphanWrapper$ManagedChannelReference.(ManagedChannelOrphanWrapper.java:102) at io.grpc.internal.ManagedChannelOrphanWrapper.(ManagedChannelOrphanWrapper.java:60) at io.grpc.internal.ManagedChannelOrphanWrapper.(ManagedChannelOrphanWrapper.java:51) at io.grpc.internal.ManagedChannelImplBuilder.build(ManagedChannelImplBuilder.java:631) at io.grpc.internal.AbstractManagedChannelImplBuilder.build(AbstractManagedChannelImplBuilder.java:297) at fiji.plugin.trackmate.detector.lacss.LacssClient.(LacssClient.java:43) at fiji.plugin.trackmate.detector.lacss.LacssDetectorFactory.getClient(LacssDetectorFactory.java:181) at fiji.plugin.trackmate.detector.lacss.LacssDetectorFactory.getDetector(LacssDetectorFactory.java:216) at fiji.plugin.trackmate.TrackMate$1.call(TrackMate.java:507) at fiji.plugin.trackmate.TrackMate$1.call(TrackMate.java:498) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748)

Mar 28, 2024 10:57:46 AM io.grpc.internal.ManagedChannelOrphanWrapper$ManagedChannelReference cleanQueue SEVERE: ~~~ Previous channel ManagedChannelImpl{logId=11, target=localhost:50051} was not shutdown properly!!! ~~~ Make sure to call shutdown()/shutdownNow() and wait until awaitTermination() returns true. java.lang.RuntimeException: ManagedChannel allocation site at io.grpc.internal.ManagedChannelOrphanWrapper$ManagedChannelReference.(ManagedChannelOrphanWrapper.java:102) at io.grpc.internal.ManagedChannelOrphanWrapper.(ManagedChannelOrphanWrapper.java:60) at io.grpc.internal.ManagedChannelOrphanWrapper.(ManagedChannelOrphanWrapper.java:51) at io.grpc.internal.ManagedChannelImplBuilder.build(ManagedChannelImplBuilder.java:631) at io.grpc.internal.AbstractManagedChannelImplBuilder.build(AbstractManagedChannelImplBuilder.java:297) at fiji.plugin.trackmate.detector.lacss.LacssClient.(LacssClient.java:43) at fiji.plugin.trackmate.detector.lacss.LacssDetectorFactory.getClient(LacssDetectorFactory.java:181) at fiji.plugin.trackmate.detector.lacss.LacssDetectorFactory.getDetector(LacssDetectorFactory.java:216) at fiji.plugin.trackmate.TrackMate$1.call(TrackMate.java:507) at fiji.plugin.trackmate.TrackMate$1.call(TrackMate.java:498) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748)

Mar 28, 2024 10:57:46 AM io.grpc.internal.ManagedChannelOrphanWrapper$ManagedChannelReference cleanQueue SEVERE: ~~~ Previous channel ManagedChannelImpl{logId=8, target=localhost:50051} was not shutdown properly!!! ~~~ Make sure to call shutdown()/shutdownNow() and wait until awaitTermination() returns true. java.lang.RuntimeException: ManagedChannel allocation site at io.grpc.internal.ManagedChannelOrphanWrapper$ManagedChannelReference.(ManagedChannelOrphanWrapper.java:102) at io.grpc.internal.ManagedChannelOrphanWrapper.(ManagedChannelOrphanWrapper.java:60) at io.grpc.internal.ManagedChannelOrphanWrapper.(ManagedChannelOrphanWrapper.java:51) at io.grpc.internal.ManagedChannelImplBuilder.build(ManagedChannelImplBuilder.java:631) at io.grpc.internal.AbstractManagedChannelImplBuilder.build(AbstractManagedChannelImplBuilder.java:297) at fiji.plugin.trackmate.detector.lacss.LacssClient.(LacssClient.java:43) at fiji.plugin.trackmate.detector.lacss.LacssDetectorFactory.getClient(LacssDetectorFactory.java:181) at fiji.plugin.trackmate.detector.lacss.LacssDetectorFactory.getDetector(LacssDetectorFactory.java:216) at fiji.plugin.trackmate.TrackMate$1.call(TrackMate.java:507) at fiji.plugin.trackmate.TrackMate$1.call(TrackMate.java:498) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748)

jiyuuchc commented 5 months ago

Attention: This is an external email. Use caution responding, opening attachments or clicking on links.

The python side showed "DEALINE_EXCEEDED" error. This simply indicated that the java client couldn't receive an answer after certain time limit.

It is curious that the time-out setting is ~90 sec. But the logging also indicated that the computation took 91.4 sec.

Mayber we can increase the time-out limit to see if that makes any difference.

Ji

From: Nick Kuang @.***> Sent: Thursday, March 28, 2024 9:44 PM To: jiyuuchc/TrackMate-Lacss Cc: Subscribed Subject: [jiyuuchc/TrackMate-Lacss] BUG: Multithread error on initiation (Issue #17)

Attention: This is an external email. Use caution responding, opening attachments or clicking on links.

Python Side:

Python

LacssDetector: UNKNOWN: Exception calling application: Unable to allocate 2.94 MiB for an array with shape (770000,) and data type float32LacssDetector: DEADLINE_EXCEEDED: deadline exceeded after 89.921922700s. [closed=[], committed=[wait_for_ready, buffered_nanos=22463276300, remote_addr=localhost/127.0.0.1:50051]]LacssDetector: DEADLINE_EXCEEDED: deadline exceeded after 89.921981700s. [closed=[], committed=[wait_for_ready, buffered_nanos=22813444200, remote_addr=localhost/127.0.0.1:50051]]LacssDetector: DEADLINE_EXCEEDED: deadline exceeded after 89.921947100s. [closed=[], committed=[wait_for_ready, buffered_nanos=23386175500, remote_addr=localhost/127.0.0.1:50051]]LacssDetector: DEADLINE_EXCEEDED: deadline exceeded after 89.921939200s. [closed=[], committed=[wait_for_ready, buffered_nanos=22495847300, remote_addr=localhost/127.0.0.1:50051]]LacssDetector: DEADLINE_EXCEEDED: deadline exceeded after 89.921897600s. [closed=[], committed=[wait_for_ready, buffered_nanos=23609353900, remote_addr=localhost/127.0.0.1:50051]]LacssDetector: DEADLINE_EXCEEDED: deadline exceeded after 89.921949000s. [closed=[], committed=[wait_for_ready, buffered_nanos=24893953300, remote_addr=localhost/127.0.0.1:50051]]LacssDetector: DEADLINE_EXCEEDED: deadline exceeded after 89.921951800s. [closed=[], committed=[wait_for_ready, buffered_nanos=24636653100, remote_addr=localhost/127.0.0.1:50051]]LacssDetector: DEADLINE_EXCEEDED: deadline exceeded after 89.921958000s. [closed=[], committed=[wait_for_ready, buffered_nanos=23195343600, remote_addr=localhost/127.0.0.1:50051]]LacssDetector: DEADLINE_EXCEEDED: deadline exceeded after 89.921951900s. [closed=[], committed=[wait_for_ready, buffered_nanos=23831476500, remote_addr=localhost/127.0.0.1:50051]]LacssDetector: DEADLINE_EXCEEDED: deadline exceeded after 89.921933100s. [closed=[], committed=[wait_for_ready, buffered_nanos=22719696900, remote_addr=localhost/127.0.0.1:50051]]LacssDetector: DEADLINE_EXCEEDED: deadline exceeded after 89.941080700s. [closed=[], committed=[wait_for_ready, buffered_nanos=23195337100, remote_addr=localhost/127.0.0.1:50051]]LacssDetector: DEADLINE_EXCEEDED: Deadline ExceededLacssDetector: DEADLINE_EXCEEDED: deadline exceeded after 89.921906800s. [closed=[], committed=[wait_for_ready, buffered_nanos=23624589600, remote_addr=localhost/127.0.0.1:50051]]LacssDetector: DEADLINE_EXCEEDED: deadline exceeded after 89.921931700s. [closed=[], committed=[wait_for_ready, buffered_nanos=23528981200, remote_addr=localhost/127.0.0.1:50051]]LacssDetector: DEADLINE_EXCEEDED: deadline exceeded after 89.921937500s. [closed=[], committed=[wait_for_ready, buffered_nanos=22671754000, remote_addr=localhost/127.0.0.1:50051]]Detection failed after 0 frames: nullFound 0 spots prior failure. null Detection done in 91.4 s. LacssDetector: DEADLINE_EXCEEDED: Deadline Exceeded

From Java Logger:

Python

[INFO] Reading available sites from https://imagej.net/https://urldefense.com/v3/__https://imagej.net/__;!!Cn_UX_p3!kZV0zcgOG6EUat_ZfMaAmOkLI66koGN6dmXuKtwftE2I1i_ynMjSFDZOzHc0CrWYeZTrIusAOeOEEk40T3HEQg$ Mar 28, 2024 10:57:46 AM io.grpc.internal.ManagedChannelOrphanWrapper$ManagedChannelReference cleanQueue SEVERE: ~ Previous channel ManagedChannelImpl{logId=7, target=localhost:50051} was not shutdown properly!!! ~ Make sure to call shutdown()/shutdownNow() and wait until awaitTermination() returns true. java.lang.RuntimeException: ManagedChannel allocation site at io.grpc.internal.ManagedChannelOrphanWrapper$ManagedChannelReference.(ManagedChannelOrphanWrapper.java:102) at io.grpc.internal.ManagedChannelOrphanWrapper.(ManagedChannelOrphanWrapper.java:60) at io.grpc.internal.ManagedChannelOrphanWrapper.(ManagedChannelOrphanWrapper.java:51) at io.grpc.internal.ManagedChannelImplBuilder.build(ManagedChannelImplBuilder.java:631) at io.grpc.internal.AbstractManagedChannelImplBuilder.build(AbstractManagedChannelImplBuilder.java:297) at fiji.plugin.trackmate.detector.lacss.LacssClient.(LacssClient.java:43) at fiji.plugin.trackmate.detector.lacss.LacssDetectorFactory.getClient(LacssDetectorFactory.java:181) at fiji.plugin.trackmate.detector.lacss.LacssDetectorFactory.getDetector(LacssDetectorFactory.java:216) at fiji.plugin.trackmate.TrackMate$1.call(TrackMate.java:507) at fiji.plugin.trackmate.TrackMate$1.call(TrackMate.java:498) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748)

Mar 28, 2024 10:57:46 AM io.grpc.internal.ManagedChannelOrphanWrapper$ManagedChannelReference cleanQueue SEVERE: ~ Previous channel ManagedChannelImpl{logId=12, target=localhost:50051} was not shutdown properly!!! ~ Make sure to call shutdown()/shutdownNow() and wait until awaitTermination() returns true. java.lang.RuntimeException: ManagedChannel allocation site at io.grpc.internal.ManagedChannelOrphanWrapper$ManagedChannelReference.(ManagedChannelOrphanWrapper.java:102) at io.grpc.internal.ManagedChannelOrphanWrapper.(ManagedChannelOrphanWrapper.java:60) at io.grpc.internal.ManagedChannelOrphanWrapper.(ManagedChannelOrphanWrapper.java:51) at io.grpc.internal.ManagedChannelImplBuilder.build(ManagedChannelImplBuilder.java:631) at io.grpc.internal.AbstractManagedChannelImplBuilder.build(AbstractManagedChannelImplBuilder.java:297) at fiji.plugin.trackmate.detector.lacss.LacssClient.(LacssClient.java:43) at fiji.plugin.trackmate.detector.lacss.LacssDetectorFactory.getClient(LacssDetectorFactory.java:181) at fiji.plugin.trackmate.detector.lacss.LacssDetectorFactory.getDetector(LacssDetectorFactory.java:216) at fiji.plugin.trackmate.TrackMate$1.call(TrackMate.java:507) at fiji.plugin.trackmate.TrackMate$1.call(TrackMate.java:498) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748)

Mar 28, 2024 10:57:46 AM io.grpc.internal.ManagedChannelOrphanWrapper$ManagedChannelReference cleanQueue SEVERE: ~ Previous channel ManagedChannelImpl{logId=16, target=localhost:50051} was not shutdown properly!!! ~ Make sure to call shutdown()/shutdownNow() and wait until awaitTermination() returns true. java.lang.RuntimeException: ManagedChannel allocation site at io.grpc.internal.ManagedChannelOrphanWrapper$ManagedChannelReference.(ManagedChannelOrphanWrapper.java:102) at io.grpc.internal.ManagedChannelOrphanWrapper.(ManagedChannelOrphanWrapper.java:60) at io.grpc.internal.ManagedChannelOrphanWrapper.(ManagedChannelOrphanWrapper.java:51) at io.grpc.internal.ManagedChannelImplBuilder.build(ManagedChannelImplBuilder.java:631) at io.grpc.internal.AbstractManagedChannelImplBuilder.build(AbstractManagedChannelImplBuilder.java:297) at fiji.plugin.trackmate.detector.lacss.LacssClient.(LacssClient.java:43) at fiji.plugin.trackmate.detector.lacss.LacssDetectorFactory.getClient(LacssDetectorFactory.java:181) at fiji.plugin.trackmate.detector.lacss.LacssDetectorFactory.getDetector(LacssDetectorFactory.java:216) at fiji.plugin.trackmate.TrackMate$1.call(TrackMate.java:507) at fiji.plugin.trackmate.TrackMate$1.call(TrackMate.java:498) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748)

Mar 28, 2024 10:57:46 AM io.grpc.internal.ManagedChannelOrphanWrapper$ManagedChannelReference cleanQueue SEVERE: ~ Previous channel ManagedChannelImpl{logId=9, target=localhost:50051} was not shutdown properly!!! ~ Make sure to call shutdown()/shutdownNow() and wait until awaitTermination() returns true. java.lang.RuntimeException: ManagedChannel allocation site at io.grpc.internal.ManagedChannelOrphanWrapper$ManagedChannelReference.(ManagedChannelOrphanWrapper.java:102) at io.grpc.internal.ManagedChannelOrphanWrapper.(ManagedChannelOrphanWrapper.java:60) at io.grpc.internal.ManagedChannelOrphanWrapper.(ManagedChannelOrphanWrapper.java:51) at io.grpc.internal.ManagedChannelImplBuilder.build(ManagedChannelImplBuilder.java:631) at io.grpc.internal.AbstractManagedChannelImplBuilder.build(AbstractManagedChannelImplBuilder.java:297) at fiji.plugin.trackmate.detector.lacss.LacssClient.(LacssClient.java:43) at fiji.plugin.trackmate.detector.lacss.LacssDetectorFactory.getClient(LacssDetectorFactory.java:181) at fiji.plugin.trackmate.detector.lacss.LacssDetectorFactory.getDetector(LacssDetectorFactory.java:216) at fiji.plugin.trackmate.TrackMate$1.call(TrackMate.java:507) at fiji.plugin.trackmate.TrackMate$1.call(TrackMate.java:498) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748)

— Reply to this email directly, view it on GitHubhttps://urldefense.com/v3/__https://github.com/jiyuuchc/TrackMate-Lacss/issues/17__;!!Cn_UX_p3!kZV0zcgOG6EUat_ZfMaAmOkLI66koGN6dmXuKtwftE2I1i_ynMjSFDZOzHc0CrWYeZTrIusAOeOEEk6YatCVpA$, or unsubscribehttps://urldefense.com/v3/__https://github.com/notifications/unsubscribe-auth/AAKRPNRJYDNVAZI45LCIBB3Y2TBO7AVCNFSM6AAAAABFNYI7U2VHI2DSMVQWIX3LMV43ASLTON2WKOZSGIYTINBVGA3DENI__;!!Cn_UX_p3!kZV0zcgOG6EUat_ZfMaAmOkLI66koGN6dmXuKtwftE2I1i_ynMjSFDZOzHc0CrWYeZTrIusAOeOEEk6qOArTVw$. You are receiving this because you are subscribed to this thread.Message ID: @.***>

Nick-Kuang commented 5 months ago

Is there any concern about the error above the deadline_exceeded

LacssDetector: UNKNOWN: Exception calling application: Unable to allocate 2.94 MiB for an array with shape (770000,) and data type float32

jiyuuchc commented 5 months ago

Attention: This is an external email. Use caution responding, opening attachments or clicking on links. Yeah I'm not sure what's the cause of that. At the surface it suggestd out of memory error. But that's very unlikely.

You could try reduce the number of threads and see if this for away.

Ji

From: Nick Kuang @.> Sent: Friday, March 29, 2024 9:40 PM To: jiyuuchc/TrackMate-Lacss @.> Cc: Yu,Ji @.>; Comment @.> Subject: Re: [jiyuuchc/TrackMate-Lacss] BUG: Multithread error on initiation (Issue #17)

Attention: This is an external email. Use caution responding, opening attachments or clicking on links.

Is there any concern about the error above the deadline_exceeded

LacssDetector: UNKNOWN: Exception calling application: Unable to allocate 2.94 MiB for an array with shape (770000,) and data type float32

— Reply to this email directly, view it on GitHubhttps://urldefense.com/v3/__https://github.com/jiyuuchc/TrackMate-Lacss/issues/17*issuecomment-2027864358__;Iw!!Cn_UX_p3!mfJD5jeDsMFLaONiGGnjUafgjQwLXbhw_fxmZEdbgtLlWZtbFuihfck3yZ602OwyitEuZa1gkb2wccDUPJ552g$, or unsubscribehttps://urldefense.com/v3/__https://github.com/notifications/unsubscribe-auth/AAKRPNX4PDNNS6OPSDI2RV3Y2YJXZAVCNFSM6AAAAABFNYI7U2VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDAMRXHA3DIMZVHA__;!!Cn_UX_p3!mfJD5jeDsMFLaONiGGnjUafgjQwLXbhw_fxmZEdbgtLlWZtbFuihfck3yZ602OwyitEuZa1gkb2wccA4Cvyk8Q$. You are receiving this because you commented.Message ID: @.***>

jiyuuchc commented 1 month ago

This should be fixed by commit #60c717

My own testing seems to verify this, although multi-threading bugs are tricky and it is hard to be sure that we no longer have the problem. We should test it a bit more before turning on the multi-thread option in release code.