search

Project-MONAI / monai-deploy

MONAI Deploy aims to become the de-facto standard for developing, packaging, testing, deploying and running medical AI applications in clinical production.
Apache License 2.0
98 stars 22 forks source link

MD Express - Hello World - No dicom list printed with curl - MAPs not getting launched #142

Open chezhia opened 11 months ago

chezhia commented 11 months ago

This issue was previously raised #90, but the suggested solution does not apply/work for me.

In the hello world example, after sending DICOMS to MONAI-Deploy, there is this step in the Readme.md:

> docker container list -a | grep alpine
# locate the container ID and run the following command
> docker logs {CONTAINER ID}
# expect a list of files to be printed
/var/monai/input/1.2.826.0.1.3680043.2.1125.1.19616861412188316212577695277886020/1.2.826.0.1.3680043.2.1125.1.34918616334750294149839565085991567/1.2.826.0.1.3680043.2.1125.1.60545822758941849948931508930806372.dcm.json
/var/monai/input/1.2.826.0.1.3680043.2.1125.1.19616861412188316212577695277886020/1.2.826.0.1.3680043.2.1125.1.34918616334750294149839565085991567/1.2.826.0.1.3680043.2.1125.1.60545822758941849948931508930806372.dcm

But this is the output I am getting:

===Configuring Informatics Gateway===
Informatics Gateway IP Address = 172.29.0.50
Informatics Gateway Port       = 5000
Informatics Gateway AE TItle   = MONAI-DEPLOY
Orthanc IP Address             = 172.29.0.100
Orthanc SCP Port               = 4242

Deleting existing MONAI Deploy AE Title
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100   233    0   233    0     0    749      0 --:--:-- --:--:-- --:--:--   749
{
  "name": "MONAI-DEPLOY",
  "aeTitle": "MONAI-DEPLOY",
  "grouping": "0020,000D",
  "workflows": [],
  "ignoredSopClasses": [],
  "allowedSopClasses": [],
  "timeout": 5,
  "id": "0d450300-5010-4711-9277-2d126fb2b7ca",
  "dateTimeCreated": "2023-09-29T18:20:57.431Z"
}

Deleting existing DICOM Source
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100   151    0   151    0     0   2841      0 --:--:-- --:--:-- --:--:--  2903
{
  "name": "ORTHANC",
  "aeTitle": "ORTHANC",
  "hostIp": "172.29.0.100",
  "id": "aa451300-ee23-4c60-bde3-45afae65c4b5",
  "dateTimeCreated": "2023-09-29T18:20:57.713Z"
}

Deleting existing DICOM Destination
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100   163    0   163    0     0   3664      0 --:--:-- --:--:-- --:--:--  3704
{
  "port": 4242,
  "name": "ORTHANC",
  "aeTitle": "ORTHANC",
  "hostIp": "172.29.0.100",
  "id": "5e2a2299-0cec-4fd4-b415-c892595647de",
  "dateTimeCreated": "2023-09-29T18:20:57.771Z"
}

Adding MONAI Deploy AE Title
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100   287    0   237  100    50    789    166 --:--:-- --:--:-- --:--:--   956
{
  "name": "MONAI-DEPLOY",
  "aeTitle": "MONAI-DEPLOY",
  "grouping": "0020,000D",
  "workflows": [],
  "ignoredSopClasses": [],
  "allowedSopClasses": [],
  "timeout": 5,
  "id": "264fc41b-bf31-4da5-b007-ff97ebe05120",
  "dateTimeCreated": "2023-09-29T19:46:06.5557054Z"
}

Adding DICOM Source
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100   220    0   155  100    65   2893   1213 --:--:-- --:--:-- --:--:--  4150
{
  "name": "ORTHANC",
  "aeTitle": "ORTHANC",
  "hostIp": "172.29.0.100",
  "id": "5a996e53-f217-4539-8733-293aeb947197",
  "dateTimeCreated": "2023-09-29T19:46:06.8520296Z"
}

Adding DICOM Destination
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100   245    0   167  100    78   3318   1549 --:--:-- --:--:-- --:--:--  5000
{
  "port": 4242,
  "name": "ORTHANC",
  "aeTitle": "ORTHANC",
  "hostIp": "172.29.0.100",
  "id": "9eb29248-5cd5-4762-af08-2ca420ba8f82",
  "dateTimeCreated": "2023-09-29T19:46:06.9279751Z"
}

Listing DICOM Sources
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100   153    0   153    0     0   5283      0 --:--:-- --:--:-- --:--:--  5464
[
  {
    "name": "ORTHANC",
    "aeTitle": "ORTHANC",
    "hostIp": "172.29.0.100",
    "id": "5a996e53-f217-4539-8733-293aeb947197",
    "dateTimeCreated": "2023-09-29T19:46:06.852Z"
  }
]

Listing DICOM Destinations
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100   165    0   165    0     0   6224      0 --:--:-- --:--:-- --:--:--  6346
[
  {
    "port": 4242,
    "name": "ORTHANC",
    "aeTitle": "ORTHANC",
    "hostIp": "172.29.0.100",
    "id": "9eb29248-5cd5-4762-af08-2ca420ba8f82",
    "dateTimeCreated": "2023-09-29T19:46:06.927Z"
  }
]

As discussed previously, this is the IGconfig container that is not active anymore. I am running this on a GPU server, so there is no NVIDIA container runtime issue. All my other containers show healthy status and the logs do not seem to show any obvious errors:

image

But, I think none of the MAP containers that are in the workflow definition are getting launched. I tried the Hello-world and Liver Tumor segmentation MAP - no segmentation output was received by ORTHANC, can someone help debug - please!

bluna301 commented 3 months ago

I am also experiencing this exact same error. The Informatics Gateway Config container is not active, and when I run the container in Docker Desktop, it will exit in less than 1 second. I have been trying to execute the Hello World and AI Liver Segmentation MAP examples.

I am able to upload the MONAI provided DICOM datasets to Orthanc, deploy workflow definitions for the alpine and AI Liver Segmentation MAP container images in the command line, and Send to DICOM Modality --> MONAI DEPLOY in Orthanc. The job indicates that it has run successfully in Orthanc - however, the job completes much faster than the 90 seconds indicated by the README (the example below completed in just under 10 seconds):

Screenshot 2024-06-05 at 10 08 07

After the workflows complete, I get the same output as the comment above for the Hello World case. For the AI Liver Segmentation MAP case, executing docker container list -a | grep monai_ai_livertumor_seg_app does not recognize any Docker containers (Docker Desktop does not indicate this container is running). I would concur that it seems like the MAP container is not getting launched after the workflow is completed.

Happy to provide any relevant mdl container logs to help debug, thank you!

mocsharp commented 3 months ago

@bluna301 what version of MDE are you using? It would be great if you can attach docker compose logs. Thanks.

bluna301 commented 3 months ago

@mocsharp - I am using the latest version of MDE (0.5.0).

Please find the docker compose logs attached: mde.log

Please let me know if I can provide any additional information - thank you for your help.