search

virtualcell / vcell

Virtual Cell Framework
http://vcell.org/
Other
66 stars 20 forks source link

VCell image fails in RunBioSimulations #96

Closed jonrkarr closed 2 years ago

jonrkarr commented 2 years ago

Some VCell simulations are failing in RunBioSimulations. See errors below. The reason may because of differences in permissions when the Docker image is converted to Singularity. I also say this because the VCell Docker image has to run as root to succeed, which is odd and not recommended.

Archive: https://run.api.biosimulations.dev/run/615223ccdfce8ba2a94da2c0/download

=============Downloading Combine Archive=============
--2021-09-27 16:04:32--  https://run.api.biosimulations.dev/run/615223ccdfce8ba2a94da2c0/download
Resolving run.api.biosimulations.dev (run.api.biosimulations.dev)... 34.123.157.17
Connecting to run.api.biosimulations.dev (run.api.biosimulations.dev)|34.123.157.17|:443... connected.
HTTP request sent, awaiting response... 302 Found
Location: https://github.com/biosimulators/Biosimulators_test_suite/raw/deploy/examples/sbml-core/Ciliberto-J-Cell-Biol-2003-morphogenesis-checkpoint-continuous.omex [following]
--2021-09-27 16:04:32--  https://github.com/biosimulators/Biosimulators_test_suite/raw/deploy/examples/sbml-core/Ciliberto-J-Cell-Biol-2003-morphogenesis-checkpoint-continuous.omex
Resolving github.com (github.com)... 140.82.112.3
Connecting to github.com (github.com)|140.82.112.3|:443... connected.
HTTP request sent, awaiting response... 302 Found
Location: https://raw.githubusercontent.com/biosimulators/Biosimulators_test_suite/deploy/examples/sbml-core/Ciliberto-J-Cell-Biol-2003-morphogenesis-checkpoint-continuous.omex [following]
--2021-09-27 16:04:32--  https://raw.githubusercontent.com/biosimulators/Biosimulators_test_suite/deploy/examples/sbml-core/Ciliberto-J-Cell-Biol-2003-morphogenesis-checkpoint-continuous.omex
Resolving raw.githubusercontent.com (raw.githubusercontent.com)... 185.199.109.133, 185.199.110.133, 185.199.111.133, ...
Connecting to raw.githubusercontent.com (raw.githubusercontent.com)|185.199.109.133|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 339789 (332K) [application/octet-stream]
Saving to: 'input.omex'

 0% [                                       ] 0           --.-K/s              
100%[======================================>] 339,789     --.-K/s   in 0.02s   

2021-09-27 16:04:32 (17.1 MB/s) - 'input.omex' saved [339789/339789]

=============Running docker image for simulator=============
INFO:    Converting OCI blobs to SIF format
INFO:    Starting build...
Getting image source signatures
Copying blob sha256:35807b77a593c1147d13dc926a91dcc3015616ff7307cc30442c5a8e07546283
Copying blob sha256:1ea345a3420b311b7e5b33ca70778c5a4a9e1cfc64d33d722aa0fc9738a94755
Copying blob sha256:fbec0a7276c86e4dcc4f3a53a6fbffb4c01f2ef0ff9976e26058ef4d0b72d7d5
Copying blob sha256:7e491ebc40a9033afb6188a85b10da994b54bcc000c66181da58cf14f9e7f04d
Copying blob sha256:b0f52edfda09129f74b21a90d333133607b574f9cfeea66502d249490457ca79
Copying blob sha256:e00ea4a99c2d0cb496c97e92d244d35c64f5ebc04c7cbcfe5d6cdaf7851c2338
Copying blob sha256:b5157506e16ffa5db41bb5aa006d8502aca886537a6b8acc3e66d4d83cca939f
Copying blob sha256:f2ef1aff7661580090885c1f737f80696af6e320d5928374c0e3f25b82437c95
Copying config sha256:c7bad60a21b503da79a338838f44e19beb1389a00bc91d7b087bcd9f429fe2ce
Writing manifest to image destination
Storing signatures
2021/09/27 16:04:39  info unpack layer: sha256:35807b77a593c1147d13dc926a91dcc3015616ff7307cc30442c5a8e07546283
2021/09/27 16:04:40  info unpack layer: sha256:1ea345a3420b311b7e5b33ca70778c5a4a9e1cfc64d33d722aa0fc9738a94755
2021/09/27 16:04:52  info unpack layer: sha256:fbec0a7276c86e4dcc4f3a53a6fbffb4c01f2ef0ff9976e26058ef4d0b72d7d5
2021/09/27 16:04:54  info unpack layer: sha256:7e491ebc40a9033afb6188a85b10da994b54bcc000c66181da58cf14f9e7f04d
2021/09/27 16:04:54  info unpack layer: sha256:b0f52edfda09129f74b21a90d333133607b574f9cfeea66502d249490457ca79
2021/09/27 16:05:01  info unpack layer: sha256:e00ea4a99c2d0cb496c97e92d244d35c64f5ebc04c7cbcfe5d6cdaf7851c2338
2021/09/27 16:05:02  info unpack layer: sha256:b5157506e16ffa5db41bb5aa006d8502aca886537a6b8acc3e66d4d83cca939f
2021/09/27 16:05:02  info unpack layer: sha256:f2ef1aff7661580090885c1f737f80696af6e320d5928374c0e3f25b82437c95
INFO:    Creating SIF file...
VCell CLI input archive /root/input.omex
/usr/lib/jvm/java-8-openjdk-amd64/jre/lib/rt.jar: error reading zip file
/usr/lib/jvm/java-8-openjdk-amd64/jre/lib/rt.jar: error reading zip file
null/usr/lib/jvm/java-8-openjdk-amd64/jre/lib/rt.jar: error reading zip file
pure virtual method called
terminate called without an active exception
/usr/local/app/vcell/installDir/docker_run.sh: line 32: 1946759 Aborted                 java -classpath '/usr/local/app/vcell/lib/*' -Dvcell.installDir=/usr/local/app/vcell/installDir -Dvcell.server.id="7.3.0.16" -Dvcell.cli="true" -Dvcell.python.executable=/usr/bin/python3 -Dvcell.mongodb.database="localhost" -Dvcell.mongodb.host.internal="localhost" -Dvcell.mongodb.port.internal=27017 org.vcell.cli.CLIStandalone "$@"
srun: error: xanadu-55: task 0: Exited with exit code 134
srun: Terminating job step 3371943.1
=============Uploading results to data-service=============
ERROR 2021-09-27 16:08:11,198 hsload.py:293 Error opening file reports.h5: Unable to open file (unable to open file: name = 'reports.h5', errno = 2, error message = 'No such file or directory', flags = 0, o_flags = 0)
srun: error: xanadu-55: task 0: Exited with exit code 1
srun: Terminating job step 3371943.2
=============Creating output archive=============
    zip warning: name not matched: reports.h5
    zip warning: name not matched: log.yml
    zip warning: name not matched: plots.zip
  adding: job.output (deflated 66%)
=============Uploading outputs to storage=============
Completed 1.9 KiB/7.1 KiB (70.8 KiB/s) with 2 file(s) remaining
upload: ./615223ccdfce8ba2a94da2c0.zip to s3://biosimdev/simulations/615223ccdfce8ba2a94da2c0/615223ccdfce8ba2a94da2c0.zip
Completed 1.9 KiB/7.1 KiB (70.8 KiB/s) with 1 file(s) remaining
Completed 7.1 KiB/7.1 KiB (174.0 KiB/s) with 1 file(s) remaining
upload: ./job.output to s3://biosimdev/simulations/615223ccdfce8ba2a94da2c0/job.output
=============Run Complete. Thank you for using BioSimulations!=============

Archive: https://run.api.biosimulations.dev/run/615223d7fd47f20ea92a9207/download

=============Downloading Combine Archive=============
--2021-09-27 16:04:41--  https://run.api.biosimulations.dev/run/615223d7fd47f20ea92a9207/download
Resolving run.api.biosimulations.dev (run.api.biosimulations.dev)... 34.123.157.17
Connecting to run.api.biosimulations.dev (run.api.biosimulations.dev)|34.123.157.17|:443... connected.
HTTP request sent, awaiting response... 302 Found
Location: https://github.com/biosimulators/Biosimulators_test_suite/raw/deploy/examples/sbml-core/Elowitz-Nature-2000-Repressilator.omex [following]
--2021-09-27 16:04:41--  https://github.com/biosimulators/Biosimulators_test_suite/raw/deploy/examples/sbml-core/Elowitz-Nature-2000-Repressilator.omex
Resolving github.com (github.com)... 140.82.112.3
Connecting to github.com (github.com)|140.82.112.3|:443... connected.
HTTP request sent, awaiting response... 302 Found
Location: https://raw.githubusercontent.com/biosimulators/Biosimulators_test_suite/deploy/examples/sbml-core/Elowitz-Nature-2000-Repressilator.omex [following]
--2021-09-27 16:04:41--  https://raw.githubusercontent.com/biosimulators/Biosimulators_test_suite/deploy/examples/sbml-core/Elowitz-Nature-2000-Repressilator.omex
Resolving raw.githubusercontent.com (raw.githubusercontent.com)... 185.199.108.133, 185.199.109.133, 185.199.110.133, ...
Connecting to raw.githubusercontent.com (raw.githubusercontent.com)|185.199.108.133|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 216849 (212K) [application/octet-stream]
Saving to: 'input.omex'

 0% [                                       ] 0           --.-K/s              
100%[======================================>] 216,849     --.-K/s   in 0.01s   

2021-09-27 16:04:41 (13.9 MB/s) - 'input.omex' saved [216849/216849]

=============Running docker image for simulator=============
INFO:    Converting OCI blobs to SIF format
INFO:    Starting build...
Getting image source signatures
Copying blob sha256:35807b77a593c1147d13dc926a91dcc3015616ff7307cc30442c5a8e07546283
Copying blob sha256:1ea345a3420b311b7e5b33ca70778c5a4a9e1cfc64d33d722aa0fc9738a94755
Copying blob sha256:fbec0a7276c86e4dcc4f3a53a6fbffb4c01f2ef0ff9976e26058ef4d0b72d7d5
Copying blob sha256:7e491ebc40a9033afb6188a85b10da994b54bcc000c66181da58cf14f9e7f04d
Copying blob sha256:b0f52edfda09129f74b21a90d333133607b574f9cfeea66502d249490457ca79
Copying blob sha256:e00ea4a99c2d0cb496c97e92d244d35c64f5ebc04c7cbcfe5d6cdaf7851c2338
Copying blob sha256:b5157506e16ffa5db41bb5aa006d8502aca886537a6b8acc3e66d4d83cca939f
Copying blob sha256:f2ef1aff7661580090885c1f737f80696af6e320d5928374c0e3f25b82437c95
Copying config sha256:c7bad60a21b503da79a338838f44e19beb1389a00bc91d7b087bcd9f429fe2ce
Writing manifest to image destination
Storing signatures
2021/09/27 16:04:48  info unpack layer: sha256:35807b77a593c1147d13dc926a91dcc3015616ff7307cc30442c5a8e07546283
2021/09/27 16:04:49  info unpack layer: sha256:1ea345a3420b311b7e5b33ca70778c5a4a9e1cfc64d33d722aa0fc9738a94755
2021/09/27 16:04:59  info unpack layer: sha256:fbec0a7276c86e4dcc4f3a53a6fbffb4c01f2ef0ff9976e26058ef4d0b72d7d5
2021/09/27 16:05:01  info unpack layer: sha256:7e491ebc40a9033afb6188a85b10da994b54bcc000c66181da58cf14f9e7f04d
2021/09/27 16:05:01  info unpack layer: sha256:b0f52edfda09129f74b21a90d333133607b574f9cfeea66502d249490457ca79
2021/09/27 16:05:07  info unpack layer: sha256:e00ea4a99c2d0cb496c97e92d244d35c64f5ebc04c7cbcfe5d6cdaf7851c2338
2021/09/27 16:05:08  info unpack layer: sha256:b5157506e16ffa5db41bb5aa006d8502aca886537a6b8acc3e66d4d83cca939f
2021/09/27 16:05:09  info unpack layer: sha256:f2ef1aff7661580090885c1f737f80696af6e320d5928374c0e3f25b82437c95
INFO:    Creating SIF file...
java: error while loading shared libraries: /lib/x86_64-linux-gnu/libz.so.1: cannot read file data: Input/output error
srun: error: xanadu-56: task 0: Exited with exit code 127
srun: Terminating job step 3371955.1
=============Uploading results to data-service=============
ERROR 2021-09-27 16:08:07,339 hsload.py:293 Error opening file reports.h5: Unable to open file (unable to open file: name = 'reports.h5', errno = 2, error message = 'No such file or directory', flags = 0, o_flags = 0)
srun: error: xanadu-56: task 0: Exited with exit code 1
srun: Terminating job step 3371955.2
=============Creating output archive=============
    zip warning: name not matched: reports.h5
    zip warning: name not matched: log.yml
    zip warning: name not matched: plots.zip
  adding: job.output (deflated 66%)
=============Uploading outputs to storage=============
Completed 1.6 KiB/6.1 KiB (62.7 KiB/s) with 2 file(s) remaining
upload: ./615223d7fd47f20ea92a9207.zip to s3://biosimdev/simulations/615223d7fd47f20ea92a9207/615223d7fd47f20ea92a9207.zip
Completed 1.6 KiB/6.1 KiB (62.7 KiB/s) with 1 file(s) remaining
Completed 6.1 KiB/6.1 KiB (122.1 KiB/s) with 1 file(s) remaining
upload: ./job.output to s3://biosimdev/simulations/615223d7fd47f20ea92a9207/job.output
=============Run Complete. Thank you for using BioSimulations!=============
moraru commented 2 years ago

@jonrkarr @bilalshaikh42 I cannot reproduce this error; see below running on exact same node same file from scratch (pulling and converting docker image to singularity) as unprivileged user

[moraru@xanadu-55 Thu Oct 14 01:53:12 ~] $ [moraru@xanadu-55 Thu Oct 14 01:53:13 ~] $ id uid=10000(moraru) gid=10000(domain users) groups=10000(domain users),10028(ccam faculty),10034(nanomedicine),10040(vpnusers),10045(linuxadmins),10047(bioinfsudoers),10069(wolanskylab),11000(developers) [moraru@xanadu-55 Thu Oct 14 01:53:16 ~] $ mkdir /tmp/bs [moraru@xanadu-55 Thu Oct 14 01:53:24 ~] $ wget https://github.com/biosimulators/Biosimulators_test_suite/raw/deploy/examples/sbml-core/Ciliberto-J-Cell-Biol-2003-morphogenesis-checkpoint-continuous.omex -O /tmp/bs/test.omex > /dev/null 2>&1 [moraru@xanadu-55 Thu Oct 14 01:53:31 ~] $ singularity build /tmp/bs/test.sif docker://ghcr.io/virtualcell/biosimulators_vcell:latest INFO: Starting build... Getting image source signatures Copying blob f3ef4ff62e0d skipped: already exists Copying blob db6520416b5b skipped: already exists Copying blob 2b1cf43f1aca skipped: already exists Copying blob a7a19cefd2da skipped: already exists Copying blob b2be7d7597bd skipped: already exists Copying blob 57a84e7d9de6 skipped: already exists Copying blob bd6065641e85 skipped: already exists Copying blob bb7dc101a8eb [--------------------------------------] 0.0b / 0.0b Copying config 493ad142c4 done Writing manifest to image destination Storing signatures 2021/10/14 01:53:49 info unpack layer: sha256:f3ef4ff62e0da0ef761ec1c8a578f3035bef51043e53ae1b13a20b3e03726d17 2021/10/14 01:53:50 info unpack layer: sha256:db6520416b5be84bcb9fb875a4a4930dea0630c468782bc2c6a822ef02dbf65b 2021/10/14 01:54:00 info unpack layer: sha256:2b1cf43f1aca1204c8f2f9ea1d9dc6ba3de9535e6c98613122a97f70d4470035 2021/10/14 01:54:01 info unpack layer: sha256:a7a19cefd2da2239e178851824b08cc6ad403c0d19e426474e47005afe9a54f1 2021/10/14 01:54:01 info unpack layer: sha256:b2be7d7597bd44e48dbe666941711b23b2fc1f3a483aff8e39413ee9af42c980 2021/10/14 01:54:08 info unpack layer: sha256:57a84e7d9de6ff14d5fa7d33e7a90b67cabffd735d3806d75f657fb9f5cf5887 2021/10/14 01:54:08 info unpack layer: sha256:bd6065641e85ecc6c61cbb3ad5c085bb76224543cdfd6b0adb5c6b2a7b4437ae 2021/10/14 01:54:09 info unpack layer: sha256:bb7dc101a8ebe8c3ea62d9b1af3d8cd103029c898168fea405b62823633c2b14 INFO: Creating SIF file... INFO: Build complete: /tmp/bs/test.sif [moraru@xanadu-55 Thu Oct 14 01:54:18 ~] $ singularity run /tmp/bs/test.sif -i /tmp/bs/test.omex -o /tmp/bs > /dev/null 2>&1 [moraru@xanadu-55 Thu Oct 14 01:55:06 ~] $ ls -al /tmp/bs total 670480 drwxr-xr-x 3 moraru domain users 150 Oct 14 01:55 . drwxrwxrwt 112 root root 8192 Oct 14 01:55 .. -rw-r--r-- 1 moraru domain users 7994 Oct 14 01:55 log.json -rw-r--r-- 1 moraru domain users 2895 Oct 14 01:55 log.yml -rw-r--r-- 1 moraru domain users 43550 Oct 14 01:55 plots.zip -rw-r--r-- 1 moraru domain users 108848 Oct 14 01:55 reports.h5 -rw-r--r-- 1 moraru domain users 67828 Oct 14 01:55 reports.zip drwxr-xr-x 2 moraru domain users 192 Oct 14 01:55 simulation_1.sedml -rw-r--r-- 1 moraru domain users 339796 Oct 14 01:53 test.omex -rwxr-xr-x 1 moraru domain users 685961216 Oct 14 01:54 test.sif [moraru@xanadu-55 Thu Oct 14 01:55:33 ~] $

moraru commented 2 years ago

Perhaps there was an issue with that particular version of the simulator? @bilalshaikh42 @jonrkarr can you provide an example with the current version?

jonrkarr commented 2 years ago

The warnings in the latest run seems fine to me -- just extra reports for plots. I'll push the new version to RunBioSimulations and see if I can replicate it there.

jonrkarr commented 2 years ago

I think this replicates the problems directly with the Docker image.

Fehlberg (KISAO_0000086) can be run from alternate working directory, but CVODE (KISAO_0000019) cannot

This works (KISAO_0000086)

docker run -it --rm \
    --mount type=bind,source=$(pwd),target=/home/Biosimulators_test_suite \
   --workdir /home/Biosimulators_test_suite \
   --user 0 \
   ghcr.io/virtualcell/biosimulators_vcell:7.4.0.23 \
        -i examples/sbml-core/Ciliberto-J-Cell-Biol-2003-morphogenesis-checkpoint-Fehlberg.omex \
        -o out

But this does not (KISAO_0000019)

docker run -it --rm \
    --mount type=bind,source=$(pwd),target=/home/Biosimulators_test_suite \
   --workdir /home/Biosimulators_test_suite \
   --user 0 \
   ghcr.io/virtualcell/biosimulators_vcell:7.4.0.23 \
        -i examples/sbml-core/Ciliberto-J-Cell-Biol-2003-morphogenesis-checkpoint-continuous.omex \
        -o out

CVODE can be run from the default working directory, but not from other directories

As described above, CVODE doesn't work from an alternate working directory. But CVODE does work from the default one, as illustrated below.

docker run -it --rm \
    --mount type=bind,source=$(pwd),target=/home/Biosimulators_test_suite \
    --user 0 \
    ghcr.io/virtualcell/biosimulators_vcell:7.4.0.23 \
        -i /home/Biosimulators_test_suite/examples/sbml-core/Ciliberto-J-Cell-Biol-2003-morphogenesis-checkpoint-continuous.omex \
        -o /home/Biosimulators_test_suite/out

CVODE fails when run as a non-root user (1000, rather than 0)

Changing the user to 1000, causes VCell to fail

docker run -it --rm \
    --mount type=bind,source=$(pwd),target=/home/Biosimulators_test_suite \
    --user 1000 \
    ghcr.io/virtualcell/biosimulators_vcell:7.4.0.23 \
        -i /home/Biosimulators_test_suite/examples/sbml-core/Ciliberto-J-Cell-Biol-2003-morphogenesis-checkpoint-continuous.omex \
        -o /home/Biosimulators_test_suite/out
jonrkarr commented 2 years ago

Note, runBioSimulations doesn't change the working directory. I included that example in case its helpful to tracing the issue.

Because CVODE fails when Fehlberg works, I suspect this has to due to the library needed for CVODE. It seems like a packaging issue, and probably isn't an issue with the VCell Java code issue.

moraru commented 2 years ago

I dunno, it works for me with solver CVODE, with alternate dir, and with non-root user...

See below:

[vcell@vcell-node3 ~ 24] $ docker run -it --rm --mount type=bind,source=/tmp,target=/tmp --workdir /tmp/bs --user 10001 ghcr.io/virtualcell/biosimulators_vcell:7.4.0.23 -i /tmp/bs/Ciliberto-J-Cell-Biol-2003-morphogenesis-checkpoint-continuous.omex -o /tmp/bs Oct 14, 2021 11:02:23 PM java.util.prefs.FileSystemPreferences$1 run INFO: Created user preferences directory. VCell CLI input archive /tmp/bs/Ciliberto-J-Cell-Biol-2003-morphogenesis-checkpoint-continuous.omex

[[[SNIP]]] Archiving resultant PDF files to plots.zip. Archiving resultant CSV files to reports.zip. [vcell@vcell-node3 ~ 25] $ [vcell@vcell-node3 ~ 25] $ [vcell@vcell-node3 ~ 25] $ ls -al /tmp/bs/ total 604 drwxr-xr-x 4 vcell root 33 Oct 14 19:02 ? drwxr-xr-x 4 vcell domain users 264 Oct 14 19:02 . drwxrwxrwt. 64 root root 4096 Oct 14 19:03 .. -rw-r--r-- 1 vcell domain users 339796 Oct 14 18:52 Ciliberto-J-Cell-Biol-2003-morphogenesis-checkpoint-continuous.omex -rw-r--r-- 1 vcell root 7994 Oct 14 19:02 log.json -rw-r--r-- 1 vcell root 2895 Oct 14 19:02 log.yml -rw-r--r-- 1 vcell root 43528 Oct 14 19:02 plots.zip -rw-r--r-- 1 vcell root 108848 Oct 14 19:02 reports.h5 -rw-r--r-- 1 vcell root 67828 Oct 14 19:02 reports.zip drwxr-xr-x 2 vcell root 192 Oct 14 19:02 simulation_1.sedml -rw-r--r-- 1 vcell root 374 Oct 14 19:02 stdOut.txt -rw-r--r-- 1 vcell root 8786 Oct 14 19:02 temp16342525438469308861804289383.tmp

jonrkarr commented 2 years ago

Hmm ... I used Linux. Did you use Windows?

moraru commented 2 years ago

[vcell@vcell-node3 ~ 1] $ cat /etc/redhat-release CentOS Linux release 7.4.1708 (Core)

moraru commented 2 years ago

Is it possible that you have somehow overlayed /usr/local? The difference between RKF and CVODE is that RKF is a Java solver while CVODE is a compiled solver (as are most of other VCell solvers, the Java ones are few and rarely used). All compiled solvers are running as a shell process spawned of by an Executable instance in Java and depend on /usr/local/app inside the container. (btw, shell spawning in itself must be working fine since it is also used to run the python code that does the hdf5 conversion and pdf generation, including for the Java solvers like RKF)

jonrkarr commented 2 years ago

I ran the previously failing simulation with VCell in runBioSimulations. The run succeeded. I guess you fixed the issue.

I ran VCell on my Ubuntu machine exactly as above.

moraru commented 2 years ago

I am a bit confused - I did not change anything, still the same ghcr.io/virtualcell/biosimulators_vcell:7.4.0.23 container out there.

Is it now somehow running OK on both runBioSimulations and your Ubuntu machine or is it still failing on your Ubuntu machine as above if non-root and/or alternate dir?

jonrkarr commented 2 years ago

It didn't work in my machine with Docker. I didn't try on my machine with Singularity.

It seemed to work in RunBioSimulations with Singularity.

moraru commented 2 years ago

Got it.

It is good that it does not create an issue with runBioSimulations.

But I think we eventually have figure out why it works on my Linux machine with Docker but it does not work on your Linux machine with Docker. If a user downloads the image for independent use it looks like it may or not work depending on their environment. This should not be that way, it defeats the purpose of containerization...

I'll keep the issue open.

jonrkarr commented 2 years ago

@bilalshaikh42 could you try my Docker commands above in your linux environment?