Closed snoop2head closed 1 year ago
Below is the installation log built and run with dockerfile in the repo.
docker build .
[+] Building 36.3s (4/9)
=> [internal] load build definition from Dockerfile 0.1s
=> => transferring dockerfile: 385B 0.0s
=> [internal] load .dockerignore 0.0s
=> => transferring context: 2B 0.0s
=> [internal] load metadata for docker.io/scmxzhaw/texlive-full:amd64 3.8s
=> [auth] scmxzhaw/texlive-full:pull token for registry-1.docker.io 0.0s
[+] Building 36.4s (4/9)
=> [internal] load build definition from Dockerfile 0.1s
=> => transferring dockerfile: 385B 0.0s
=> [internal] load .dockerignore 0.0s
=> => transferring context: 2B 0.0s
=> [internal] load metadata for docker.io/scmxzhaw/texlive-full:amd64 3.8s
=> [auth] scmxzhaw/texlive-full:pull token for registry-1.docker.io 0.0s
[+] Building 36.6s (4/9)
=> [internal] load build definition from Dockerfile 0.1s
=> => transferring dockerfile: 385B 0.0s
=> [internal] load .dockerignore 0.0s
=> => transferring context: 2B 0.0s
=> [internal] load metadata for docker.io/scmxzhaw/texlive-full:amd64 3.8s
=> [auth] scmxzhaw/texlive-full:pull token for registry-1.docker.io 0.0s
[+] Building 36.8s (4/9)
=> [internal] load build definition from Dockerfile 0.1s
=> => transferring dockerfile: 385B 0.0s
=> [internal] load .dockerignore 0.0s
=> => transferring context: 2B 0.0s
=> [internal] load metadata for docker.io/scmxzhaw/texlive-full:amd64 3.8s
=> [auth] scmxzhaw/texlive-full:pull token for registry-1.docker.io 0.0s
[+] Building 39.2s (4/9)
=> [internal] load build definition from Dockerfile 0.1s
=> => transferring dockerfile: 385B 0.0s
=> [internal] load .dockerignore 0.0s
=> => transferring context: 2B 0.0s
=> [internal] load metadata for docker.io/scmxzhaw/texlive-full:amd64 3.8s
=> [auth] scmxzhaw/texlive-full:pull token for registry-1.docker.io 0.0s
[+] Building 39.4s (4/9)
=> [internal] load build definition from Dockerfile 0.1s
=> => transferring dockerfile: 385B 0.0s
=> [internal] load .dockerignore 0.0s
=> => transferring context: 2B 0.0s
=> [internal] load metadata for docker.io/scmxzhaw/texlive-full:amd64 3.8s
=> [auth] scmxzhaw/texlive-full:pull token for registry-1.docker.io 0.0s
[+] Building 39.5s (4/9)
=> [internal] load build definition from Dockerfile 0.1s
=> => transferring dockerfile: 385B 0.0s
=> [internal] load .dockerignore 0.0s
=> => transferring context: 2B 0.0s
=> [internal] load metadata for docker.io/scmxzhaw/texlive-full:amd64 3.8s
=> [auth] scmxzhaw/texlive-full:pull token for registry-1.docker.io 0.0s
[+] Building 804.6s (5/9)
=> => transferring dockerfile: 385B 0.0s
=> [internal] load .dockerignore 0.0s0
=> => transferring context: 2B 0.0s
=> [internal] load metadata for docker.io/scmxzhaw/texlive-full:amd64 3.8s
=> [auth] scmxzhaw/texlive-full:pull token for registry-1.docker.io 0.0s
=> [1/5] FROM docker.io/scmxzhaw/texlive-full:amd64@sha256:d312d07d943b5d59d5b46414965b563412076a1362b25f362133da3 708.3s
=> => resolve docker.io/scmxzhaw/texlive-full:amd64@sha256:d312d07d943b5d59d5b46414965b563412076a1362b25f362133da32e 0.0s
=> => sha256:d312d07d943b5d59d5b46414965b563412076a1362b25f362133da32e0e87820 743B / 743B 0.0s
=> => sha256:11c3e1d7a9675cd5548d9e412be403b13d906dd7773e2805afae8ab65d7bd49c 1.45kB / 1.45kB 0.0s
=> => sha256:eaead16dc43bb8811d4ff450935d607f9ba4baffda4fc110cc402fa43f601d83[+] Building 804.8s (5/9) d0aa9d14a00471d5e3600fc07e952af8
=> => transferring dockerfile: 385B 0.0sf450935d607f9ba4baffda4fc110cc402
=> [internal] load .dockerignore 0.0s4ad9e19a6882d0aa9d14a00471d5e3600
=> => transferring context: 2B 0.0sthon3.8 pip poppler-utils git
=> [internal] load metadata for docker.io/scmxzhaw/texlive-full:amd64 3.8sage libasan5:amd64.
=> [auth] scmxzhaw/texlive-full:pull token for registry-1.docker.io 0.0s9.4.0-1ubuntu1~20.04.1_amd64.deb
=> [1/5] FROM docker.io/scmxzhaw/texlive-full:amd64@sha256:d312d07d943b5d59d5b46414965b563412076a1362b25f362133da3 708.3sntu1~20.04.1) ...
=> => resolve docker.io/scmxzhaw/texlive-full:amd64@sha256:d312d07d943b5d59d5b46414965b563412076a1362b25f362133da32e 0.0sage liblsan0:amd64.
=> => sha256:d312d07d943b5d59d5b46414965b563412076a1362b25f362133da32e0e87820 743B / 743B 0.0s10.3.0-1ubuntu1~20.04_amd64.deb .
=> => sha256:11c3e1d7a9675cd5548d9e412be403b13d906dd7773e2805afae8ab65d7bd49c 1.45kB / 1.45kB 0.0suntu1~20.04) ...
=> => sha256:eaead16dc43bb8811d4ff450935d607f9ba4baffda4fc110cc402fa43f601d83[+] Building 804.9s (5/9) d0aa9d14a00471d5e3600fc07e952af8
=> => transferring dockerfile: 385B 0.0sf450935d607f9ba4baffda4fc110cc402
=> [internal] load .dockerignore 0.0s4ad9e19a6882d0aa9d14a00471d5e3600
=> => transferring context: 2B 0.0sthon3.8 pip poppler-utils git
=> [internal] load metadata for docker.io/scmxzhaw/texlive-full:amd64 3.8sage libasan5:amd64.
=> [auth] scmxzhaw/texlive-full:pull token for registry-1.docker.io 0.0s9.4.0-1ubuntu1~20.04.1_amd64.deb
=> [1/5] FROM docker.io/scmxzhaw/texlive-full:amd64@sha256:d312d07d943b5d59d5b46414965b563412076a1362b25f362133da3 708.3sntu1~20.04.1) ...
=> => resolve docker.io/scmxzhaw/texlive-full:amd64@sha256:d312d07d943b5d59d5b46414965b563412076a1362b25f362133da32e 0.0sage liblsan0:amd64.
=> => sha256:d312d07d943b5d59d5b46414965b563412076a1362b25f362133da32e0e87820 743B / 743B 0.0s10.3.0-1ubuntu1~20.04_amd64.deb .
=> => sha256:11c3e1d7a9675cd5548d9e412be403b13d906dd7773e2805afae8ab65d7bd49c 1.45kB / 1.45kB 0.0suntu1~20.04) ...
=> => sha256:eaead16dc43bb8811d4ff450935d607f9ba4baffda4fc110cc402fa43f601d83[+] Building 808.8s (5/9) [+] Building 1000.9s (10/10) FINISHED
=> [internal] load build definition from Dockerfile 0.1s
=> => transferring dockerfile: 385B 0.0s
=> [internal] load .dockerignore 0.0s
=> => transferring context: 2B 0.0s
=> [internal] load metadata for docker.io/scmxzhaw/texlive-full:amd64 3.8s
=> [auth] scmxzhaw/texlive-full:pull token for registry-1.docker.io 0.0s
=> [1/5] FROM docker.io/scmxzhaw/texlive-full:amd64@sha256:d312d07d943b5d59d5b46414965b563412076a1362b25f362133da3 708.3s
=> => resolve docker.io/scmxzhaw/texlive-full:amd64@sha256:d312d07d943b5d59d5b46414965b563412076a1362b25f362133da32e 0.0s
=> => sha256:d312d07d943b5d59d5b46414965b563412076a1362b25f362133da32e0e87820 743B / 743B 0.0s
=> => sha256:11c3e1d7a9675cd5548d9e412be403b13d906dd7773e2805afae8ab65d7bd49c 1.45kB / 1.45kB 0.0s
=> => sha256:eaead16dc43bb8811d4ff450935d607f9ba4baffda4fc110cc402fa43f601d83 28.58MB / 28.58MB 3.2s
=> => sha256:c4c543d969e93856d4e14ad9e19a6882d0aa9d14a00471d5e3600fc07e952af8 1.93GB / 1.93GB 220.3s
=> => extracting sha256:eaead16dc43bb8811d4ff450935d607f9ba4baffda4fc110cc402fa43f601d83 9.2s
=> => extracting sha256:c4c543d969e93856d4e14ad9e19a6882d0aa9d14a00471d5e3600fc07e952af8 472.6s
=> [2/5] RUN apt update && apt install -y python3.8 pip poppler-utils git 183.4s
=> [3/5] RUN git clone https://github.com/felix-schmitt/FormulaNet.git 3.4s
=> [4/5] WORKDIR FormulaNet/ 0.2s
=> [5/5] RUN pip install -r requirements.txt 86.7s
=> exporting to image 14.5s
=> => exporting layers 14.5s
=> => writing image
docker run <img-id>
Traceback (most recent call last):
File "./download.py", line 97, in <module>
download("urls.txt")
File "./download.py", line 25, in download
train_pages = load_json(Path("Dataset/train/train_coco.json"))
File "/FormulaNet/utils/tools.py", line 27, in load_json
file = json.load(f)
File "/usr/lib/python3.8/json/__init__.py", line 293, in load
return loads(fp.read(),
File "/usr/lib/python3.8/json/__init__.py", line 357, in loads
return _default_decoder.decode(s)
File "/usr/lib/python3.8/json/decoder.py", line 337, in decode
obj, end = self.raw_decode(s, idx=_w(s, 0).end())
File "/usr/lib/python3.8/json/decoder.py", line 355, in raw_decode
raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
Did you mount the dataset folder with the GT files?
docker run -v ~/
I think the other issue (with the Mac) appears because you use another LaTeX version. We compile the vanilla file because we used color instructions to create the GT. To make sure that with and without color look similar, you have to compile the file with the same LaTeX environment, otherwise, you will get the problem of different pages.
Thank you for the instruction! It seems like Docker option was a must.
Same as #1 #2
System
Error log
Diagnosis
May I know the difference between downloaded 0003025.pdf and compiled vanilla_0003025.pdf from
modified_file
? It seems like 0003025.log shows that it fully compiles 30 pages, but vanilla_0003025.log says it stops at page 20 due to incomplete iffalse.modified_file
variable with downloaded pdf file in the code snippet below? https://github.com/felix-schmitt/FormulaNet/blob/35ca4753164fe07319aaf1539b80258ab7bf7dfa/download.py#L68-L82Logs of 0003025.log and vanilla_0003025.log
Below is the requested log for 0003025.log.
Below is vanilla_0003025.log for your reference