Data Generation is struck at the first sample.

hassan-mahmood / TIES_DataGeneration

Dataset Generation Code for: S.R. Qasim, H. Mahmood, and F. Shafait, Rethinking Table Parsing using Graph Neural Networks (2019)

MIT License

118 stars 39 forks source link

Data Generation is struck at the first sample. #14

Open ashish-kubade opened 4 years ago

ashish-kubade commented 4 years ago

I am not able to generate data samples. The code is not moving from first sample. Screen Attached. I am using following parameters: python generate_data.py --filesize 1 --threads 1 --outpath . --imagespath ~/Downloads/UNLV_dataset/unlv_images/ --ocrpath ~/Downloads/UNLV_dataset/unlv_xml_ocr/ --tablepath ~/Downloads/UNLV_dataset/unlv_xml_gt/ --visualizeimgs 1 --visualizebboxes 1 System specifications: TF: 2.0 RAM: 8GM ( I think for data preparation this should suffice) GPU: GForec: 920Mx: 2GB VRAM Could you please have a look?

TIA.

ReikoMin commented 3 years ago

I would like to ask, you have solved this problem, I also met the same problem

wangxupeng commented 3 years ago

you need use right the python enviroment

absl-py==0.10.0

astunparse==1.6.3

cachetools==4.1.1

certifi==2020.6.20

chardet==3.0.4

cycler==0.10.0

decorator==4.4.2

gast==0.3.3

google-auth==1.20.1

google-auth-oauthlib==0.4.1

google-pasta==0.2.0

grpcio==1.31.0

h5py==2.10.0

idna==2.10

imageio==2.9.0

importlib-metadata==1.7.0

Keras-Preprocessing==1.1.2

kiwisolver==1.2.0

Markdown==3.2.2

matplotlib==3.3.1

networkx==2.5

numpy==1.18.5

oauthlib==3.1.0

opencv-python==4.4.0.42

opt-einsum==3.3.0

Pillow==7.2.0

protobuf==3.13.0

pyasn1==0.4.8

pyasn1-modules==0.2.8

pyparsing==2.4.7

python-dateutil==2.8.1

PyWavelets==1.1.1

requests==2.24.0

requests-oauthlib==1.3.0

rsa==4.6

scikit-image==0.17.2

scipy==1.4.1

selenium==3.141.0

six==1.15.0

tensorboard==2.3.0

tensorboard-plugin-wit==1.7.0

tensorflow==2.3.0

tensorflow-estimator==2.3.0

termcolor==1.1.0

tifffile==2020.8.25

tqdm==4.48.2

urllib3==1.25.10

Werkzeug==1.0.1

wrapt==1.12.1

zipp==3.1.0

ReikoMin commented 3 years ago

@wangxupeng After you modify the environment, the problem is solved, right? I will try it. Thank you

linhuaiyi commented 3 years ago

I found the code crashed when generate category 4 I go into the Transform(im, bboxes, shearval, rotval, self.max_width, self.max_height) function in GenerateTFRecord.py It seems like the wrong type of img make the transform.warp(img, inverse_map=afine_tf) crashed so i modified to transform.warp(np.array(img), inverse_map=afine_tf) and it works well now. @ReikoMin @ashj9

LiuShiChen-Chn commented 4 months ago

@linhuaiyi @ReikoMin @wangxupeng @ashj9 Please, my recent research problem requires the use of this repository (TIES_DataGeneration), I see you all run the code, but the link to the UNLV dataset required by the repository is no longer valid, can you give me a copy of the dataset, or tell me where I can download it? Urgent, thanks for reply!