search

jrzaurin / pytorch-widedeep

A flexible package for multimodal-deep-learning to combine tabular data with text and images using Wide and Deep models in Pytorch
Apache License 2.0
1.3k stars 190 forks source link

error #221

Closed xylovezxy closed 3 months ago

xylovezxy commented 4 months ago

image Hello, this error occurs when I run my notebook. Kernel crashes when executing code in the current or previous cell.May I ask why this is happening？

jrzaurin commented 4 months ago

Hey @xylovezxy

can you please provide a more complete piece of code and the error in English?

Cheers!

xylovezxy commented 4 months ago

The red error is: Kernel crashes when executing code in the current or previous cell. Please review the code in the cell to determine the possible cause of the malfunction.

I have successfully run both the text and deep versions, but when I tried to run the data processing module for image data, the kernel crashed. There is a column in my dataframe, which is imd_path, which is the path of the image corresponding to the ID

xylovezxy commented 4 months ago

image I don't know why the program was killed

jrzaurin commented 4 months ago

There used to be an issue with notebooks and windows,.let me find it and I will link it there.

But also it does not seem to be finding the dir where the images are (?). The images are in the same directory where the code is running, correct?

xylovezxy commented 4 months ago

Because img.col is my image path column. I have a lot of data, but many of them correspond to the same image, so I processed many duplicate images during data preprocessing, resulting in memory overflow. I currently think this is the problem, and I am trying to modify the image preprocessing code to ensure batch processing or not to process duplicate image data.