err_handle(layoutlmv3): Error message doesn't give much clarity when boxes not containing enough information

Sushaanth-Suresh-Kumar commented 9 months ago

System Info

transformers version: 4.37.2
Platform: Windows-10-10.0.22000-SP0
Python version: 3.11.5
Huggingface_hub version: 0.20.3
Safetensors version: 0.4.2
Accelerate version: not installed
Accelerate config: not found
PyTorch version (GPU?): 2.2.0+cpu (False)
Tensorflow version (GPU?): 2.15.0 (False)
Flax version (CPU?/GPU?/TPU?): not installed (NA)
Jax version: not installed
JaxLib version: not installed
Using GPU in script?: no
Using distributed or parallel set-up in script?: no

Who can help?

@younesbelkada @ArthurZucker

Information

[X] The official example scripts
[ ] My own modified scripts

Tasks

[ ] An officially supported task in the examples folder (such as GLUE/SQuAD, ...)
[X] My own task or dataset (give details below)

Reproduction

Model I am using LayoutLMv3:

when boxes = [[123, 53], [36, 87], ...] (basically any list which is not according to the proper format) by proper format I mean [[123, 346, 234, 634], [356, 568, 234, 25], ...]

encoding = processor(
        image_1,
        text,
        boxes=boxes,
        max_length=512,
        padding="max_length",
        truncation=True,
        return_tensors="pt"
    )

It produces a this error message

ValueError: Unable to create tensor, you should probably activate truncation and/or padding with 'padding=True' 'truncation=True' to have batched tensors with the same length. Perhaps your features (labels in this case) have excessive nesting (inputs type list where type int is expected).

To Reproduce Steps to reproduce the behavior:

add any list of boxes with not enough values like boxes = [[123, 53], [36, 87], ...]
when run it throws the ValueError mentioned above

Expected behavior

Can throw an error saying

ValueError: boxes doesn't have enough values inside each box. Each box should contain 4 values

ArthurZucker commented 9 months ago

Would you like to open a PR to improve the error? 🤗

Sushaanth-Suresh-Kumar commented 9 months ago

Sure

Sushaanth-Suresh-Kumar commented 8 months ago

I was busy for a while. I will try it and let you know. @ArthurZucker

I am forked and cloned the huggingface/transformers library. Now when I was following through the instructions. I came into the problem where I am getting this error message below when I was executing this command pip install -e ".[dev]"

This is the Error:

ERROR: Ignored the following versions that require a different python version: 1.21.2 Requires-Python >=3.7,<3.11; 1.21.3 Requires-Python >=3.7,<3.11; 1.21.4 Requires-Python >=3.7,<3.11; 1.21.5 Requires-Python >=3.7,<3.11; 1.21.6 Requires-Python >=3.7,<3.11
ERROR: Could not find a version that satisfies the requirement tensorflow-text<2.16; extra == "dev" (from transformers[dev]) (from versions: none)
ERROR: No matching distribution found for tensorflow-text<2.16; extra == "dev"

amyeroberts commented 8 months ago

@Sushaanth-Suresh-Kumar Could you open a new issue for this? This will help us make sure this problem isn't lost, properly tracked and clear if it's been resolved

ArthurZucker commented 7 months ago

Are you running this on macos?

huggingface / transformers