transformers.generation.utils.GenerationMixin.generate() got multiple values for keyword argument 'generation_config'

rectalogic commented 1 week ago

System Info

transformers version: 4.46.0.dev0
Platform: macOS-14.6.1-arm64-arm-64bit
Python version: 3.12.5
Huggingface_hub version: 0.25.1
Safetensors version: 0.4.5
Accelerate version: not installed
Accelerate config: not found
PyTorch version (GPU?): 2.4.1 (False)
Tensorflow version (GPU?): not installed (NA)
Flax version (CPU?/GPU?/TPU?): not installed (NA)
Jax version: not installed
JaxLib version: not installed
Using distributed or parallel set-up in script?: no

Who can help?

@Rocketknight1

Information

[ ] The official example scripts
[X] My own modified scripts

Tasks

[ ] An officially supported task in the examples folder (such as GLUE/SQuAD, ...)
[X] My own task or dataset (give details below)

Reproduction

Using a pipeline with the text-to-audio task fails:

from transformers import pipeline

pipe = pipeline(task="text-to-audio")
pipe("Hello world")

Fails with this exception:

No model was supplied, defaulted to suno/bark-small and revision 1dbd7a1 (https://huggingface.co/suno/bark-small).
Using a pipeline without specifying a model name and revision in production is not recommended.
/Users/aw/Projects/rectalogic/llm-transformers/venv/lib/python3.12/site-packages/transformers/models/encodec/modeling_encodec.py:124: UserWarning: To copy construct from a tensor, it is recommended to use sourceTensor.clone().detach() or sourceTensor.clone().detach().requires_grad_(True), rather than torch.tensor(sourceTensor).
  self.register_buffer("padding_total", torch.tensor(kernel_size - stride, dtype=torch.int64), persistent=False)
Hardware accelerator e.g. GPU is available in the environment, but no `device` argument is passed to the `Pipeline` object. Model will be on CPU.
Traceback (most recent call last):
  File "/Users/aw/Projects/rectalogic/llm-transformers/a.py", line 4, in <module>
    pipe("Hello world")
  File "/Users/aw/Projects/rectalogic/llm-transformers/venv/lib/python3.12/site-packages/transformers/pipelines/text_to_audio.py", line 186, in __call__
    return super().__call__(text_inputs, **forward_params)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/aw/Projects/rectalogic/llm-transformers/venv/lib/python3.12/site-packages/transformers/pipelines/base.py", line 1268, in __call__
    return self.run_single(inputs, preprocess_params, forward_params, postprocess_params)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/aw/Projects/rectalogic/llm-transformers/venv/lib/python3.12/site-packages/transformers/pipelines/base.py", line 1275, in run_single
    model_outputs = self.forward(model_inputs, **forward_params)
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/aw/Projects/rectalogic/llm-transformers/venv/lib/python3.12/site-packages/transformers/pipelines/base.py", line 1175, in forward
    model_outputs = self._forward(model_inputs, **forward_params)
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/aw/Projects/rectalogic/llm-transformers/venv/lib/python3.12/site-packages/transformers/pipelines/text_to_audio.py", line 147, in _forward
    output = self.model.generate(**model_inputs, **forward_params)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/aw/Projects/rectalogic/llm-transformers/venv/lib/python3.12/site-packages/torch/utils/_contextlib.py", line 116, in decorate_context
    return func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^
  File "/Users/aw/Projects/rectalogic/llm-transformers/venv/lib/python3.12/site-packages/transformers/models/bark/modeling_bark.py", line 1724, in generate
    semantic_output = self.semantic.generate(
                      ^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/aw/Projects/rectalogic/llm-transformers/venv/lib/python3.12/site-packages/transformers/models/bark/modeling_bark.py", line 900, in generate
    semantic_output = super().generate(
                      ^^^^^^^^^^^^^^^^^
TypeError: transformers.generation.utils.GenerationMixin.generate() got multiple values for keyword argument 'generation_config'

Expected behavior

Should not raise an exception.

Rocketknight1 commented 1 week ago

Confirmed the issue here - this is quite serious! Investigating ASAP

Rocketknight1 commented 1 week ago

cc @gante - I did a git bisect and the cause is #33480

Rocketknight1 commented 1 week ago

@rectalogic this should now be fixed on main - please let us know if you encounter any other issues with the pipeline!

huggingface / transformers