argilla-io / distilabel

⚗️ distilabel is a framework for synthetic data and AI feedback for AI engineers that require high-quality outputs, full data ownership, and overall efficiency.
https://distilabel.argilla.io
Apache License 2.0
1.12k stars 70 forks source link

[FEATURE] Update `LLM.generate` interface to allow returning arbitrary/extra stuff related to the generation #738

Open gabrielmbmb opened 2 weeks ago

gabrielmbmb commented 2 weeks ago

Description

Update the LLM.generate function signature to allow returning more stuff related to the generation apart from the completion given by the LLM. This would be useful to include generation statistics (number of tokens generated, seconds it took, etc), and to also be able to include intermediate generations (MixtureOfAgents generations of the proposers LLM).