Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verified research papers.
As recently discussed internally, maintaining the benchmarks may be too time consuming and hard, since there are a lot of things going on and benchmarks tend to be maintained separately. So on, we internally decided to remove the implementation from the distilabel core for the moment, and provide that as an example instead, that anyone can use as reference for building benchmarks with distilabel.
Description
As recently discussed internally, maintaining the benchmarks may be too time consuming and hard, since there are a lot of things going on and benchmarks tend to be maintained separately. So on, we internally decided to remove the implementation from the
distilabel
core for the moment, and provide that as an example instead, that anyone can use as reference for building benchmarks withdistilabel
.