camachojua / diplomado-ia

Repositorio de discusión para el diplomado de inteligencia artificial
GNU Lesser General Public License v2.1
15 stars 18 forks source link

add sharding module #27

Closed egmzcrz closed 1 week ago

egmzcrz commented 1 week ago

sharding.go improves upon file_splitting.go but is incompatible with the unit test api: total number of lines per output file is not fixed, instead total number of bytes is constant.