Closed PhungVanDuy closed 1 year ago
Hey @PhungVanDuy it looks good! One thing is could you prepend the licensing information for the files from the bigcode repository so people can easily identify it is theirs?
Do you think it is possible to easily run the near dedup across data sources or better to just do each on their own?
Gonna close this since we are going a different direction
Hey @PhungVanDuy it looks good! One thing is could you prepend the licensing information for the files from the bigcode repository so people can easily identify it is theirs?