Open sylvinus opened 8 years ago
That will probably help people contribute to cosr-ops and avoid confusion like in https://github.com/commonsearch/cosr-ops/issues/7#issuecomment-207589390
Using the devindex, a smaller subset of Common Crawl, or any WARC file would be great and might also open the door to people installing production instances on their own dataset. (We should just be careful about branding in this case)
That will probably help people contribute to cosr-ops and avoid confusion like in https://github.com/commonsearch/cosr-ops/issues/7#issuecomment-207589390
Using the devindex, a smaller subset of Common Crawl, or any WARC file would be great and might also open the door to people installing production instances on their own dataset. (We should just be careful about branding in this case)