Shortening the archive path

nikohansen commented 19 hours ago

Should we create a tiny URL to alleviate the long path problem?

nikohansen commented 17 hours ago

FTR, 260 chars seems to be a limit under windows.

The Windows cache location has an offset of len(username) + 43, see here
len('data-archives\numbbo.github.io\data-archive\data-archive') == 55
a typical long-ish path name within the archive is 25 chars
a long zip filename is 30 chars
len('.extracted_CMA-ESPLUSSEL_auger_noiseless/CMA-ESPLUSSEL/bbobdata-cmaesplussel1e4/data_f10/bbobexp_f10_DIM10.dat') == 110

The current error is raised preemptively in the coco code, not by the OS.

Changing the format to .zip and not extracting the file while reading in would solve this problem too.

nikohansen commented 7 hours ago

The latest commit shortens the local path for the official data archive by 50 chars, namely from

.../data-archives/numbbo.github.io/data-archive/data-archive/... to .../das/da/...

numbbo / coco-postprocess