search

mar-file-system / GUFI

Grand Unified File-Index
Other
46 stars 23 forks source link

how to configure GUFI to use lester? #159

Open yr-wang-hit opened 2 months ago

yr-wang-hit commented 2 months ago

We experiment GUFI to generate index for Lustre and wonder if we can use lester to accelerate the index generation process. (The SC'22 paper seems that lester can accelerate the process by 5x if I not misunderstood.)

Thanks.

dmanno commented 1 month ago

Yes, this is absolutely possible. We had to make some patches to lester to get it to work with more recent versions of lustre. Once I find this patchset, I'll get it over to you. As I recall, it wasn't too many modifications. We also adjusted the output format, so that it could be consumed by gufi_trace2index. Once we get lester working again, I'll provide an example below.