ise-uiuc / FreeFuzz

Free Lunch for Testing: Fuzzing Deep-Learning Libraries from Open Source (ICSE'22)
72 stars 14 forks source link

Question on experimental configuration #9

Open Sehun0819 opened 1 year ago

Sehun0819 commented 1 year ago

Hi. I met a trouble when I tried FreeFuzz on my machine. The problem is, I can’t reproduce the experiment. While experiment in paper spent 7.3 hours for all APIs of PyTorch, mine spent 33.5 hours only for torch.nn.functional.*(less than 100 APIs). I only ran CPU mode and the processor of my machine is at least comparable to the machine in paper.

I sent an email to Anjiang first, and he suspected slowdown due too big tensor shape. So I tried to find a configuration to set a range for the shape of tensors as he suggested, but I couldn’t find. Therefore, it would be appreciated if you let me know how to configure tensor size (or, any setting for executing FreeFuzz like the way you did in your paper). Thank you :)