Queries about src/evaluation/evaluation.py

[pipiofzl]

I encountered an issue while using src/evaluation/evaluation.py. Specifically, when performing two consecutive ICCAD_evaluation calculations in evaluation.py, as shown in the script below (The modifications made in evaluation.py are as shown in the screenshot. Everything else is identical to the evaluation.py on GitHub.): I noticed that evaluating test_1.size first, then output.size, and vice versa, leads to completely different scores. What could be causing this issue? (PS: The mentioned output.size is the result for the given NV_NVDLA_partition_m design without any replacements, while test_1.size is the result after replacing the cell corresponding to the “g85390” instance in the NV_NVDLA_partition_m design with equiv_cells[2].) Below are the result images: First evaluate test_1.size and then evaluate output.size： test_1.size: output.size: First evaluate output.size and then evaluate test_1.size： output.size: test_1.size: Here is the Google Drive link where I have placed output.size and test1.size. https://drive.google.com/drive/folders/1iTMICfo8Uag5hXgdlTT-fJxCVhQ2fsp?usp=sharing

[bingyuew]

I cannot reproduce the timing number you are getting. Besides, OpenROAD can only read one design at a time. You will receive an error message if you try to load the design twice.

[pipiofzl]

Are the results the same when you first run test_1.size and then output.size compared to running output.size first and then test_1.size?

[pipiofzl]

Can evaluation.py only evaluate one .size file at a time? If I want to evaluate two .size files, how should I do it?

[bingyuew]

Unfortunately, openroad does not support this feature.

[pipiofzl]

OK，thanks~