Submission 72

[Edkamb]

This issue will be used for the communication concerning the testing phase of submission 72.

[ghost]

I had no problems in compiling the provided tools but when I follow the execution sequence given in the readme, I get file not found exceptions for three of the scripts:

bash test_8k_10.sh

opt-10: crypto_test/bc/Cipher/aes-trace.bc: error: Could not open input file: No such file or directory
opt-10: crypto_test/bc/Cipher/des-trace.bc: error: Could not open input file: No such file or directory
opt-10: crypto_test/bc/Cipher/seed-trace.bc: error: Could not open input file: No such file or directory
opt-10: crypto_test/bc/Cipher/camellia-trace.bc: error: Could not open input file: No such file or directory
opt-10: crypto_test/bc/Cipher/chacha20-trace.bc: error: Could not open input file: No such file or directory
opt-10: crypto_test/bc/Cipher/idea-trace.bc: error: Could not open input file: No such file or directory
opt-10: crypto_test/bc/Cipher/aria-trace.bc: error: Could not open input file: No such file or directory
opt-10: crypto_test/bc/Cipher/sm4-trace.bc: error: Could not open input file: No such file or directory
opt-10: crypto_test/bc/Hash/blake2-trace.bc: error: Could not open input file: No such file or directory
opt-10: crypto_test/bc/Hash/md5-trace.bc: error: Could not open input file: No such file or directory
opt-10: crypto_test/bc/Hash/sha256-trace.bc: error: Could not open input file: No such file or directory
opt-10: crypto_test/bc/Hash/whirlpool-trace.bc: error: Could not open input file: No such file or directory

bash explicit-vs-symbolic-SEED.sh

opt-10: crypto_test/bc/Cipher/seed-trace.bc: error: Could not open input file: No such file or directory
opt-10: crypto_test/bc/Cipher/seed-trace.bc: error: Could not open input file: No such file or directory
opt-10: crypto_test/bc/Cipher/seed-trace.bc: error: Could not open input file: No such file or directory
opt-10: crypto_test/bc/Cipher/seed-trace.bc: error: Could not open input file: No such file or directory
opt-10: crypto_test/bc/Cipher/seed-trace.bc: error: Could not open input file: No such file or directory
opt-10: crypto_test/bc/Cipher/seed-trace.bc: error: Could not open input file: No such file or directory
opt-10: crypto_test/bc/Cipher/seed-trace.bc: error: Could not open input file: No such file or directory
opt-10: crypto_test/bc/Cipher/seed-trace.bc: error: Could not open input file: No such file or directory
opt-10: crypto_test/bc/Cipher/seed-trace.bc: error: Could not open input file: No such file or directory
opt-10: crypto_test/bc/Cipher/seed-trace.bc: error: Could not open input file: No such file or directory

bash TestStats.sh 8192

Results/*/**.txt
Results/*/**
/home/fase2022/Downloads/Spreca/crypto_test/Results/*/**.txt
Traceback (most recent call last):
  File "leakingsites.py", line 23, in <module>
    with open(readLog, "r") as readL:
FileNotFoundError: [Errno 2] No such file or directory: '/home/fase2022/Downloads/Spreca/crypto_test/Results/*/**.txt'

For the first two scripts (bash test_8k_10.sh and explicit-vs-symbolic-SEED.sh), I was also not able to find the files using a search on the filesystem. For the third script (TestStats.sh), I was able to find many *.txt files but don't know which are the expected ones.

For replication, I used the zip hosted at: https://zenodo.org/record/5824407

[myUct]

• The README file

  • I do not find any information about the requested badges

• Installation

  Dependencies can be installed with install-deps.sh, simply run: .\install-deps.sh

  • This command does not work. I need to use sudo sh install-deps.sh.
  • The script uses apt install -> no .deb is provided and we need to install external sources (see Including Ubuntu Packages in https://fase-conf.github.io/)

• Test run

  • During the run of bash TraceGen.sh -all, some warnings and errors are raised. eg. test2.c:8:16: error: expected ';' at end of declaration
  • Moreover, I do not understand how we can check the correctness of the tests or what is relevant in the output.

• Evaluation script

  • bash test_8k_10.sh failed

  • opt-10: crypto_test/bc/Cipher/aes-trace.bc: error: Could not open input file: No such file or directory opt-10: crypto_test/bc/Cipher/des-trace.bc: error: Could not open input file: No such file or directory opt-10: crypto_test/bc/Cipher/seed-trace.bc: error: Could not open input file: No such file or directory opt-10: crypto_test/bc/Cipher/camellia-trace.bc: error: Could not open input file: No such file or directory opt-10: crypto_test/bc/Cipher/chacha20-trace.bc: error: Could not open input file: No such file or directory opt-10: crypto_test/bc/Cipher/idea-trace.bc: error: Could not open input file: No such file or directory opt-10: crypto_test/bc/Cipher/aria-trace.bc: error: Could not open input file: No such file or directory opt-10: crypto_test/bc/Cipher/sm4-trace.bc: error: Could not open input file: No such file or directory opt-10: crypto_test/bc/Hash/blake2-trace.bc: error: Could not open input file: No such file or directory opt-10: crypto_test/bc/Hash/md5-trace.bc: error: Could not open input file: No such file or directory opt-10: crypto_test/bc/Hash/sha256-trace.bc: error: Could not open input file: No such file or directory opt-10: crypto_test/bc/Hash/whirlpool-trace.bc: error: Could not open input file: No such file or directory

[Eiram]

• I do not find any information about the requested badges

In the abstract it is stated that "2. We aim for badges of “Artifact Evaluated”, “Artifacts Available” and “Results Validated” "

[zunchenhuang]

@ArtifactReviewer-FASE2022 @myUct

Thank you very much for the feedback!

First, it seems a compatibility issue, please do the following:

Step 1:

Make sure current version of libssl-dev is uninstalled:

sudo apt autoremove libssl-dev

Step 2:

Download openssl1.1.1k version and install it:

cd ~
wget https://www.openssl.org/source/old/1.1.1/openssl-1.1.1k.tar.gz
tar xvzf openssl-1.1.1k.tar.gz 
cd openssl-1.1.1k
./config
make 
make test
sudo make install

Step 3: Go to Spreca and compile the crypto benchmarks:

clang-10 -O0 -emit-llvm -c -g Cipher/aes.c -o bc/Cipher/aes.bc
llvm-link-10 bc/Cipher/aes.bc bc/TRACE_test.bc -o bc/Cipher/aes-trace.bc

clang-10 -O0 -emit-llvm -c -g Cipher/des_enc.c -o bc/Cipher/des_enc.bc
clang-10 -O0 -emit-llvm -c -g Cipher/des_set_key.c -o bc/Cipher/des_set_key.bc
llvm-link-10 bc/Cipher/des_set_key.bc bc/Cipher/des_enc.bc bc/TRACE_test.bc -o bc/Cipher/des-trace.bc

clang-10 -O0 -emit-llvm -c -g Cipher/seed.c -o bc/Cipher/seed.bc
llvm-link-10 bc/Cipher/seed.bc bc/TRACE_test.bc -o bc/Cipher/seed-trace.bc

clang-10 -O0 -emit-llvm -c -g Cipher/camellia.c -o bc/Cipher/camellia.bc
llvm-link-10 bc/Cipher/camellia.bc bc/TRACE_test.bc -o bc/Cipher/camellia-trace.bc

clang-10 -O0 -emit-llvm -c -g Cipher/chacha_enc_ctr32.c -o bc/Cipher/chacha20.bc
llvm-link-10 bc/Cipher/chacha20.bc bc/TRACE_test.bc -o bc/Cipher/chacha20-trace.bc

clang-10 -O0 -emit-llvm -c -g Cipher/idea.c -o bc/Cipher/idea.bc
llvm-link-10 bc/Cipher/idea.bc bc/TRACE_test.bc -o bc/Cipher/idea-trace.bc

clang-10 -O0 -emit-llvm -c -g Cipher/aria.c -o bc/Cipher/aria.bc
llvm-link-10 bc/Cipher/aria.bc bc/TRACE_test.bc -o bc/Cipher/aria-trace.bc

clang-10 -O0 -emit-llvm -c -g Cipher/sm4.c -o bc/Cipher/sm4.bc
llvm-link-10 bc/Cipher/sm4.bc bc/TRACE_test.bc -o bc/Cipher/sm4-trace.bc

clang-10 -O0 -emit-llvm -c -g Hash/md5_dgst.c -o bc/Hash/md5_dgst.bc
clang-10 -O0 -emit-llvm -c -g Hash/md5_one.c -o bc/Hash/md5_one.bc
llvm-link-10 bc/Hash/md5_dgst.bc bc/Hash/md5_one.bc bc/TRACE_test.bc -o bc/Hash/md5-trace.bc

clang-10 -O0 -emit-llvm -c -g Hash/sha256.c -o bc/Hash/sha256.bc
llvm-link-10 bc/Hash/sha256.bc bc/TRACE_test.bc -o bc/Hash/sha256-trace.bc

clang-10 -O0 -emit-llvm -c -g Hash/wp_dgst.c -o bc/Hash/wp_dgst.bc
clang-10 -O0 -emit-llvm -c -g Hash/wp_block.c -o bc/Hash/wp_block.bc
llvm-link-10 bc/Hash/wp_dgst.bc bc/Hash/wp_block.bc bc/TRACE_test.bc -o bc/Hash/whirlpool-trace.bc

clang-10 -O0 -emit-llvm -c -g Hash/blake2b.c -o bc/Hash/blake2b.bc
llvm-link-10 bc/Hash/blake2b.bc bc/TRACE_test.bc -o bc/Hash/blake2-trace.bc

Then it's able to run bash test_8k_10.sh, etc.

We will make another simple script in the final artifact version.

Second, for the test program output: e.g., in test result test_processed_12_3_10_result.txt for test.c, you can see if there are some divergent cache behavior by search "SAT", then there are two concrete symbolic values provided with logged cache states.

Thank you again for your help and feedback!