[Tracking] Testing Not-Supported Feature

[hukoyu]

When failing LTP tests categorized, they were categorized into 4 categories:

1) Test Issues - Test Bugs:

• There is bug in the test code such as non-existing folder or user and so on
• Fix bug in test code and enable test

2) Test Issue – Test Using Not-Supported Feature

• Testing supported feature (syscall) in sgx-lkl but in the test code a not-supported feature is used
• Refactor test code without using not-supported feature and enable test

**3) Testing Not Supported Feature

• Sgx-lkl will not support these features due to limitations such as single process, single user
• We will disable these tests. They are not applicable since sgx-lkl doesn’t implement these features**

4) SGX-LKL Bug

• Tests are  legit and failures are genuine. Tests failing due to incomplete implementation or bug in sgx-lkl implementation.
• Fix bug in sgx-lkl and enable test

Currently there are 165 tests in "Testing Not Supported Feature" category that we will track with this issue.

[hukoyu]

These are tests that not supported by sgx-lkl and will not be enabled at all: (Count: 165) Update Date: July 28, 2020

syslog-syslogtst ptrace05 ptrace04 prctl06 eventfd01 fcntl07 fcntl11 fsync04 madvise08 madvise09 clone01, clone02, clone03, clone04, clone05, clone06, clone07, clone08 abort01 waitpid10 waitpid09 waitpid07 waitpid06 waitpid05 waitpid03 waitpid02 waitpid01 waitpid13 waitpid12 waitpid11 prctl-prctl06_execve execveat-execveat_child execveat-execveat_errno execve-execve01_child execv-execv01_child setresuid04 unshare02 unshare01 pause03 pause01 fcntl22

There are 100 non supported tests that will add here soon...

Not supported per Peter:

acct02 ioperm01 iopl01 add_key01 delete_module02 migrate_pages01 modify_ldt01 msgctl01 ipc-msgget-msgget03 acct01 kcmp01 keyctl01 keyctl02 perf_event_open01 profil01 quotactl02 setns02 swapon03 userfaultfd01 pkey01 swapoff01 delete_module03 delete_module01 acct-acct02_helper