shashank-boyapally commented 4 months ago

Type of change

[x] Refactor
[x] New feature
[x] Bug fix
[ ] Optimization
[x] Documentation Update

Description

Do not MERGE until fmatch 0.0.6 is released

Firstly, please forgive for changing many things in a single PR. Below are the updates following this PR.

Run orion in Daemon mode using orion daemon. This is the opinionated version of daemon mode, where the tests are pre-determined with small-scale-cluster-density being default.

>> curl -L -X POST 'http://127.0.0.1:8000/daemon?filter_changepoints=true&version=4.15'
{
"aws-small-scale-cluster-density-v2": [
    {
        "uuid": "bd5e6cad-6bc2-472d-948a-b1fbb350e80a",
        "timestamp": 1703680619,
        "buildUrl": "https://tinyurl.com/2ce2rhwx",
        "metrics": {
            "apiserverCPU_avg": {
                "value": 11.1966602622,
                "percentage_change": 0
            },
            "etcdCPU_avg": {
                "value": 8.6323461833,
                "percentage_change": 0
            },
            "podReadyLatency_P99": {
                "value": 13000,
                "percentage_change": 0
            },
            "etcdDisk_avg": {
                "value": 0.0154012333,
                "percentage_change": 43.3409860968489
            },
            "ovnCPU_avg": {
                "value": 2.776452632,
                "percentage_change": 0
            }
        },
        "is_changepoint": true
    },
    {
        "uuid": "12a1750e-a7eb-48ed-bc00-35078d2bbad8",
        "timestamp": 1704890296,
        "buildUrl": "https://tinyurl.com/28pv78qv",
        "metrics": {
            "apiserverCPU_avg": {
                "value": 10.9378649752,
                "percentage_change": 0
            },
            "etcdCPU_avg": {
                "value": 8.8632852428,
                "percentage_change": 11.533377325057053
            },
            "podReadyLatency_P99": {
                "value": 13000,
                "percentage_change": 0
            },
            "etcdDisk_avg": {
                "value": 0.0154638616,
                "percentage_change": 0
            },
            "ovnCPU_avg": {
                "value": 3.1066655456,
                "percentage_change": 25.58620416479553
            }
        },
        "is_changepoint": true
    }
]
}

Get list of options of tests available using

>> curl -L 'http://127.0.0.1:8000/daemon/options'
{
"options": [
    "small-scale-cluster-density",
    "small-scale-node-density-cni"
]
}

The old cli mode is now cmd-mode run it using orion cmd
Refactored code for better readability.
Documentation update pertaining to daemon-mode.
One bug noticed for multiple test run cases, where only the first test case was the only output, fixed it and multiple test cases are now printed in the output.
pass version as a param supported by templating.

Related Tickets & Documents

Related Issue #27
Closes #

Checklist before requesting a review

[x] I have performed a self-review of my code.
[ ] If it is a core feature, I have added thorough tests.

Testing

Please describe the System Under Test.
Please provide detailed steps to perform tests related to this code change.
How were the fix/results from this change verified? Please provide relevant screenshots or results.

shashank-boyapally commented 4 months ago

Hi @paigerube14 @jtaleric just rebased with latest changes.

shashank-boyapally commented 3 months ago

I added pyshorteners to shorten the buildUrl in the display, the requirements.txt file is not updated since I wanted to update it along fmatch 0.0.6 when released. There would be some function changes in fmatch 0.0.6.