User-level synchronous invocations using Intel MPK

[evanstella]

Summary of this Pull Request (PR)

UPDATE 12/4/2022: Merged with gwsystems/main locally to resolve conflict. See tests below. Ready for review and integration.

User-level synchronous invocations using Intel MPK. This PR is for review of the feature and includes both kernel and user-level modifications to enable the feature. Performance tests are still required. This PR is for review; not ready to be merged yet.

Intent for your PR

Choose one (Mandatory):

• [] This PR is for a code-review and is intended to get feedback, but not to be pulled yet.
• [x] This PR is mature, and ready to be integrated into the repo.

Reviewers (Mandatory):

@gparmer @WenyuanShao @betahxy @Others

Code Quality

As part of this pull request, I've considered the following:

Style:

• [x] Comments adhere to the Style Guide (SG)
• [x] Spacing adhere's to the SG
• [x] Naming adhere's to the SG
• [x] All other aspects of the SG are adhered to, or exceptions are justified in this pull request
• [ ] I have run the auto formatter on my code before submitting this PR (see doc/auto_formatter.md for instructions)

Code Craftsmanship:

• [x] I've made an attempt to remove all redundant code
• [x] I've considered ways in which my changes might impact existing code, and cleaned it up
• [x] I've formatted the code in an effort to make it easier to read (proper error handling, function use, etc...)
• [x] I've commented appropriately where code is tricky
• [x] I agree that there is no "throw-away" code, and that code in this PR is of high quality

Testing

I've tested the code using the following test programs (provide list here):

• [ ] micro_booter
• [] unit_pingpong
• [x] unit_schedtests
• [x] vas_ping_pong_tests (a capmgr, scheduler, schedtests, ping/pong)
• [x] sched_ping_pong
• [x] vas_call_tests (test of a chain of both kernel and user-level synchronous invocations)

[gparmer]

Do you want a fresh review? Looks like not much of logical substance has changed, so I wanted to ask to make sure.

[gparmer]

Thanks for this massive amount of work! We're good to intergrate.