spongedsc / pathways

Pathways: multi-modal AI/ML models on discord
GNU Affero General Public License v3.0
3 stars 1 forks source link

[callsystem] CUTS Runner #93

Closed daniwasonline closed 5 months ago

daniwasonline commented 6 months ago

Description

This PR adds a special callsystem for running CUTS tests. It simply adds an otherwise-dull runner with a special wake command (cuts.run [CUTS unit test ID or "all" for running all CUTS tests at once]). When this wake command is called, the CUTS runner will ensure that the test ID is valid and isn't a regular callsystem. If these conditions are met, the runner will pass context to the CUTS test to complete an activation. Results are piped back to the runner and are sent as necessary.

Why is this useful?

As CUTS unit tests are expressed as otherwise-regular callsystems that use special methods in the CUTS SDK/API, running multiple tests simultaneously or running multiple tests in fast succession is incredibly unfriendly, i.e. one may run into rate-limits. Having a special test runner callsystem will help ease this common scenario.

Butterroach commented 6 months ago

why am i supposed to review

Butterroach commented 6 months ago

idk what hte fuck is going on :sad:

artifishvr commented 6 months ago

i am SO sorry i have no idea how to suggest multiple lines other than doing that

artifishvr commented 6 months ago

also bye butterroach :c

Butterroach commented 6 months ago

dont request reviews from me i know nothing about the new code base

artifishvr commented 6 months ago

its mildly humorous

artifishvr commented 6 months ago

i know nothing about the new code base

yoooo me neitherrr (also i will stop)

daniwasonline commented 6 months ago

i am SO sorry i have no idea how to suggest multiple lines other than doing that

its okay dw

daniwasonline commented 6 months ago

i know nothing about the new code base

yoooo me neitherrr (also i will stop)

i worked on it and i dont understand half of what i did (i do but i have a stroke every time i read it)

daniwasonline commented 6 months ago

time for crack