search

php-llm / llm-chain

PHP library for building LLM-based features and applications.
MIT License
10 stars 3 forks source link

Examples as E2E Tests #32

Open chr-hertel opened 1 month ago

chr-hertel commented 1 month ago

Would be interesting to run the examples as E2E tests. Would require tokens (not that problematic with secrets i guess) but also a clever way to execute and run assertions.

Maybe it's enough to have a proper exit code? :thinking:

OskarStark commented 1 month ago

What about prompting "Answer just with: OK" or a structured output?

chr-hertel commented 1 month ago

Answer just with: OK

Huh, easy one - i Like 👍

chr-hertel commented 1 month ago

after integrating the example runner, this is not that urgent anymore, but basically that thing could be converted to a functional phpunit test - only important to execute those example parallel not sequentially