FDK test kit - Githubissues

fnproject / fn

The container native, cloud agnostic serverless platform.

http://fnproject.io

Apache License 2.0

5.76k stars 405 forks source link

FDK test kit #477

Open zootalures opened 7 years ago

zootalures commented 7 years ago

As an FDK author I want to know whether i've done everything I need to to implement a Good FDK.

Write a test suite that drives a consistent set of tests for FDK implementations, to ensure:

FDKs support a given set of features (e.g. Hot/cold etc..)
FDKs respect the current container contract (and verify that changes are supported)

zootalures commented 7 years ago

Things to test OTOMH:

http/json/default contract
- empty/large/small bodies
handles multiple events
Streaming http (accepts more data than fn memory)
Differ

For implementation I think having a single runner that executes the tests against a container that that uses the FDK and is coded to supply specific responses to each test case?

This would allow matrix/regression testing of FDK and Container contract changes.

denismakogon commented 7 years ago

So, per our discussion, we need to document list of validation tests to pass (design them as part of API validation tests). Not sure cold mode matter, because it'll go away eventually. I don't like the idea to run tests against the container, we can run them against Fn server with deployed functions.

In addition to things to test is multipart types.