bitshares / bitshares-core

BitShares Blockchain node and command-line wallet
https://bitshares.github.io/
Other
1.17k stars 647 forks source link

test automation framework #1913

Open OpenLedgerApp opened 5 years ago

OpenLedgerApp commented 5 years ago

All protocol and minor blockchain changes requires automation testing. Bitshares requires automation framework for BitShares. This tool allows running integration and smoke test for BitShares workers.

We would like to share it with the community. @ryanRfox @xeroc @pmconrad @sschiessl-bcp @abitmore @oxarbitrage @jmjatlanta

Link to commit: https://github.com/openledger/bitshares-tests/commit/1ea33fed37682b42ad78bfaefb784b45c8d36d95

sschiessl-bcp commented 5 years ago

please transfer to bitshares-core

pmconrad commented 5 years ago

Why add a separate framework for tests instead of extending the boost-based unit tests we already have?

abitmore commented 5 years ago

Having a python-based test framework is good for Python developers to contribute to the project. It can become stale if nobody uses/maintains it though.

OpenLedgerApp commented 5 years ago

Why add a separate framework for tests instead of extending the boost-based unit tests we already have?

Python tests are integration tests. They are running in environment very similar to production. An integration test is done to demonstrate that different pieces of the system work together. Both types of testing are important: unit and integration

pmconrad commented 5 years ago

Well, this is not a microservice architecture or sth like that, where you need to test the interoperability of dozens of independent services.

In our existing cli_test suite we test interoperability of cli_wallet and node API. AFAICS this is basically the same level that your framework is based upon.