search

googleapis / sample-tester

Tool for testing semantically equivalent samples in multiple languages and environments
Apache License 2.0
10 stars 12 forks source link

better error messages #133

Closed vchudnov-g closed 5 years ago

vchudnov-g commented 5 years ago

For example, these two error messages are not particularly friendly:

$ sample-tester
ERROR:root:error reading manifest data:
 no version specified in manifest sources: "/usr/local/[REDACTED]/sample-tester/tests/testdata/inputs/multidocs/ant.manifest.yaml", "/usr/local/[REDACTED]/sample-tester/tests/testdata/inputs/multidocs/ant.manifest.yaml"
ERROR:root:fatal error: ValueError('could not create test environments for convention "tag": Exception(\'error reading manifest data:\\n no version specified in manifest sources: "/usr/local/[REDACTED]/sample-tester/tests/testdata/inputs/multidocs/ant.manifest.yaml", "/usr/local/[REDACTED]/sample-tester/tests/testdata/inputs/multidocs/ant.manifest.yaml"\',)',)

ERROR: could not run tests because could not create test environments for convention "tag": Exception('error reading manifest data:\n no version specified in manifest sources: "/usr/local/[REDACTED]/sample-tester/tests/testdata/inputs/multidocs/ant.manifest.yaml", "/usr/local/[REDACTED]/sample-tester/tests/testdata/inputs/multidocs/ant.manifest.yaml"',)

usage: sample-tester [-h] [-c CONVENTION:ARG,ARG,...] [--xunit FILE] [-v {quiet,summary,detailed}] [-f] [-l {none,info,debug}]
                     [--envs TESTENV_FILTER] [--suites SUITE_FILTER] [--cases CASE_FILTER] [--version] [--fail-fast]
                     ...

and

$ sample-tester /tmp/jeff.manifest.yaml 
ERROR:root:fatal error: KeyError('test',)

ERROR: could not run tests because 'test'

usage: sample-tester [-h] [-c CONVENTION:ARG,ARG,...] [--xunit FILE] [-v {quiet,summary,detailed}] [-f] [-l {none,info,debug}]
                     [--envs TESTENV_FILTER] [--suites SUITE_FILTER] [--cases CASE_FILTER] [--version] [--fail-fast]