search

apjanke / octave-testify

New BIST (Built-In Self Test) functions for GNU Octave
GNU General Public License v3.0
4 stars 2 forks source link

Feature: install and test all Forge packages #16

Closed apjanke closed 5 years ago

apjanke commented 5 years ago

Add a feature that will install and test all Octave Forge packages, producing a report on failures.

To help with the effort at http://lists.gnu.org/archive/html/octave-maintainers/2019-03/msg00096.html.

apjanke commented 5 years ago

TODO: Include the package version in the log output.

apjanke commented 5 years ago

Work is in progress on branch https://github.com/apjanke/octave-testify/tree/octave-forge-package-tester

apjanke commented 5 years ago

Okay, we're getting somewhere. Here's example log output for it in its current state.

octave-testify-ForgePkgTester-2019-03-16_15-24-48.zip

apjanke commented 5 years ago

Doing better. We're capturing build logs for both successful and failed installations.

Example output: octave-testify-ForgePkgTester-2019-03-16_20-26-10.zip

The full run takes about 40 minutes and produces 9,000 lines of log output.

apjanke commented 5 years ago

Merged to master, so it can be tested using pkg install <github-repo-url>.

apjanke commented 5 years ago

More progress.

Example output: macOS: octave-testify-ForgePkgTester-2019-03-16_23-40-16.zip

apjanke commented 5 years ago

Looking pretty good now, with caching and dependency-order resolution.

Example output: macOS: octave-testify-ForgePkgTester-2019-03-17_17-53-30.zip Linux: octave-testify-ForgePkgTester-2019-03-17_16-07-51.zip Windows: octave-testify-ForgePkgTester-2019-03-17_19-27-37.zip

apjanke commented 5 years ago

Closing this as done. Remaining bugs in it can be dealt with under other issues.