search

aboutcode-org / scancode-toolkit

:mag: ScanCode detects licenses, copyrights, dependencies by "scanning code" ... to discover and inventory open source and third-party packages used in your code. Sponsored by NLnet project https://nlnet.nl/project/vulnerabilitydatabase, the Google Summer of Code, Azure credits, nexB and others generous sponsors!
https://github.com/aboutcode-org/scancode-toolkit/releases/
2.1k stars 544 forks source link

ScanCode getting killed on Travis CI during license indexing #884

Closed sschuberth closed 5 years ago

sschuberth commented 6 years ago

We see ScanCode 2.2.1 getting killed as part of running functional tests for ORT on Travis CI. stderr shows:

Scanning files for: infos, licenses, copyrights with 1 process(es)...
Building license detection index...
/home/travis/build/heremaps/oss-review-toolkit/scanner/src/funTest/assets/scanners/scancode-toolkit/scancode: line 114:  5332 Killed $SCANCODE_ROOT_DIR/bin/scancode "$@"

My hunch is this only happens if the system is low on memory.

Any idea how to further debug or work around this?

/cc @mnonnenmacher

pombredanne commented 6 years ago

@sschuberth Thanks for this report. I think a special test script run could be made that checks memory before and after. I never saw this OOM on scancode Travis runs proper so it could have to do with using a container or a VM for a travis job too.

pombredanne commented 5 years ago

@sschuberth there have been several updates and improvements since this ticket and I never saw this issue. If you do not experience it anymore, feel free to close this. Thanks!

sschuberth commented 5 years ago

I also haven't seen it in quite a while!