[...truncated 1.69 KB...]
Checking out Revision c28687fffb1ceab1befc094f06ac0671108a2c5c (origin/integration)
Commit message: "Merge pull request #38 from browsermt/wasm-integration"
> git config core.sparsecheckout # timeout=10
> git checkout -f c28687fffb1ceab1befc094f06ac0671108a2c5c
> git rev-list 38e8b3cd6d5a2db561ce201c3e69fb79c676389c # timeout=10
[bergamot-translator] $ /bin/sh -xe /tmp/jenkins6534391889599615024.sh
+ . /etc/environment
+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games
+ rm -rf build
+ mkdir -p build
+ cd build
+ CMAKE=/usr/bin/cmake
+ CC=/usr/bin/gcc-8 CXX=/usr/bin/g++-8 /usr/bin/cmake -DCOMPILE_CUDA=off -DCOMPILE_TESTS=OFF -DCOMPILE_EXAMPLES=OFF -DUSE_SENTENCEPIECE=ON -DCOMPILE_SERVER=OFF ..
-- The CXX compiler identification is GNU 8.4.0
-- The C compiler identification is GNU 8.4.0
-- Check for working CXX compiler: /usr/bin/g++-8
-- Check for working CXX compiler: /usr/bin/g++-8 -- works
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Detecting CXX compile features
-- Detecting CXX compile features - done
-- Check for working C compiler: /usr/bin/gcc-8
-- Check for working C compiler: /usr/bin/gcc-8 -- works
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Detecting C compile features
-- Detecting C compile features - done
-- Submodule update
Submodule path '3rd_party/marian-dev': checked out '467c43a292a68b7913af2a00d353de97c1740f92'
Submodule 'src/3rd_party/onnxjs' (https://github.com/abhi-agg/onnxjs.git) registered for path '3rd_party/marian-dev/src/3rd_party/onnxjs'
Cloning into '/var/lib/jenkins/workspace/bergamot-translator/3rd_party/marian-dev/src/3rd_party/onnxjs'...
Submodule path '3rd_party/marian-dev/src/3rd_party/intgemm': checked out 'cc71e5c2a69755009667330af1f60a4ed15b5b63'
Submodule path '3rd_party/marian-dev/src/3rd_party/onnxjs': checked out 'dfefde914fcc79b4c0f9eafcfc97e4b606af700e'
Submodule 'deps/eigen' (https://github.com/abhi-agg/eigen-git-mirror.git) registered for path '3rd_party/marian-dev/src/3rd_party/onnxjs/deps/eigen'
Cloning into '/var/lib/jenkins/workspace/bergamot-translator/3rd_party/marian-dev/src/3rd_party/onnxjs/deps/eigen'...
Submodule path '3rd_party/marian-dev/src/3rd_party/onnxjs/deps/eigen': checked out 'fff37f4ca0397af9ed7e04f3bd6b893a1ea2b08e'
From https://github.com/marian-nmt/sentencepiece
* branch bd18c834559ef4a25fa3a740b97465df2daae6eb -> FETCH_HEAD
Submodule path '3rd_party/marian-dev/src/3rd_party/sentencepiece': checked out 'bd18c834559ef4a25fa3a740b97465df2daae6eb'
From https://github.com/ugermann/ssplit-cpp
* branch 432208826ee27e7b3984b53774b1a16d74256d77 -> FETCH_HEAD
Submodule path '3rd_party/ssplit-cpp': checked out '432208826ee27e7b3984b53774b1a16d74256d77'
CMake Error at 3rd_party/marian-dev/CMakeLists.txt:42 (add_compile_definitions):
Unknown CMake command "add_compile_definitions".
-- Configuring incomplete, errors occurred!
See also "/var/lib/jenkins/workspace/bergamot-translator/build/CMakeFiles/CMakeOutput.log".
Build step 'Execute shell' marked build as failure
marianminion
commented
3 years ago
Build 'bergamot-translator' is failing!
Last 50 lines of build output:
Changes since last successful build:
[aaggarwal] 9a54d2116cc0b26fcc7582c0a99c7905c2d3be66 - Updated marian-dev submodule
[aaggarwal] 47b4bae268bf98dd1fad70ce50731a5f74e09c3b - Changed encodePreservingSource -> encodeWithByteRanges
[aaggarwal] 5683168a8d0011e7311ec62e13806b23bce52ec9 - Updated ssplit submodule to a different repository
[aaggarwal] 584700ce911de9da92489661c42a4ecc7c58d35e - Changed translate() API from non-blocking to blocking
[aaggarwal] a2d32693448fbbc582efc0da1e05f6731e548845 - Updated ssplit submodule
[aaggarwal] 9747d9ba83e2eb6f7cf5edfee37a90592d2c220b - Add cmake option to compile project on WASM
[aaggarwal] b73d4f4cc275277b35545af2a0d35ea7953166d4 - Set cmake option to compile marian library only
[aaggarwal] 838547e4d582089d6222aadf14e77732d8955d17 - Set cmake options of marian properly for this project
[aaggarwal] 9b896507e3860b5c3cf0e452659d336fe43958e1 - cmake compile option changes
[aaggarwal] 79c445ae3a9c63fa68cd7687e5bdae7b76dc72b1 - cmake compile option changes for wasm builds
[aaggarwal] a06530e92b6d16527487c8fa0ead4ae04f0ddbb5 - Fixed a bug in TranslationModel class
[aaggarwal] 23a952782479401c4ac31bab6eccccb546c1f4ee - Source code changes to compile the project without threads
[aaggarwal] 7b80003a5fd60d5e28beee74d8f45590390581f5 - Added code to generate proper JS bindings of translator
[aaggarwal] 74b06d863ebbd0b0b59dfd7be1e541a338c8a3f8 - Add wasm folder to compile JS bindings
[aaggarwal] de501e8f963b8fed6cc6f1799d55f2e20b325d3e - Added JS binding files and cmake infrastructure to build them
[aaggarwal] e12647076c69c4e0355b598b16127d4112f662bd - Updated README with wasm build and use instructions
[aaggarwal] ff95e37f89e2ed67e4a6420e6a3415bb8e794994 - Improved cmake option PACKAGE_DIR
[aaggarwal] 28dcf55b417549f1b5ba7ec739e416166ac93591 - Improved cmake to use wasm compilation flags across project
[aaggarwal] 3b7673bf15e9877f3cfc15c17a366db8a494a4d5 - Updated marian-dev submodule
[github] 9108d9f0b3e96c1890746ab740df1901b5cc2245 - Update README.md
[github] 3a53a68444834aeb6e78bfdb35ae12570187acd7 - Update README.md
[github] a97bf7b504e151494d3206e8b2459e666482640b - Update README.md
[github] 47db65972cd791cbb59b4ee9825e1d80a1e9d0f1 - Update README.md
[Jerin Philip] 4764f11e95cb2ec3c2766949ba58a74ee0d2cc90 - Move BatchTranslator::thread_ to Service (#10)
[Jerin Philip] f1d9f67b56ed5d84f74236b166fd592c060bf8d2 - single-threaded run with --cpu-threads 0 (#10)
[Jerin Philip] 77a600b637afd854a189f96b052f37896d37acb7 - Removing join() (#10)
[Jerin Philip] 73a56a8f4fa447fb58e230905c7c6e3d25c366da - Refactoring batching-mechanisms into Batcher
[Jerin Philip] e585a9e7861934e40d3d4e2a5793724be3a9e3a6 - Sanitizing Batch construction
[andrenatal] 1e413f71cd583bba570af8ed8fde7f797174dd41 - Including a more elaborated test page, a node webserver containing the
[Jerin Philip] 47323d21b93795e19d82a499bfb13b71f7032c40 - Getting rid of unused variables in Batch
[Jerin Philip] ecc91c51e3b439b32173e3e4a821fdfe1a538436 - BatchTranslator* -> unique_ptr
[andrenatal] 0dbc8612c2431722152ca925f1bd7152187a399a - Adding missing bergamot-httpserver.js
[Jerin Philip] 5bd4a1a3c0ef388249794298b5ed2c0b1cf92d05 - Refactor: marian-TranslationResult and associated
[Jerin Philip] 0fc6105df49a4e0f05e1d382ea9909776ad3aeec - No more two TranslationResults (sort-of)
[Jerin Philip] 370e9e2fb619b5f45693a3d4e6e3dac1442b6fed - {translation_result -> response}.h; propogates;
[Jerin Philip] be455a3da101132c5d7c3a283b90cc1cffd8a119 - Straightening multithreading in translator workers
[Jerin Philip] 45a8309c6972b121d62f1e9329267f752b8c796b - Missed translation_result -> response rename
[motin] d27a96fc53add7b36d063aaf86c528bc03798eea - Updated wasm readme
[motin] f7c86518cfbe418ba9db6655a6e093de520c618d - Update test page package-lock.json
[motin] 26ea5bba7a0a37c5785d34be6586f154f1bebb0b - Some cleanup
[motin] d3969bcd2d2430a4bf5f047d791eb768ba4cb013 - Add support for translating multiple sentences on the test page + report
[motin] 28c0ab2e04f6e32b999aac0caa181cd914f92e30 - Tweak words per second metric in the test page log
[motin] a33b3a3bb5bcac9fe34135d671773a11554dce82 - Add instructions on how to assemble and package the set of files
[motin] 53e0b9fc5c219ae57d79be57acbec0dd580e89a8 - Fix typo in lexical shortlist argument on test page
[motin] e50dd0909f4709a6336b46a0baee175353ed0150 - Ignore contents in models directory
[motin] 7030fa015745070e0d7dc8ab6f0a5d25a1d95a78 - Ignore test page bundled artifacts
[motin] 49ad6514aec6498e2a24a7dd96cff25d4e64ab5d - Add reproducible docker-based builds + let test page use these by
[motin] 77f39545f314c7a931c91aef0a11e871ff5a880c - Add time it takes to arrive to preRun to test page
[motin] dbdcdab1153be9891e2a44aa308b29c0141349aa - Avoid use of unsafe eval in glue code
[motin] 70bdcd436571de532ea202d95edf7cccf9505bb4 - Fix typo from when fixing typo
[motin] da56501c4f255d9bc57c2d244e0979c29676ad3f - Finally found the original typo that made it appear as if loading the
[motin] 1e94d78c4d2b6bb9b763c16c59b0178a8458e18f - Formatting
[motin] fcc998ffa4c2468baed11889951685ff0b923cf7 - Add 10 lines of esen benchmark sentences to test page
[motin] f3ff1d29ae4d6d036f68bc993420c36015f10b09 - Make modelConfig an object instead of string (less likelihood of typos)
[motin] 7d6346d3b0b000f281e99f972bb2fe663b93b27f - Add model config used in pr6 benchmarks
[motin] 64d57d8aa089957f5c8ffe88f7ce805de0423e6e - Use yaml for modelConfig on test page
[aaggarwal] 3dd7a60b3511e5ebc09169f33d37913834e83a1d - Enabled simd shuffle pattern for intgemm compilation
[motin] 91e45cb4f08a1b9f59757c82c61fbd5b86d88915 - Prepend shortlist path with /
[motin] 9a5ae9568e50856d520839854dc00ee2662b2d04 - Turn of assertions and disable exception catching for wasm builds
[motin] 9a5cf30bbbdee83d98e933ee122aed00b26b161a - Revert "Enabled simd shuffle pattern for intgemm compilation"
[Jerin Philip] ca6ca154b9ee74899f1a801a8a3c91972ca10043 - Changing fn name from enqueue to produceTo(pcqueue)
[aaggarwal] 0374ac4696b124ed9e015325aef3c1501a514736 - Updated marian submodule
[aaggarwal] 3607523c24ca69fa3b195f1aae1aaf0c0bb44f65 - Enabled COMPILE_WITHOUT_EXCEPTIONS for marian submodule
[aaggarwal] c5c5339489d6d209271f76ac2f53ce7ac92fa7c0 - Re-enable simd shuffle pattern for intgemm compilation
[Jerin Philip] d5a5e754510aeb158fea3e82939426e4d29885ed - Renaming variables; Enhancing documentation
[aaggarwal] 921c2eedf812b3304a06ebfad890fb025755c2a0 - Updated config for min inference time
[motin] b1e72ce75e2bce611b6dee11408278f8b3e3e4ec - Updated instructions on how to get all relevant models in place for the
[motin] d907400a80d59cac771dad7f31d67bcb67411270 - Updated test page to use the model structure from bergamot-models repo
[Jerin Philip] 65e74069709784614d6936a1ea55623ee001d04b - Comments and lazy stuff to response
[Jerin Philip] 4c8b655ac5c46c6eaaafa6dd3eea32232866a182 - Batch cleanup
[Jerin Philip] 9c907ea605af4a568fb945272247ada8e70a6a9c - another int to size_t
[Jerin Philip] d7556bc1681048856e8e3e5f83087b2856221c0e - SentenceRanges: Class to work with string_views
[Jerin Philip] 0296a38cd48970234753cf4f95e7d46269aa089f - Bunch of integers on containers to size_ts
[Jerin Philip] 69201ba44ccd1611fe03ce5a6d225cad118c2ba1 - Unify options with marian
[Jerin Philip] fba44bec8f754e0a17c7bbc76d50697121bf97a3 - Improving Batcher error message with new option names
[Jerin Philip] c205c82585752b32f6f60191edcbb8bdebd687f7 - Updates to README with option changes
[Jerin Philip] 44a44fa1562319178e5246205ef6c5b5fbc49f10 - CMake build with submodule recursive clones
[Jerin Philip] d005f73cb9c67e39766d19130cb4499c71adb9d0 - Reverting changes to PCQueue
[aaggarwal] b86f8a7dc2f57b2ff0d21ca16be6a332126d4199 - Improved README
[Jerin Philip] 72848ba0f6070be711cbf7f8bbbdaf5dd534e9fb - Fixes UEdin builds after wasm-integration merge
[Jerin Philip] 47b9db0c455528984e868a03709e0fb4bedddb37 - Documentation formatting/syntax fix
[Jerin Philip] 7b10c3548333d8c5b67b1c6c32b1e279647c5e68 - Hard abort if multithread path launched without multithread-support
[Jerin Philip] 70b57ee3e7ed1f0569d6c838851354753fe88c8d - Redundant parser include fixed
[Jerin Philip] d72343567c978d9a8605193f7027c23edff728b3 - BatchTranslator doesn't do thread_, residue from merge removed
[aaggarwal] 9feebe5cb2509e137c412a925a8c905ad0a51daa - Allow using relative paths for packaging files
[Jerin Philip] b9d081dd4552ac8f6baf536046b1eebbfb7792ef - Temporary: Updating marian-dev to wasm branch
[Jerin Philip] d249dcbfaa45f44cda022482b314143a9b9e2b80 - Build doc updated with wasm-branch compatible command
[aaggarwal] b75e72e65d55307ff5f4e3b499680609031c686d - Added more explanation for FILES_TO_PACKAGE in README
[Jerin Philip] ca9aa64926684f41a36c29e4cba8b23ac9e550ec - Switch to work with ssplit-cpp both pcre2 and pcrecpp
[Jerin Philip] fbff7389d1f735272133db68f5029772dabc78c0 - Temporary: Switch to abhi-agg/ssplit-cpp@wasm
[aaggarwal] c2371dd771b36be8396da5da156fadc4bde0e744 - Replaced "build-wasm-docker" with "build-wasm"
[aaggarwal] 79571bada5ef8fdd20ae623521f0f64ac42ed4ff - Improved wasm/README
[motin] 51f702ea6c849687488d6478b3bc428f0ad033ae - Remove Docker-based builds since they are no more reproducible than
[aaggarwal] 5dcbb721faadc55ded424b6df5b74854e54d600e - Update ssplit submodule to master branch
[aaggarwal] fa4a1ed67d2313efc88d4ac7930da08ab5e882b7 - Adapted model config in test example of bergamot
[aaggarwal] 462a850d8ae554e835f0e3e64aef897aa3f93dad - Changed Sentences to Paragraphs in test page of WASM
[aaggarwal] 458176c0501880e3f308cf90bfc8b8fb7e9504c6 - Enable building pcre2 from sources for ssplit submodule
[aaggarwal] 415d16bd1de06e67f46d02c54edabbf4e980bd9b - Single cmake option to enable/disable wasm compatible marian compilation
View full output