Closed gbuehler closed 1 year ago
ronaldtse
commented
1 year ago Thanks @gbuehler for the report.
I think this happens because the Gemfile provided in the document's root directory instructs Metanorma to install the dependencies locally, however, the metanorma Docker container does not contain any development tools (like gcc), so the compilation of dependencies fails.
Can you try removing the Gemfile to see if things would work?
@CAMOBAP can you help here? Thanks!
gbuehler
commented
1 year ago Thanks Ron,
That did not work. I removed the Gemfile from the repository and I get a different error at the same point:
Running with gitlab-runner 15.6.1 (133d7e76)
on ogc-runner HvB6u3MS
Preparing the "docker" executor
00:0[2](https://gitlab.ogc.org/ogc/T18-3Dplus_Data_Standards_and_Streaming/-/jobs/8880#L2)
Using Docker executor with image metanorma/metanorma ...
Pulling docker image metanorma/metanorma ...
Using docker image sha256:92ff6[3](https://gitlab.ogc.org/ogc/T18-3Dplus_Data_Standards_and_Streaming/-/jobs/8880#L3)df1[4](https://gitlab.ogc.org/ogc/T18-3Dplus_Data_Standards_and_Streaming/-/jobs/8880#L4)becf7201d866[5](https://gitlab.ogc.org/ogc/T18-3Dplus_Data_Standards_and_Streaming/-/jobs/8880#L5)ded[6](https://gitlab.ogc.org/ogc/T18-3Dplus_Data_Standards_and_Streaming/-/jobs/8880#L6)2a39ca947c5e7febe3fa445c96c559ae37591 for metanorma/metanorma with digest metanorma/metanorma@sha256:b5c6505f481428115f10c194974e29260101c524d2a7421bc22cbef8485eff87 ...
Preparing environment
00:01
Running on runner-hvb6u3ms-project-499-concurrent-0 via gitlab...
Getting source from Git repository
00:01
Fetching changes with git depth set to 20...
Reinitialized existing Git repository in /builds/ogc/T18-3Dplus_Data_Standards_and_Streaming/.git/
Checking out 5935aacb as main...
Skipping Git submodules setup
Executing "step_script" stage of the job script
00:16
Using docker image sha256:92ff63df14becf7201d8665ded62a39ca947c5e7febe3fa445c96c559ae37591 for metanorma/metanorma with digest metanorma/metanorma@sha256:b5c6505f481428115f10c194974e29260101c524d2a7421bc22cbef8485eff87 ...
$ curl -L --retry 3 https://raw.githubusercontent.com/metanorma/metanorma-build-scripts/master/gemfile-to-bundle-add.sh | bash
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 1142 100 1142 0 0 1[8](https://gitlab.ogc.org/ogc/T18-3Dplus_Data_Standards_and_Streaming/-/jobs/8880#L8)721 0 --:--:-- --:--:-- --:--:-- 18721
[WARNING] Avoid use this script directly use metanorma/docker-gem-install@main action instead
bash: line 27: ./Gemfile: No such file or directory
Fetching gem metadata from https://rubygems.org/..............
Resolving dependencies....
Using rake 13.0.6
Using concurrent-ruby 1.1.10
Using minitest 5.16.3
Using public_suffix 5.0.0
Using faraday-em_http 1.0.0
Using faraday-excon 1.1.0
Using faraday-httpclient 1.0.1
Using multipart-post 2.2.3
Using faraday-net_http 1.0.1
Using faraday-net_http_persistent 1.2.0
Using faraday-em_synchrony 1.0.0
Using faraday-patron 1.0.0
Using faraday-retry 1.0.3
Using faraday-rack 1.0.0
Using ruby2_keywords 0.0.5
Using multi_json 1.15.0
Using connection_pool 2.3.0
Using amazing_print 1.4.0
Using asciidoctor 2.0.18
Using asciimath 2.0.4
Using htmlentities 4.3.4
Fetching racc 1.6.1 (was 1.6.0)
Using arr-pm 0.0.12
Using rsec 1.0.0
Using latex-decode 0.4.0
Using bundler 2.3.26
Using camertron-eprun 1.1.1
Using cldr-plurals-runtime-rb 1.1.0
Using cliver 0.3.2
Using cnccs 0.1.6
Using coderay 1.1.3
Using csv 3.2.5
Fetching date 3.3.0 (was 3.2.2)
Using builder 3.2.4
Using descriptive_statistics 2.5.1
Using unf_ext 0.0.8.2
Using scanf 1.0.0
Using matrix 0.4.2
Using unicode-types 1.8.0
Using link_header 0.0.8
Using ruby-ole 1.2.12.2
Using ffi 1.15.5
Using rubyzip 2.3.2
Using seven-zip 1.4.2
Using thor 1.0.1
Using rake-compiler 1.2.0
Using rake-compiler-dock 1.2.2
Using rchardet 1.8.0
Using mime-types-data 3.2022.0105
Using plist 3.6.0
Using socksify 1.7.1
Using ttfunk 1.7.0
Using gb-agencies 0.0.7
Using graphql 1.13.6
Using temple 0.9.1
Using tilt 2.0.11
Using hashie 4.1.0
Using hollaback 0.1.1
Using image_size 3.2.0
Using plane1converter 0.0.1
Using thread_safe 0.3.6
Using uuidtools 2.2.0
Fetching iso-639 0.3.6 (was 0.3.5)
Using iso639 1.3.2
Using liquid 4.0.3
Using marcel 1.0.2
Fetching mn2pdf 1.53 (was 1.50)
Installing iso-639 0.3.6 (was 0.3.5)
Installing racc 1.6.1 (was 1.6.0) with native extensions
Installing date 3.3.0 (was 3.2.2) with native extensions
Using mdb 0.5.0
Fetching timeout 0.3.1 (was 0.3.0)
Installing timeout 0.3.1 (was 0.3.0)
Using net-http-digest_auth 1.4.1
Using rubyntlm 0.6.3
Using webrick 1.7.0
Using webrobots 0.1.2
Using isoics 0.1.11
Using mini_portile2 2.8.0
Using lightly 0.3.3
Using parslet 2.0.0
Fetching json-canonicalization 0.3.1 (was 0.3.0)
Installing json-canonicalization 0.3.1 (was 0.3.0)
Using rack 2.2.4
Using rexml 3.2.5
Fetching logger 1.5.2 (was 1.5.1)
Installing logger 1.5.2 (was 1.5.1)
Using roman-numerals 0.3.0
Using ox 2.14.11
Using method_source 1.0.0
Using optout 0.0.2
Using unicode2latex 0.0.6
Fetching mnconvert 1.29.0 (was 1.27.0)
Using tokenizer 0.3.0
Using metanorma-ietf-data 0.2.0
Using i18n 1.12.0
Using tzinfo 2.0.5
Using faraday-multipart 1.0.4
Using addressable 2.8.1
Using net-http-persistent 4.0.1
Using bibtex-ruby 6.0.0
Using unf 0.1.4
Using emf2svg 1.4.3 (x86_64-linux)
Using ffi-libarchive 1.1.3
Using ffi-compiler2 2.0.1
Using sys-uname 1.2.2
Using rdf 3.2.9
Using sys-proctable 1.2.7
Using pngcheck 0.3.1 (x86_64-linux)
Using expressir 1.2.8 (x86_64-linux)
Using extract_ttc 0.3.3 (x86_64-linux)
Using sassc 2.4.0
Using haml 5.2.2
Using thor-hollaback 0.2.1
Fetching net-protocol 0.2.0 (was 0.1.3)
Using mime-types 3.4.1
Using pubid-core 1.3.0
Using ruby-graphviz 1.2.5
Using latexmath 0.1.5
Using pry 0.14.1
Using ruby-jing 0.0.3
Using bcp47 0.3.3
Using activesupport 7.0.4
Using faraday 1.10.2
Using css_parser 1.12.0
Using down 5.3.1
Using git 1.12.0
Using twitter_cldr 6.11.4
Fetching tzinfo-data 1.2022.7 (was 1.2022.6)
Installing net-protocol 0.2.0 (was 0.1.3)
Using domain_name 0.5.20190701
Using ffi-libarchive-binary 0.3.0 (x86_64-linux)
Using libmspack 0.10.1.2
Using sxp 1.2.3
Using json-ld 3.2.3
Using rdf-xsd 3.2.1
Using rdf-aggregate-repo 3.2.1
Using sparql-client 3.2.1
Using rdf-isomorphic 3.2.1
Using rdf-json 3.2.0
Using rdf-vocab 3.2.3
Fetching rdf-normalize 0.5.1 (was 0.5.0)
Installing rdf-normalize 0.5.1 (was 0.5.0)
Installing tzinfo-data 1.2022.7 (was 1.2022.6)
Using rdf-ordered-repo 3.2.1
Using lutaml-express 0.2.1
Using algolia 2.2.5
Using faraday_middleware 1.2.0
Using graphql-client 0.16.0
Using premailer 1.11.1
Using http-cookie 1.0.5
Using excavate 0.3.3
Using ebnf 2.3.1
Using json-ld-preloaded 3.2.2
Using rdf-reasoner 0.8.0
Using rdf-trix 3.2.0
Using rdf-rdfa 3.2.0
Using rdf-tabular 3.2.1
Using serrano 1.0.0
Using sparql 3.1.8
Using rdf-rdfxml 3.2.0
Using rdf-turtle 3.2.1
Installing mnconvert 1.29.0 (was 1.27.0)
Installing mn2pdf 1.53 (was 1.50)
Gem::Ext::BuildError: ERROR: Failed to build gem native extension.
current directory: /usr/local/bundle/gems/racc-1.6.1/ext/racc/cparse
/usr/local/bin/ruby -I /usr/local/lib/ruby/3.1.0 -r
./siteconf20221205-15-r02a6m.rb extconf.rb
checking for rb_block_call()... *** extconf.rb failed ***
Could not create Makefile due to some reason, probably lack of necessary
libraries and/or headers. Check the mkmf.log file for more details. You may
need configuration options.
Provided configuration options:
--with-opt-dir
--without-opt-dir
--with-opt-include
--without-opt-include=${opt-dir}/include
--with-opt-lib
--without-opt-lib=${opt-dir}/lib
--with-make-prog
--without-make-prog
--srcdir=.
--curdir
--ruby=/usr/local/bin/$(RUBY_BASE_NAME)
/usr/local/lib/ruby/3.1.0/mkmf.rb:498:in `try_do': The compiler failed to
generate an executable file. (RuntimeError)
You have to install development tools first.
from /usr/local/lib/ruby/3.1.0/mkmf.rb:591:in `try_link0'
from /usr/local/lib/ruby/3.1.0/mkmf.rb:609:in `try_link'
from /usr/local/lib/ruby/3.1.0/mkmf.rb:830:in `try_func'
from /usr/local/lib/ruby/3.1.0/mkmf.rb:1119:in `block in have_func'
from /usr/local/lib/ruby/3.1.0/mkmf.rb:1007:in `block in checking_for'
from /usr/local/lib/ruby/3.1.0/mkmf.rb:362:in `block (2 levels) in postpone'
from /usr/local/lib/ruby/3.1.0/mkmf.rb:332:in `open'
from /usr/local/lib/ruby/3.1.0/mkmf.rb:362:in `block in postpone'
from /usr/local/lib/ruby/3.1.0/mkmf.rb:332:in `open'
from /usr/local/lib/ruby/3.1.0/mkmf.rb:358:in `postpone'
from /usr/local/lib/ruby/3.1.0/mkmf.rb:1006:in `checking_for'
from /usr/local/lib/ruby/3.1.0/mkmf.rb:1118:in `have_func'
from extconf.rb:6:in `<main>'
To see why this extension failed to compile, please check the mkmf.log which can
be found here:
/usr/local/bundle/extensions/x86_64-linux/3.1.0/racc-1.6.1/mkmf.log
extconf failed, exit code 1
Gem files will remain installed in /usr/local/bundle/gems/racc-1.6.1 for
inspection.
Results logged to
/usr/local/bundle/extensions/x86_64-linux/3.1.0/racc-1.6.1/gem_make.out
/usr/local/lib/ruby/3.1.0/rubygems/ext/builder.rb:95:in `run'
/usr/local/lib/ruby/3.1.0/rubygems/ext/ext_conf_builder.rb:47:in `block in
build'
/usr/local/lib/ruby/3.1.0/tempfile.rb:317:in `open'
/usr/local/lib/ruby/3.1.0/rubygems/ext/ext_conf_builder.rb:26:in `build'
/usr/local/lib/ruby/3.1.0/rubygems/ext/builder.rb:161:in `build_extension'
/usr/local/lib/ruby/3.1.0/rubygems/ext/builder.rb:195:in `block in
build_extensions'
/usr/local/lib/ruby/3.1.0/rubygems/ext/builder.rb:192:in `each'
/usr/local/lib/ruby/3.1.0/rubygems/ext/builder.rb:192:in `build_extensions'
/usr/local/lib/ruby/3.1.0/rubygems/installer.rb:853:in `build_extensions'
/usr/local/bundle/gems/bundler-2.3.26/lib/bundler/rubygems_gem_installer.rb:72:in
`build_extensions'
/usr/local/bundle/gems/bundler-2.3.26/lib/bundler/rubygems_gem_installer.rb:28:in
`install'
/usr/local/bundle/gems/bundler-2.3.26/lib/bundler/source/rubygems.rb:207:in
`install'
/usr/local/bundle/gems/bundler-2.3.26/lib/bundler/installer/gem_installer.rb:54:in
`install'
/usr/local/bundle/gems/bundler-2.3.26/lib/bundler/installer/gem_installer.rb:16:in
`install_from_spec'
/usr/local/bundle/gems/bundler-2.3.26/lib/bundler/installer/parallel_installer.rb:186:in
`do_install'
/usr/local/bundle/gems/bundler-2.3.26/lib/bundler/installer/parallel_installer.rb:177:in
`block in worker_pool'
/usr/local/bundle/gems/bundler-2.3.26/lib/bundler/worker.rb:62:in `apply_func'
/usr/local/bundle/gems/bundler-2.3.26/lib/bundler/worker.rb:57:in `block in
process_queue'
/usr/local/bundle/gems/bundler-2.3.26/lib/bundler/worker.rb:54:in `loop'
/usr/local/bundle/gems/bundler-2.3.26/lib/bundler/worker.rb:54:in
`process_queue'
/usr/local/bundle/gems/bundler-2.3.26/lib/bundler/worker.rb:91:in `block (2
levels) in create_threads'
An error occurred while installing racc (1.6.1), and Bundler cannot continue.
In Gemfile:
metanorma-cli was resolved to 1.6.7, which depends on
metanorma-bipm was resolved to 2.1.13, which depends on
metanorma-generic was resolved to 2.2.5, which depends on
metanorma-standoc was resolved to 2.2.8, which depends on
asciimath2unitsml was resolved to 0.4.3, which depends on
nokogiri was resolved to 1.13.9, which depends on
racc
Gem::Ext::BuildError: ERROR: Failed to build gem native extension.
current directory: /usr/local/bundle/gems/date-3.3.0/ext/date
/usr/local/bin/ruby -I /usr/local/lib/ruby/3.1.0 -r
./siteconf20221205-15-ryfwwj.rb extconf.rb
checking for rb_category_warn()... *** extconf.rb failed ***
Could not create Makefile due to some reason, probably lack of necessary
libraries and/or headers. Check the mkmf.log file for more details. You may
need configuration options.
Provided configuration options:
--with-opt-dir
--without-opt-dir
--with-opt-include
--without-opt-include=${opt-dir}/include
--with-opt-lib
--without-opt-lib=${opt-dir}/lib
--with-make-prog
--without-make-prog
--srcdir=.
--curdir
--ruby=/usr/local/bin/$(RUBY_BASE_NAME)
/usr/local/lib/ruby/3.1.0/mkmf.rb:498:in `try_do': The compiler failed to
generate an executable file. (RuntimeError)
You have to install development tools first.
from /usr/local/lib/ruby/3.1.0/mkmf.rb:591:in `try_link0'
from /usr/local/lib/ruby/3.1.0/mkmf.rb:609:in `try_link'
from /usr/local/lib/ruby/3.1.0/mkmf.rb:830:in `try_func'
from /usr/local/lib/ruby/3.1.0/mkmf.rb:1119:in `block in have_func'
from /usr/local/lib/ruby/3.1.0/mkmf.rb:1007:in `block in checking_for'
from /usr/local/lib/ruby/3.1.0/mkmf.rb:362:in `block (2 levels) in postpone'
from /usr/local/lib/ruby/3.1.0/mkmf.rb:332:in `open'
from /usr/local/lib/ruby/3.1.0/mkmf.rb:362:in `block in postpone'
from /usr/local/lib/ruby/3.1.0/mkmf.rb:332:in `open'
from /usr/local/lib/ruby/3.1.0/mkmf.rb:358:in `postpone'
from /usr/local/lib/ruby/3.1.0/mkmf.rb:1006:in `checking_for'
from /usr/local/lib/ruby/3.1.0/mkmf.rb:1118:in `have_func'
from extconf.rb:6:in `<main>'
To see why this extension failed to compile, please check the mkmf.log which can
be found here:
/usr/local/bundle/extensions/x86_64-linux/3.1.0/date-3.3.0/mkmf.log
extconf failed, exit code 1
Gem files will remain installed in /usr/local/bundle/gems/date-3.3.0 for
inspection.
Results logged to
/usr/local/bundle/extensions/x86_64-linux/3.1.0/date-3.3.0/gem_make.out
/usr/local/lib/ruby/3.1.0/rubygems/ext/builder.rb:95:in `run'
/usr/local/lib/ruby/3.1.0/rubygems/ext/ext_conf_builder.rb:47:in `block in
build'
/usr/local/lib/ruby/3.1.0/tempfile.rb:317:in `open'
/usr/local/lib/ruby/3.1.0/rubygems/ext/ext_conf_builder.rb:26:in `build'
/usr/local/lib/ruby/3.1.0/rubygems/ext/builder.rb:161:in `build_extension'
/usr/local/lib/ruby/3.1.0/rubygems/ext/builder.rb:195:in `block in
build_extensions'
/usr/local/lib/ruby/3.1.0/rubygems/ext/builder.rb:192:in `each'
/usr/local/lib/ruby/3.1.0/rubygems/ext/builder.rb:192:in `build_extensions'
/usr/local/lib/ruby/3.1.0/rubygems/installer.rb:853:in `build_extensions'
/usr/local/bundle/gems/bundler-2.3.26/lib/bundler/rubygems_gem_installer.rb:72:in
`build_extensions'
/usr/local/bundle/gems/bundler-2.3.26/lib/bundler/rubygems_gem_installer.rb:28:in
`install'
/usr/local/bundle/gems/bundler-2.3.26/lib/bundler/source/rubygems.rb:207:in
`install'
/usr/local/bundle/gems/bundler-2.3.26/lib/bundler/installer/gem_installer.rb:54:in
`install'
/usr/local/bundle/gems/bundler-2.3.26/lib/bundler/installer/gem_installer.rb:16:in
`install_from_spec'
/usr/local/bundle/gems/bundler-2.3.26/lib/bundler/installer/parallel_installer.rb:186:in
`do_install'
/usr/local/bundle/gems/bundler-2.3.26/lib/bundler/installer/parallel_installer.rb:177:in
`block in worker_pool'
/usr/local/bundle/gems/bundler-2.3.26/lib/bundler/worker.rb:62:in `apply_func'
/usr/local/bundle/gems/bundler-2.3.26/lib/bundler/worker.rb:57:in `block in
process_queue'
/usr/local/bundle/gems/bundler-2.3.26/lib/bundler/worker.rb:54:in `loop'
/usr/local/bundle/gems/bundler-2.3.26/lib/bundler/worker.rb:54:in
`process_queue'
/usr/local/bundle/gems/bundler-2.3.26/lib/bundler/worker.rb:91:in `block (2
levels) in create_threads'
An error occurred while installing date (3.3.0), and Bundler cannot continue.
In Gemfile:
metanorma-cli was resolved to 1.6.7, which depends on
metanorma-bipm was resolved to 2.1.13, which depends on
metanorma-generic was resolved to 2.2.5, which depends on
metanorma-standoc was resolved to 2.2.8, which depends on
metanorma was resolved to 1.5.3, which depends on
isodoc was resolved to 2.3.6, which depends on
relaton-cli was resolved to 1.13.0, which depends on
relaton was resolved to 1.13.0, which depends on
relaton-3gpp was resolved to 1.13.0, which depends on
net-ftp was resolved to 0.1.3, which depends on
time was resolved to 0.2.0, which depends on
date
Cleaning up project directory and file based variables
00:01
ERROR: Job failed: exit code 1
CAMOBAP
commented
1 year ago @ronaldtse I have the same assumption because OGC is public flavor
@gbuehler could you please remove curl -L --retry 3 https://raw.githubusercontent.com/metanorma/metanorma-build-scripts/master/gemfile-to-bundle-add.sh | bash line from .gitlab-ci.yaml and try again
gbuehler
commented
1 year ago OK, That worked. I have removed that line from the yaml file and all repos build.
Thanks,
ronaldtse
commented
1 year ago Thanks @gbuehler @CAMOBAP !
I am not sure but it seems that there are conflicts when it gets:
https://raw.githubusercontent.com/metanorma/metanorma-build-scripts/master/gemfile-to-bundle-add.sh
further down