search

ngageoint / hootenanny

Hootenanny conflates multiple maps into a single seamless map.
GNU General Public License v3.0
353 stars 74 forks source link

Get Translations/Debug log failed #1371

Closed balazsdukai closed 7 years ago

balazsdukai commented 7 years ago

I've just installed Hootenanny and I am able to run without provisioning it in a Chromium browser on this system:

LSB Version: core-9.20160110ubuntu0.2-amd64:core-9.20160110ubuntu0.2-noarch:security-9.20160110ubuntu0.2-amd64:security-9.20160110ubuntu0.2-noarch Distributor ID: LinuxMint Description: Linux Mint 18.1 Serena Release: 18.1 Codename: serena

However, when I launch Hootenanny in Chromium (http://localhost:8888/hootenanny-id/) I get a "Get Translations failed!" and "Get debug log failed!" error and I cannot Import Single Dataset, or do anything else. I'm a rather beginner, so it is possible that I missed and essential step somewhere... In get-translations-failed.txt you find the error log that I saved from Hootenanny.

sisskind commented 7 years ago

Could you be more specific when you say without provisioning?

balazsdukai commented 7 years ago

I meant that I call vagrant up --no-provision, because with vagrant up --provision Hootenanny in not served to Chromium.

sisskind commented 7 years ago

I think that chromium is still supported if you run vagrant up --provision. Have you tried that?

balazsdukai commented 7 years ago

Hm, no, it doesn't work for me. When run vagrant up --provision, this is the output in the terminal: I hope it helps.

Bringing machine 'default' up with 'virtualbox' provider...
==> default: Checking if box 'ubuntu/trusty64' is up to date...
==> default: Clearing any previously set forwarded ports...
==> default: Clearing any previously set network interfaces...
==> default: Preparing network interfaces based on configuration...
    default: Adapter 1: nat
==> default: Forwarding ports...
    default: 8080 (guest) => 8888 (host) (adapter 1)
    default: 8094 (guest) => 8094 (host) (adapter 1)
    default: 8096 (guest) => 8096 (host) (adapter 1)
    default: 8000 (guest) => 8000 (host) (adapter 1)
    default: 22 (guest) => 2222 (host) (adapter 1)
==> default: Running 'pre-boot' VM customizations...
==> default: Booting VM...
==> default: Waiting for machine to boot. This may take a few minutes...
    default: SSH address: 127.0.0.1:2222
    default: SSH username: vagrant
    default: SSH auth method: private key
==> default: Machine booted and ready!
==> default: Checking for guest additions in VM...
    default: The guest additions on this VM do not match the installed version of
    default: VirtualBox! In most cases this is fine, but in rare cases it can
    default: prevent things such as shared folders from working properly. If you see
    default: shared folder errors, please make sure the guest additions within the
    default: virtual machine match the version of VirtualBox you have installed on
    default: your host and reload your VM.
    default: 
    default: Guest Additions Version: 4.3.36
    default: VirtualBox Version: 5.0
==> default: Mounting shared folders...
    default: /home/vagrant/hoot => /opt/hoot
==> default: Running provisioner: hoot (shell)...
    default: Running: /tmp/vagrant-shell20170126-18352-11g4nrf.sh
==> default: HOOT_HOME: /home/vagrant/hoot
==> default: Updating OS...
==> default: ### Setup NTP...
==> default: Reading package lists...
==> default: Building dependency tree...
==> default: 
==> default: Reading state information...
==> default: ntp is already the newest version.
==> default: 0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded.
==> default:  * Stopping NTP server ntpd
==> default:    ...done.
==> default:  * Starting NTP server ntpd
==> default:    ...done.
==> default: ### Installing dependencies from repos...
==> default: Reading package lists...
==> default: Building dependency tree...
==> default: Reading state information...
==> default: 0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded.
==> default: ### Configuring environment...
==> default: gpg: 
==> default: requesting key D39DC0E3 from hkp server keys.gnupg.net
==> default: gpg: 
==> default: key D39DC0E3: "Michal Papis (RVM signing) <mpapis@gmail.com>" not changed
==> default: gpg: 
==> default: Total number processed: 1
==> default: gpg: 
==> default:              unchanged: 1
==> default: Downloading https://github.com/rvm/rvm/archive/1.28.0.tar.gz
==> default: Downloading https://github.com/rvm/rvm/releases/download/1.28.0/1.28.0.tar.gz.asc
==> default: Found PGP signature at: 'https://github.com/rvm/rvm/releases/download/1.28.0/1.28.0.tar.gz.asc',
==> default: but no GPG software exists to validate it, skipping.
==> default: Upgrading the RVM installation in /home/vagrant/.rvm/
==> default:     RVM PATH line found in /home/vagrant/.mkshrc /home/vagrant/.profile /home/vagrant/.bashrc /home/vagrant/.zshrc.
==> default:     RVM sourcing line found in /home/vagrant/.profile /home/vagrant/.bash_profile /home/vagrant/.zlogin.
==> default: Upgrade of RVM in /home/vagrant/.rvm/ is complete.
==> default: # User,
==> default: #
==> default: #   Thank you for using RVM!
==> default: #   We sincerely hope that RVM helps to make your life easier and more enjoyable!!!
==> default: #
==> default: # ~Wayne, Michal & team.
==> default: In case of problems: https://rvm.io/help and https://twitter.com/rvm_io
==> default: 
==> default: Upgrade Notes:
==> default:   * No new notes to display.
==> default: Warning! PATH is not properly set up, '/home/vagrant/.rvm/gems/ruby-2.3.3/bin' is not at first place,
==> default:          usually this is caused by shell initialization files - check them for 'PATH=...' entries,
==> default:          it might also help to re-add RVM to your dotfiles: 'rvm get stable --auto-dotfiles',
==> default:          to fix temporarily in this shell session run: 'rvm use ruby-2.3.3'.
==> default: Already installed ruby-2.3.3.
==> default: To reinstall use:
==> default:     rvm reinstall ruby-2.3.3
==> default: Using /home/vagrant/.rvm/gems/ruby-2.3.3
==> default: Reading package lists...
==> default: Building dependency tree...
==> default: Reading state information...
==> default: 0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded.
==> default: /tmp/vagrant-shell: line 207: ogrinfo: command not found
==> default: ### Building GDAL w/ FileGDB...
==> default: GDAL: configure
==> default: /bin/bash: ./config.rpath: No such file or directory
==> default: libcfitsio not found - FITS support disabled
==> default: using internal csf code.
==> default: using pre-installed libpng.
==> default: dds support disabled.
==> default: libgta not found - GTA support disabled
==> default: using internal libpcidsk.
==> default: BigTIFF support enabled.
==> default: using internal GeoTIFF code.
==> default: using pre-installed libjpeg.
==> default: using pre-installed libgif.
==> default:         did not find nc-config, some features may be missing
==> default:         use --with-netcdf=/path/to/netcdf or add nc-config to PATH
==> default: using pre-installed libnetcdf from /usr
==> default: checking for OGR ... enabled
==> default: libfreexl not found - FreeXL support disabled
==> default: config.status: WARNING:  'GDALmake.opt.in' seems to ignore the --datarootdir setting
==> default: GDAL is now configured for x86_64-unknown-linux-gnu
==> default:   Installation directory:    /usr/local
==> default:   C compiler:                gcc -g -O2 -DHAVE_SSE_AT_COMPILE_TIME
==> default:   C++ compiler:              g++ -g -O2 -DHAVE_SSE_AT_COMPILE_TIME
==> default:   LIBTOOL support:           yes
==> default:   LIBZ support:              external
==> default:   LIBLZMA support:           no
==> default:   GRASS support:             no
==> default:   CFITSIO support:           no
==> default:   PCRaster support:          internal
==> default:   LIBPNG support:            external
==> default:   DDS support:               no
==> default:   GTA support:               no
==> default:   LIBTIFF support:           external (BigTIFF=yes)
==> default:   LIBGEOTIFF support:        internal
==> default:   LIBJPEG support:           external
==> default:   12 bit JPEG:               no
==> default:   12 bit JPEG-in-TIFF:       no
==> default:   LIBGIF support:            external
==> default:   OGDI support:              yes
==> default:   HDF4 support:              yes
==> default:   HDF5 support:              yes
==> default:   NetCDF support:            yes
==> default:   Kakadu support:            no
==> default:   JasPer support:            yes (GeoJP2=yes)
==> default:   OpenJPEG support:          no
==> default:   ECW support:               no
==> default:   MrSID support:             no
==> default:   MrSID/MG4 Lidar support:   no
==> default:   MSG support:               no
==> default:   GRIB support:              yes
==> default:   EPSILON support:           no
==> default:   WebP support:              no
==> default:   cURL support (wms/wcs/...):yes
==> default:   PostgreSQL support:        yes
==> default:   MySQL support:             no
==> default:   Ingres support:            no
==> default:   Xerces-C support:          yes
==> default:   NAS support:               yes
==> default:   Expat support:             yes
==> default:   libxml2 support:           yes
==> default:   Google libkml support:     no
==> default:   ODBC support:              yes
==> default:   PGeo support:              yes
==> default:   FGDB support:              yes
==> default:   MDB support:               no
==> default:   PCIDSK support:            internal
==> default:   OCI support:               no
==> default:   GEORASTER support:         no
==> default:   SDE support:               no
==> default:   Rasdaman support:          no
==> default:   DODS support:              no
==> default:   SQLite support:            yes
==> default:   PCRE support:              yes
==> default:   SpatiaLite support:        no
==> default:   DWGdirect support          no
==> default:   INFORMIX DataBlade support:no
==> default:   GEOS support:              yes
==> default:   Poppler support:           no
==> default:   Podofo support:            no
==> default:   OpenCL support:            no
==> default:   Armadillo support:         no
==> default:   FreeXL support:            no
==> default:   SWIG Bindings:             python 
==> default:   Statically link PROJ.4:    no
==> default:   enable OGR building:       yes
==> default:   enable pthread support:    yes
==> default:   enable POSIX iconv support:yes
==> default:   hide internal symbols:     no
==> default: configure: WARNING: --with-libxml2 and --with-fgdb are both available. There might be some incompatibility between system libxml2 and the embedded copy within libFileGDBAPI
==> default: GDAL: make
==> default: GDAL: install
==> default: GDAL: python build
==> default: GDAL: python install
==> default:  * Restarting PostgreSQL 9.5 database server
==> default:    ...done.
==> default:  * Stopping Tomcat servlet engine tomcat6
==> default:    ...done.
==> default: ### Installing node-mapnik-server...
==> default: ### Installing node-export-server...
==> default: Running provisioner: build (shell)...
    default: Running: /tmp/vagrant-shell20170126-18352-13cibyn.sh
==> default: ### Configuring Hoot...
==> default: HOOT_HOME: /home/vagrant/hoot
==> default: configure.ac:7: installing './missing'
==> default: ./configure: line 15807: ogrinfo: command not found
==> default: configure: error: "There is an error with one or more GDAL file formats."
The SSH command responded with a non-zero exit status. Vagrant
assumes that this means the command failed. The output for this command
should be in the log above. Please read the output to determine what
went wrong.
brianhatchl commented 7 years ago

These symptoms indicate to me that the hoot build was incomplete during provisioning. The reason seems to be that the GDAL dependency were not successfully built and installed (e.g. the ogrinfo: command not found error.) However, the console snippet doesn't show anything obvious going wrong with the GDAL build.

When vagrant issues like this are reported I always make sure to ask about the host machine first. The vagrantfile is configured to allocate 8GB RAM and 4 CPU. Are those resources available on the system you are running?

balazsdukai commented 7 years ago

Hm that is good point, because I'm trying to run it on my laptop which has 8GB RAM and 4 CPU altogether. Thus as I understand VirtualBox won't and shouldn't allocate it all to the guest? I found the entry in the Vagrantfile, if change the setting now will it take effect? Or do I need to recompile Hootenanny?

brianhatchl commented 7 years ago

I think you are correct, but we have seen problems in the past that seemed to be caused by overallocation of host resources. My dev environment has half the available RAM and all the CPU cores allocated and I'm running without problems. Let's try changing your setup to 4GB RAM and leave CPUs alone.

You can accomplish this by adding a file named VagrantfileLocal to the hoot directory to override the defaults in the Vagrantfile:

Vagrant.configure(2) do |config|
    vb.memory = 4096
    vb.cpus = 4
  end
end

Then just issue vagrant reload for those new settings to take effect. I would attempt to run vagrant provision again to see if that clears up the issue with the GDAL build.

balazsdukai commented 7 years ago

I'm not sure what goes wrong. Adding the entry you wrote to a blank file called VagrantfileLocal and then calling vagrant reload produces the error:

There is a syntax error in the following Vagrantfile. The syntax error
message is reproduced below for convenience:

VagrantfileLocal:5: syntax error, unexpected keyword_end, expecting end-of-input

After deleting the last end and running vagrant reload I get this error:

/opt/hoot $ vagrant reload

VagrantfileLocal:2:in `block in <top (required)>': undefined local variable or method `vb' for main:Object (NameError)
    from /usr/lib/ruby/vendor_ruby/vagrant/config/v2/loader.rb:37:in `load'
    from /usr/lib/ruby/vendor_ruby/vagrant/config/loader.rb:113:in `block (2 levels) in load'
    from /usr/lib/ruby/vendor_ruby/vagrant/config/loader.rb:107:in `each'
    from /usr/lib/ruby/vendor_ruby/vagrant/config/loader.rb:107:in `block in load'
    from /usr/lib/ruby/vendor_ruby/vagrant/config/loader.rb:104:in `each'
    from /usr/lib/ruby/vendor_ruby/vagrant/config/loader.rb:104:in `load'
    from /usr/lib/ruby/vendor_ruby/vagrant/vagrantfile.rb:28:in `initialize'
    from /usr/lib/ruby/vendor_ruby/vagrant/environment.rb:706:in `new'
    from /usr/lib/ruby/vendor_ruby/vagrant/environment.rb:706:in `vagrantfile'
    from /usr/lib/ruby/vendor_ruby/vagrant/environment.rb:452:in `host'
    from /usr/lib/ruby/vendor_ruby/vagrant/environment.rb:179:in `block in action_runner'
    from /usr/lib/ruby/vendor_ruby/vagrant/action/runner.rb:33:in `run'
    from /usr/lib/ruby/vendor_ruby/vagrant/environment.rb:439:in `hook'
    from /usr/lib/ruby/vendor_ruby/vagrant/environment.rb:688:in `unload'
    from /usr/bin/vagrant:176:in `ensure in <main>'
    from /usr/bin/vagrant:176:in `<main>'

In my Vagrantfile says

Vagrant.configure(2) do |config|
  config.vm.provider "virtualbox" do |vb|
  #   # Display the VirtualBox GUI when booting the machine
  #   vb.gui = true
  #
  #   # Customize the amount of memory on the VM:
     vb.memory = 8192
     vb.cpus = 4
  end

so shouldn't I write:

Vagrant.configure(2) do |config|
    config.vm.provider "virtualbox" do |vb|
        vb.memory = 4096
        vb.cpus = 4
  end
end
brianhatchl commented 7 years ago

Yep, sorry, I did a bad job copy/pasting from my own local file that had extra stuff in there.

Let's try this:

Vagrant.configure(2) do |config|
  config.vm.provider "virtualbox" do |vb|
    vb.memory = 4096
    vb.cpus = 4
  end
end
balazsdukai commented 7 years ago

I'm afraid it didn't solve it yet...Does Hootenanny need to access my local GDAL installation? I've tried reducing the CPU to 2, just in case. But it gives the same error. The output I get in the terminal is:

 /opt/hoot $ vagrant reload
==> default: Checking if box 'ubuntu/trusty64' is up to date...
==> default: Clearing any previously set forwarded ports...
==> default: Clearing any previously set network interfaces...
==> default: Preparing network interfaces based on configuration...
    default: Adapter 1: nat
==> default: Forwarding ports...
    default: 8080 (guest) => 8888 (host) (adapter 1)
    default: 8094 (guest) => 8094 (host) (adapter 1)
    default: 8096 (guest) => 8096 (host) (adapter 1)
    default: 8000 (guest) => 8000 (host) (adapter 1)
    default: 22 (guest) => 2222 (host) (adapter 1)
==> default: Running 'pre-boot' VM customizations...
==> default: Booting VM...
==> default: Waiting for machine to boot. This may take a few minutes...
    default: SSH address: 127.0.0.1:2222
    default: SSH username: vagrant
    default: SSH auth method: private key
==> default: Machine booted and ready!
==> default: Checking for guest additions in VM...
    default: The guest additions on this VM do not match the installed version of
    default: VirtualBox! In most cases this is fine, but in rare cases it can
    default: prevent things such as shared folders from working properly. If you see
    default: shared folder errors, please make sure the guest additions within the
    default: virtual machine match the version of VirtualBox you have installed on
    default: your host and reload your VM.
    default: 
    default: Guest Additions Version: 4.3.36
    default: VirtualBox Version: 5.0
==> default: Mounting shared folders...
    default: /home/vagrant/hoot => /opt/hoot
==> default: Machine already provisioned. Run `vagrant provision` or use the `--provision`
==> default: flag to force provisioning. Provisioners marked to run always will still run.
==> default: Running provisioner: tomcat (shell)...
    default: Running: inline script
==> default:  * Starting Tomcat servlet engine tomcat6
==> default:    ...done.
==> default: Running provisioner: mapnik (shell)...
    default: Running: inline script
==> default: Starting node app ...
==> default: Node app started with pid 2224
==> default: Running provisioner: hadoop (shell)...
    default: Running: inline script
==> default: no jobtracker to stop
==> default: localhost: no tasktracker to stop
==> default: no namenode to stop
==> default: localhost: no datanode to stop
==> default: localhost: no secondarynamenode to stop
==> default: starting namenode, logging to /home/vagrant/hadoop/bin/../logs/hadoop-vagrant-namenode-vagrant-ubuntu-trusty-64.out
==> default: localhost: starting datanode, logging to /home/vagrant/hadoop/bin/../logs/hadoop-vagrant-datanode-vagrant-ubuntu-trusty-64.out
==> default: localhost: starting secondarynamenode, logging to /home/vagrant/hadoop/bin/../logs/hadoop-vagrant-secondarynamenode-vagrant-ubuntu-trusty-64.out
==> default: starting jobtracker, logging to /home/vagrant/hadoop/bin/../logs/hadoop-vagrant-jobtracker-vagrant-ubuntu-trusty-64.out
==> default: localhost: starting tasktracker, logging to /home/vagrant/hadoop/bin/../logs/hadoop-vagrant-tasktracker-vagrant-ubuntu-trusty-64.out

 /opt/hoot $ vagrant provision
==> default: Running provisioner: hoot (shell)...
    default: Running: /tmp/vagrant-shell20170127-15152-gspjtk.sh
==> default: HOOT_HOME: /home/vagrant/hoot
==> default: Updating OS...
==> default: ### Setup NTP...
==> default: Reading package lists...
==> default: Building dependency tree...
==> default: Reading state information...
==> default: ntp is already the newest version.
==> default: 0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded.
==> default:  * Stopping NTP server ntpd
==> default:    ...done.
==> default: ntpd: time slew +0.006833s
==> default:  * Starting NTP server ntpd
==> default:    ...done.
==> default: ### Installing dependencies from repos...
==> default: Reading package lists...
==> default: Building dependency tree...
==> default: Reading state information...
==> default: 0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded.
==> default: ### Configuring environment...
==> default: gpg: 
==> default: requesting key D39DC0E3 from hkp server keys.gnupg.net
==> default: gpg: 
==> default: key D39DC0E3: "Michal Papis (RVM signing) <mpapis@gmail.com>" not changed
==> default: gpg: 
==> default: Total number processed: 1
==> default: gpg: 
==> default:              unchanged: 1
==> default: Downloading https://github.com/rvm/rvm/archive/1.28.0.tar.gz
==> default: Downloading https://github.com/rvm/rvm/releases/download/1.28.0/1.28.0.tar.gz.asc
==> default: Found PGP signature at: 'https://github.com/rvm/rvm/releases/download/1.28.0/1.28.0.tar.gz.asc',
==> default: but no GPG software exists to validate it, skipping.
==> default: Upgrading the RVM installation in /home/vagrant/.rvm/
==> default:     RVM PATH line found in /home/vagrant/.mkshrc /home/vagrant/.profile /home/vagrant/.bashrc /home/vagrant/.zshrc.
==> default:     RVM sourcing line found in /home/vagrant/.profile /home/vagrant/.bash_profile /home/vagrant/.zlogin.
==> default: Upgrade of RVM in /home/vagrant/.rvm/ is complete.
==> default: # User,
==> default: #
==> default: #   Thank you for using RVM!
==> default: #   We sincerely hope that RVM helps to make your life easier and more enjoyable!!!
==> default: #
==> default: # ~Wayne, Michal & team.
==> default: In case of problems: https://rvm.io/help and https://twitter.com/rvm_io
==> default: Upgrade Notes:
==> default:   * No new notes to display.
==> default: Warning! PATH is not properly set up, '/home/vagrant/.rvm/gems/ruby-2.3.3/bin' is not at first place,
==> default:          usually this is caused by shell initialization files - check them for 'PATH=...' entries,
==> default:          it might also help to re-add RVM to your dotfiles: 'rvm get stable --auto-dotfiles',
==> default:          to fix temporarily in this shell session run: 'rvm use ruby-2.3.3'.
==> default: Already installed ruby-2.3.3.
==> default: To reinstall use:
==> default:     rvm reinstall ruby-2.3.3
==> default: Using /home/vagrant/.rvm/gems/ruby-2.3.3
==> default: Reading package lists...
==> default: Building dependency tree...
==> default: Reading state information...
==> default: 0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded.
==> default: /tmp/vagrant-shell: line 207: ogrinfo: command not found
==> default: ### Building GDAL w/ FileGDB...
==> default: GDAL: configure
==> default: /bin/bash: ./config.rpath: No such file or directory
==> default: libcfitsio not found - FITS support disabled
==> default: using internal csf code.
==> default: using pre-installed libpng.
==> default: dds support disabled.
==> default: libgta not found - GTA support disabled
==> default: using internal libpcidsk.
==> default: BigTIFF support enabled.
==> default: using internal GeoTIFF code.
==> default: using pre-installed libjpeg.
==> default: using pre-installed libgif.
==> default:         did not find nc-config, some features may be missing
==> default:         use --with-netcdf=/path/to/netcdf or add nc-config to PATH
==> default: using pre-installed libnetcdf from /usr
==> default: checking for OGR ... enabled
==> default: libfreexl not found - FreeXL support disabled
==> default: config.status: WARNING:  'GDALmake.opt.in' seems to ignore the --datarootdir setting
==> default: GDAL is now configured for x86_64-unknown-linux-gnu
==> default:   Installation directory:    /usr/local
==> default:   C compiler:                gcc -g -O2 -DHAVE_SSE_AT_COMPILE_TIME
==> default:   C++ compiler:              g++ -g -O2 -DHAVE_SSE_AT_COMPILE_TIME
==> default:   LIBTOOL support:           yes
==> default:   LIBZ support:              external
==> default:   LIBLZMA support:           no
==> default:   GRASS support:             no
==> default:   CFITSIO support:           no
==> default:   PCRaster support:          internal
==> default:   LIBPNG support:            external
==> default:   DDS support:               no
==> default:   GTA support:               no
==> default:   LIBTIFF support:           external (BigTIFF=yes)
==> default:   LIBGEOTIFF support:        internal
==> default:   LIBJPEG support:           external
==> default:   12 bit JPEG:               no
==> default:   12 bit JPEG-in-TIFF:       no
==> default:   LIBGIF support:            external
==> default:   OGDI support:              yes
==> default:   HDF4 support:              yes
==> default:   HDF5 support:              yes
==> default:   NetCDF support:            yes
==> default:   Kakadu support:            no
==> default:   JasPer support:            yes (GeoJP2=yes)
==> default:   OpenJPEG support:          no
==> default:   ECW support:               no
==> default:   MrSID support:             no
==> default:   MrSID/MG4 Lidar support:   no
==> default:   MSG support:               no
==> default:   GRIB support:              yes
==> default:   EPSILON support:           no
==> default:   WebP support:              no
==> default:   cURL support (wms/wcs/...):yes
==> default:   PostgreSQL support:        yes
==> default:   MySQL support:             no
==> default:   Ingres support:            no
==> default:   Xerces-C support:          yes
==> default:   NAS support:               yes
==> default:   Expat support:             yes
==> default:   libxml2 support:           yes
==> default:   Google libkml support:     no
==> default:   ODBC support:              yes
==> default:   PGeo support:              yes
==> default:   FGDB support:              yes
==> default:   MDB support:               no
==> default:   PCIDSK support:            internal
==> default:   OCI support:               no
==> default:   GEORASTER support:         no
==> default:   SDE support:               no
==> default:   Rasdaman support:          no
==> default:   DODS support:              no
==> default:   SQLite support:            yes
==> default:   PCRE support:              yes
==> default:   SpatiaLite support:        no
==> default:   DWGdirect support          no
==> default:   INFORMIX DataBlade support:no
==> default:   GEOS support:              yes
==> default:   Poppler support:           no
==> default:   Podofo support:            no
==> default:   OpenCL support:            no
==> default:   Armadillo support:         no
==> default:   FreeXL support:            no
==> default:   SWIG Bindings:             python 
==> default:   Statically link PROJ.4:    no
==> default:   enable OGR building:       yes
==> default:   enable pthread support:    yes
==> default:   enable POSIX iconv support:yes
==> default:   hide internal symbols:     no
==> default: configure: WARNING: --with-libxml2 and --with-fgdb are both available. There might be some incompatibility between system libxml2 and the embedded copy within libFileGDBAPI
==> default: GDAL: make
==> default: GDAL: install
==> default: GDAL: python build
==> default: GDAL: python install
==> default:  * Restarting PostgreSQL 9.5 database server
==> default:    ...done.
==> default:  * Stopping Tomcat servlet engine tomcat6
==> default:    ...done.
==> default: ### Installing node-mapnik-server...
==> default: ### Installing node-export-server...
==> default: Running provisioner: build (shell)...
    default: Running: /tmp/vagrant-shell20170127-15152-mqqwq.sh
==> default: ### Configuring Hoot...
==> default: HOOT_HOME: /home/vagrant/hoot
==> default: configure.ac:7: installing './missing'
==> default: ./configure: line 15807: ogrinfo: command not found
==> default: configure: error: "There is an error with one or more GDAL file formats."
The SSH command responded with a non-zero exit status. Vagrant
assumes that this means the command failed. The output for this command
should be in the log above. Please read the output to determine what
went wrong.
brianhatchl commented 7 years ago

Looking at the provision script, there should be a file /home/vagrant/gdal-1.10.1/GDAL_Build.txt. It's a really verbose build log which is why we redirect it to a file. Can you attach the file to this ticket? Maybe there is something in there that will give us a clue why the GDAL build is incomplete.

balazsdukai commented 7 years ago

Yes, here it is: GDAL_Build.txt

brianhatchl commented 7 years ago

So something is definitely wrong in the build:

libtool: link: `gdal_rasterize.lo' is not a valid libtool object
make[1]: *** [gdal_rasterize] Error 1
make[1]: *** Waiting for unfinished jobs....
libtool: link: `gdal_grid.lo' is not a valid libtool object
make[1]: *** [gdal_grid] Error 1
make: *** [apps-target] Error 2
libtool: link: `gdal_rasterize.lo' is not a valid libtool object
make[1]: *** [gdal_rasterize] Error 1
make: *** [apps-target] Error 2

Could you try deleting these files and dirs from the vm and re-run vagrant provision?

gdal-1.10.1.tar.gz
gdal-1.10.1
FileGDB_API_1_4-64.tar.gz
/usr/local/FileGDB_API
brianhatchl commented 7 years ago

I realize I'm on our develop branch, so on master you will have FileGDB_API13-64.tar.gz

balazsdukai commented 7 years ago

After deleting the files you said and running vagrant provision I get until the error below, and then it hangs there since about 50 min. I will also attach the error log once it manges to terminate the process. 

 $ vagrant provision
==> default: Running provisioner: hoot (shell)...
    default: Running: /tmp/vagrant-shell20170127-21724-qajiir.sh
==> default: HOOT_HOME: /home/vagrant/hoot
==> default: Updating OS...
==> default: ### Setup NTP...
==> default: Reading package lists...
==> default: Building dependency tree...
==> default: Reading state information...
==> default: ntp is already the newest version.
==> default: 0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded.
==> default:  * Stopping NTP server ntpd
==> default:    ...done.
==> default: ntpd: time slew +0.000619s
==> default:  * Starting NTP server ntpd
==> default:    ...done.
==> default: ### Installing dependencies from repos...
==> default: Reading package lists...
==> default: Building dependency tree...
==> default: Reading state information...
==> default: 0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded.
==> default: ### Configuring environment...
==> default: gpg: 
==> default: requesting key D39DC0E3 from hkp server keys.gnupg.net
==> default: gpg: 
==> default: key D39DC0E3: "Michal Papis (RVM signing) <mpapis@gmail.com>" not changed
==> default: gpg: 
==> default: Total number processed: 1
==> default: gpg: 
==> default:              unchanged: 1
==> default: Downloading https://github.com/rvm/rvm/archive/1.28.0.tar.gz
==> default: Downloading https://github.com/rvm/rvm/releases/download/1.28.0/1.28.0.tar.gz.asc
==> default: Found PGP signature at: 'https://github.com/rvm/rvm/releases/download/1.28.0/1.28.0.tar.gz.asc',
==> default: but no GPG software exists to validate it, skipping.
==> default: Upgrading the RVM installation in /home/vagrant/.rvm/
==> default:     RVM PATH line found in /home/vagrant/.mkshrc /home/vagrant/.profile /home/vagrant/.bashrc /home/vagrant/.zshrc.
==> default:     RVM sourcing line found in /home/vagrant/.profile /home/vagrant/.bash_profile /home/vagrant/.zlogin.
==> default: Upgrade of RVM in /home/vagrant/.rvm/ is complete.
==> default: # User,
==> default: #
==> default: #   Thank you for using RVM!
==> default: #   We sincerely hope that RVM helps to make your life easier and more enjoyable!!!
==> default: #
==> default: # ~Wayne, Michal & team.
==> default: In case of problems: https://rvm.io/help and https://twitter.com/rvm_io
==> default: Upgrade Notes:
==> default:   * No new notes to display.
==> default: Warning! PATH is not properly set up, '/home/vagrant/.rvm/gems/ruby-2.3.3/bin' is not at first place,
==> default:          usually this is caused by shell initialization files - check them for 'PATH=...' entries,
==> default:          it might also help to re-add RVM to your dotfiles: 'rvm get stable --auto-dotfiles',
==> default:          to fix temporarily in this shell session run: 'rvm use ruby-2.3.3'.
==> default: Already installed ruby-2.3.3.
==> default: To reinstall use:
==> default: 
==> default:     rvm reinstall ruby-2.3.3
==> default: Using /home/vagrant/.rvm/gems/ruby-2.3.3
==> default: Reading package lists...
==> default: Building dependency tree...
==> default: Reading state information...
==> default: 0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded.
==> default: /tmp/vagrant-shell: line 207: ogrinfo: command not found
==> default: ### Downloading GDAL source...
==> default: ### Extracting GDAL source...
==> default: ### Downloading FileGDB API source...
==> default: ### Extracting FileGDB API source & installing lib...
==> default: ### Building GDAL w/ FileGDB...
==> default: GDAL: configure
==> default: /bin/bash: ./config.rpath: No such file or directory
==> default: libcfitsio not found - FITS support disabled
==> default: using internal csf code.
==> default: using pre-installed libpng.
==> default: dds support disabled.
==> default: libgta not found - GTA support disabled
==> default: using internal libpcidsk.
==> default: BigTIFF support enabled.
==> default: using internal GeoTIFF code.
==> default: using pre-installed libjpeg.
==> default: using pre-installed libgif.
==> default:         did not find nc-config, some features may be missing
==> default:         use --with-netcdf=/path/to/netcdf or add nc-config to PATH
==> default: using pre-installed libnetcdf from /usr
==> default: checking for OGR ... enabled
==> default: libfreexl not found - FreeXL support disabled
==> default: config.status: WARNING:  'GDALmake.opt.in' seems to ignore the --datarootdir setting
==> default: GDAL is now configured for x86_64-unknown-linux-gnu
==> default:   Installation directory:    /usr/local
==> default:   C compiler:                gcc -g -O2 -DHAVE_SSE_AT_COMPILE_TIME
==> default:   C++ compiler:              g++ -g -O2 -DHAVE_SSE_AT_COMPILE_TIME
==> default:   LIBTOOL support:           yes
==> default:   LIBZ support:              external
==> default:   LIBLZMA support:           no
==> default:   GRASS support:             no
==> default:   CFITSIO support:           no
==> default:   PCRaster support:          internal
==> default:   LIBPNG support:            external
==> default:   DDS support:               no
==> default:   GTA support:               no
==> default:   LIBTIFF support:           external (BigTIFF=yes)
==> default:   LIBGEOTIFF support:        internal
==> default:   LIBJPEG support:           external
==> default:   12 bit JPEG:               no
==> default:   12 bit JPEG-in-TIFF:       no
==> default:   LIBGIF support:            external
==> default:   OGDI support:              yes
==> default:   HDF4 support:              yes
==> default:   HDF5 support:              yes
==> default:   NetCDF support:            yes
==> default:   Kakadu support:            no
==> default:   JasPer support:            yes (GeoJP2=yes)
==> default:   OpenJPEG support:          no
==> default:   ECW support:               no
==> default:   MrSID support:             no
==> default:   MrSID/MG4 Lidar support:   no
==> default:   MSG support:               no
==> default:   GRIB support:              yes
==> default:   EPSILON support:           no
==> default:   WebP support:              no
==> default:   cURL support (wms/wcs/...):yes
==> default:   PostgreSQL support:        yes
==> default:   MySQL support:             no
==> default:   Ingres support:            no
==> default:   Xerces-C support:          yes
==> default:   NAS support:               yes
==> default:   Expat support:             yes
==> default:   libxml2 support:           yes
==> default:   Google libkml support:     no
==> default:   ODBC support:              yes
==> default:   PGeo support:              yes
==> default:   FGDB support:              yes
==> default:   MDB support:               no
==> default:   PCIDSK support:            internal
==> default:   OCI support:               no
==> default:   GEORASTER support:         no
==> default:   SDE support:               no
==> default:   Rasdaman support:          no
==> default:   DODS support:              no
==> default:   SQLite support:            yes
==> default:   PCRE support:              yes
==> default:   SpatiaLite support:        no
==> default:   DWGdirect support          no
==> default:   INFORMIX DataBlade support:no
==> default:   GEOS support:              yes
==> default:   Poppler support:           no
==> default:   Podofo support:            no
==> default:   OpenCL support:            no
==> default:   Armadillo support:         no
==> default:   FreeXL support:            no
==> default:   SWIG Bindings:             python 
==> default:   Statically link PROJ.4:    no
==> default:   enable OGR building:       yes
==> default:   enable pthread support:    yes
==> default:   enable POSIX iconv support:yes
==> default:   hide internal symbols:     no
==> default: configure: WARNING: --with-libxml2 and --with-fgdb are both available. There might be some incompatibility between system libxml2 and the embedded copy within libFileGDBAPI
==> default: GDAL: make
==> default: GDAL: install
==> default: GDAL: python build
==> default: GDAL: python install
==> default:  * Restarting PostgreSQL 9.5 database server
==> default:    ...done.
==> default:  * Stopping Tomcat servlet engine tomcat6
==> default:    ...done.
==> default: ### Installing node-mapnik-server...
==> default: ### Installing node-export-server...
==> default: Running provisioner: build (shell)...
    default: Running: /tmp/vagrant-shell20170127-21724-jyb2om.sh
==> default: ### Configuring Hoot...
==> default: HOOT_HOME: /home/vagrant/hoot
==> default: configure.ac:7: installing './missing'
==> default: Hootenanny Web Services enabled.
==> default: R&D experimental functions enabled.
==> default: Hootenanny UI tests enabled.
==> default: grep: 
==> default: LocalConfig.pri
==> default: : No such file or directory
==> default: Customizing LocalConfig.pri...
==> default: Building Hoot... 
==> default: Will take several extra minutes to build the training data the initial time Hootenanny is installed only.
==> default: Making clean in stub
==> default: WARNING: Failure to find: src/main/cpp/hoot/core/util/ConfigDefaults.h
==> default: WARNING: Failure to find: src/main/cpp/hoot/core/util/ConfigOptions.h
==> default: ERROR:  relation "maps" does not exist
==> default: LINE 1: SELECT display_name FROM maps WHERE display_name like '%Cucu...
==> default:                                  ^
==> default: Making all in stub
==> default: #
==> default: # A fatal error has been detected by the Java Runtime Environment:
==> default: #
==> default: #  SIGSEGV (0xb) at pc=0x00002aabbcd05fe5, pid=3511, tid=0x00002aabd661e700
==> default: #
==> default: # JRE version: Java(TM) SE Runtime Environment (8.0_112-b15) (build 1.8.0_112-b15)
==> default: # Java VM: Java HotSpot(TM) 64-Bit Server VM (25.112-b15 mixed mode linux-amd64 compressed oops)
==> default: # Problematic frame:
==> default: # 
==> default: V  [libjvm.so+0x7fdfe5]
==> default:   PhaseLive::compute(unsigned int)+0x3f5
==> default: #
==> default: # Failed to write core dump. Core dumps have been disabled. To enable core dumping, try "ulimit -c unlimited" before starting Java again
==> default: #
==> default: # An error report file with more information is saved as:
==> default: # /home/vagrant/hoot/hoot-services/hs_err_pid3511.log
brianhatchl commented 7 years ago

That's progress. We're past the GDAL build and the latest error is now occurring in the hoot code build.

I have not seen that jvm error before (have you @dmylov?)

We can do a more targeted rebuild within the vagrant ssh terminal if you want to Ctrl+C to end the provision process. I'm not sure why it's hanging and just didn't exit with that error.

You can try these steps to build hoot-services in isolation to see if the jvm error reoccurs:

vagrant ssh
cd hoot
source SetupEnv.sh
cd hoot-services
make clean
make
balazsdukai commented 7 years ago

Yes indeed I get a more detailed error from running make. I attached it too: make_error.txt

brianhatchl commented 7 years ago

It seems like the initial provision left some external dependencies partially downloaded and corrupt. First gdal or the FileGDB_API and now maven jars.

(/home/vagrant/.m2/repository/org/liquibase/liquibase-maven-plugin/3.1.0/liquibase-maven-plugin-3.1.0.jar): zip file is empty

Can you delete this file and re-run make?

dmylov commented 7 years ago

I've never seen the error happen during provision. Is it happening repeatedly?

brianhatchl commented 7 years ago

I think we have some corrupt dependencies (jars, source files, etc) that need re-downloading. The subsequent errors are probably all cascading from that.

balazsdukai commented 7 years ago

I've just re-run make and attached the error log. I assume at this point might be better to re-install Hootenanny, instead of individually tracing down the broken dependencies. make_error2.txt

@dmylov it's my first time with Hootenanny, so I cannot tell

brianhatchl commented 7 years ago

I agree, seems like there was a network hiccup, maybe caused by resource over-allocation and a bunch of files weren't fully downloaded.

To start from scratch you can just run vagrant destroy and then vagrant up.

balazsdukai commented 7 years ago

Yaay! It works :-) @brianhatchl thank you very very much for your help! Although I cannot add datasets(shp)...But I will open another issue for that.