Closed justaddcoffee closed 2 years ago
Started a separate PR for NEAT-related changes I don't want to trigger new builds for (https://github.com/Knowledge-Graph-Hub/kg-idg/pull/49)
Looks like the gcloud instance can't find conda
Looks like this is working - is it in a shape where we can reintegrate the ETL stages?
Yeah, I think so. Let me push up a commit that does this, and we can see how it goes
SonarCloud Quality Gate failed.
We install the working ensmallen
but it looks like NEAT doesn't use it:
00:45:17 + neat updateyaml --input_path /tmp/kg-idg-neat.20211221.yaml --keys name,description,output_directory,graph_data:graph:node_path,graph_data:graph:edge_path,upload:s3_bucket_dir --values kg-idg-20211221,kg-idg-20211221,20211221/graph_ml/,20211221/merged-kg_nodes.tsv,20211221/merged-kg_edges.tsv,kg-idg/20211221/graph_ml/
00:45:20 Traceback (most recent call last):
00:45:20 File "/var/lib/jenkins/workspace/_add_neat_to_jenkins_run_jenkins/gitrepo/venv/bin/neat", line 11, in <module>
00:45:20 load_entry_point('neat==0.0.1', 'console_scripts', 'neat')()
00:45:20 File "/var/lib/jenkins/workspace/_add_neat_to_jenkins_run_jenkins/gitrepo/venv/lib/python3.8/site-packages/pkg_resources/__init__.py", line 489, in load_entry_point
00:45:20 return get_distribution(dist).load_entry_point(group, name)
00:45:20 File "/var/lib/jenkins/workspace/_add_neat_to_jenkins_run_jenkins/gitrepo/venv/lib/python3.8/site-packages/pkg_resources/__init__.py", line 2852, in load_entry_point
00:45:20 return ep.load()
00:45:20 File "/var/lib/jenkins/workspace/_add_neat_to_jenkins_run_jenkins/gitrepo/venv/lib/python3.8/site-packages/pkg_resources/__init__.py", line 2443, in load
00:45:20 return self.resolve()
00:45:20 File "/var/lib/jenkins/workspace/_add_neat_to_jenkins_run_jenkins/gitrepo/venv/lib/python3.8/site-packages/pkg_resources/__init__.py", line 2449, in resolve
00:45:20 module = __import__(self.module_name, fromlist=['__name__'], level=0)
00:45:20 File "/var/lib/jenkins/workspace/_add_neat_to_jenkins_run_jenkins/gitrepo/venv/lib/python3.8/site-packages/neat/cli.py", line 4, in <module>
00:45:20 from ensmallen import Graph # type: ignore
00:45:20 File "/var/lib/jenkins/workspace/_add_neat_to_jenkins_run_jenkins/gitrepo/venv/lib/python3.8/site-packages/ensmallen/__init__.py", line 13, in <module>
00:45:20 raise ValueError(
00:45:20 ValueError: This library was compiled assuming that SIMD instruction commonly available in CPU hardware since 2013 are present on the machine where this library is intended to run.
00:45:20 On the current machine, the flags {'avx', 'avx2', 'bmi2', 'bmi1'} are not available.
00:45:20 You could still compile Ensmallen on this machine and have a version of the library that can execute here, but the library has been extensively designed to use SIMD instructions, so you would have a version slower than the one provided on Pypi.
(this is a duplicate PR)
Add stages to Jenkinsfile to: