search

uber / aresdb

A GPU-powered real-time analytics storage and query engine.
https://eng.uber.com/aresdb/
Apache License 2.0
3.01k stars 234 forks source link

docker build error #244

Closed yutiansut closed 5 years ago

yutiansut commented 5 years ago

docker build error in last step RUN make aresd -j

Step 27/27 : RUN make aresd -j
 ---> Running in 2bdfb1ea1d1d
Scanning dependencies of target mem
[  5%] Building C object CMakeFiles/mem.dir/cgoutils/memory/malloc.c.o
[ 11%] Linking C shared library lib/libmem.so
[ 11%] Built target mem
Scanning dependencies of target algorithm
[ 16%] Building CUDA object CMakeFiles/algorithm.dir/query/algorithm.cu.o
[ 22%] Building CUDA object CMakeFiles/algorithm.dir/query/dimension_transform.cu.o
[ 27%] Building CUDA object CMakeFiles/algorithm.dir/query/filter.cu.o
[ 33%] Building CUDA object CMakeFiles/algorithm.dir/query/functor.cu.o
[ 38%] Building CUDA object CMakeFiles/algorithm.dir/query/geo_intersects.cu.o
[ 44%] Building CUDA object CMakeFiles/algorithm.dir/query/hash_lookup.cu.o
[ 50%] Building CUDA object CMakeFiles/algorithm.dir/query/hash_reduction.cu.o
[ 55%] Building CUDA object CMakeFiles/algorithm.dir/query/hll.cu.o
[ 61%] Building CUDA object CMakeFiles/algorithm.dir/query/memory.cu.o
[ 66%] Building CUDA object CMakeFiles/algorithm.dir/query/measure_transform.cu.o
[ 72%] Building CUDA object CMakeFiles/algorithm.dir/query/scratch_space_transform.cu.o
[ 77%] Building CUDA object CMakeFiles/algorithm.dir/query/sort_reduce.cu.o
[ 83%] Building CUDA object CMakeFiles/algorithm.dir/query/transform.cu.o
[ 88%] Building CUDA object CMakeFiles/algorithm.dir/query/utils.cu.o
/root/go/src/github.com/uber/aresdb/query/utils.hpp(114): warning: floating-point value does not fit in required integral type
          detected during:
            instantiation of "Value ares::get_identity_value<Value>(AggregateFunction) [with Value=int32_t]"
/root/go/src/github.com/uber/aresdb/query/iterator.hpp(608): here
            instantiation of "ares::MeasureOutputIterator<Value>::MeasureOutputIterator(Value *, const uint32_t *, const uint32_t *, AggregateFunction) [with Value=int32_t]"
/root/go/src/github.com/uber/aresdb/query/iterator.hpp(650): here
            instantiation of "ares::MeasureOutputIterator<Value> ares::make_measure_output_iterator(Value *, uint32_t *, uint32_t *, AggregateFunction) [with Value=int32_t]"
/root/go/src/github.com/uber/aresdb/query/measure_transform.cu(31): here
            instantiation of "int ares::OutputVectorBinder<NInput, FunctorType>::transformMeasureOutput(MeasureOutputVector) const [with NInput=1, FunctorType=UnaryFunctorType]"
/root/go/src/github.com/uber/aresdb/query/measure_transform.cu(43): here

/root/go/src/github.com/uber/aresdb/query/utils.hpp(114): warning: floating-point value does not fit in required integral type
          detected during instantiation of "Value ares::get_identity_value<Value>(AggregateFunction) [with Value=uint32_t]"
/root/go/src/github.com/uber/aresdb/query/hash_reduction.cu(364): here

/usr/local/cuda/bin/../targets/x86_64-linux/include/thrust/iterator/iterator_facade.h(128): warning: calling a __host__ function from a __host__ __device__ function is not allowed
          detected during:
            instantiation of "Facade::reference thrust::iterator_core_access::dereference(const Facade &) [with Facade=ares::GeoBatchIntersectIterator<ares::ColumnIterator<GeoPointT>>]"
(310): here
            instantiation of "thrust::iterator_facade<Derived, Value, System, Traversal, Reference, Difference>::reference thrust::iterator_facade<Derived, Value, System, Traversal, Reference, Difference>::operator*() const [with Derived=ares::GeoBatchIntersectIterator<ares::ColumnIterator<GeoPointT>>, Value=ares::EmptyStruct, System=thrust::host_system_tag, Traversal=thrust::random_access_traversal_tag, Reference=ares::EmptyStruct, Difference=std::ptrdiff_t]"
/usr/local/cuda/bin/../targets/x86_64-linux/include/thrust/system/detail/sequential/for_each.h(56): here
            instantiation of "InputIterator thrust::system::detail::sequential::for_each(thrust::system::detail::sequential::execution_policy<DerivedPolicy> &, InputIterator, InputIterator, UnaryFunction) [with DerivedPolicy=thrust::system::cpp::detail::par_t, InputIterator=ares::GeoBatchIntersectIterator<ares::ColumnIterator<GeoPointT>>, UnaryFunction=ares::VoidFunctor]"
/usr/local/cuda/bin/../targets/x86_64-linux/include/thrust/detail/for_each.inl(44): here
            instantiation of "InputIterator thrust::for_each(const thrust::detail::execution_policy_base<DerivedPolicy> &, InputIterator, InputIterator, UnaryFunction) [with DerivedPolicy=thrust::system::cpp::detail::par_t, InputIterator=ares::GeoBatchIntersectIterator<ares::ColumnIterator<GeoPointT>>, UnaryFunction=ares::VoidFunctor]"
/root/go/src/github.com/uber/aresdb/query/geo_intersects.cu(282): here
            instantiation of "void ares::calculateBatchIntersection(GeoShapeBatch, InputIterator, uint32_t *, int, uint32_t, uint32_t *, __nv_bool, cudaStream_t) [with InputIterator=ares::ColumnIterator<GeoPointT>]"
/root/go/src/github.com/uber/aresdb/query/geo_intersects.cu(292): here
            instantiation of "int ares::GeoIntersectionContext::run(uint32_t *, InputIterator) [with InputIterator=ares::ColumnIterator<GeoPointT>]"
/root/go/src/github.com/uber/aresdb/query/geo_intersects.cu(171): here
            instantiation of "int ares::InputVectorBinder<ares::GeoIntersectionContext, 1>::bind(InputIterators...) [with InputIterators=<>]"
/root/go/src/github.com/uber/aresdb/query/geo_intersects.cu(107): here

/root/go/src/github.com/uber/aresdb/query/utils.hpp(114): warning: floating-point value does not fit in required integral type
          detected during instantiation of "Value ares::get_identity_value<Value>(AggregateFunction) [with Value=uint64_t]"
/root/go/src/github.com/uber/aresdb/query/hash_reduction.cu(366): here

/root/go/src/github.com/uber/aresdb/query/utils.hpp(114): warning: floating-point value does not fit in required integral type
          detected during instantiation of "Value ares::get_identity_value<Value>(AggregateFunction) [with Value=int32_t]"
/root/go/src/github.com/uber/aresdb/query/hash_reduction.cu(370): here

/usr/local/cuda/bin/../targets/x86_64-linux/include/thrust/iterator/iterator_facade.h(128): warning: calling a __host__ function from a __host__ __device__ function is not allowed
          detected during:
            instantiation of "Facade::reference thrust::iterator_core_access::dereference(const Facade &) [with Facade=ares::GeoBatchIntersectIterator<ares::RecordIDJoinIterator<GeoPointT>>]"
(310): here
            instantiation of "thrust::iterator_facade<Derived, Value, System, Traversal, Reference, Difference>::reference thrust::iterator_facade<Derived, Value, System, Traversal, Reference, Difference>::operator*() const [with Derived=ares::GeoBatchIntersectIterator<ares::RecordIDJoinIterator<GeoPointT>>, Value=ares::EmptyStruct, System=thrust::host_system_tag, Traversal=thrust::random_access_traversal_tag, Reference=ares::EmptyStruct, Difference=std::ptrdiff_t]"
/usr/local/cuda/bin/../targets/x86_64-linux/include/thrust/system/detail/sequential/for_each.h(56): here
            instantiation of "InputIterator thrust::system::detail::sequential::for_each(thrust::system::detail::sequential::execution_policy<DerivedPolicy> &, InputIterator, InputIterator, UnaryFunction) [with DerivedPolicy=thrust::system::cpp::detail::par_t, InputIterator=ares::GeoBatchIntersectIterator<ares::RecordIDJoinIterator<GeoPointT>>, UnaryFunction=ares::VoidFunctor]"
/usr/local/cuda/bin/../targets/x86_64-linux/include/thrust/detail/for_each.inl(44): here
            instantiation of "InputIterator thrust::for_each(const thrust::detail::execution_policy_base<DerivedPolicy> &, InputIterator, InputIterator, UnaryFunction) [with DerivedPolicy=thrust::system::cpp::detail::par_t, InputIterator=ares::GeoBatchIntersectIterator<ares::RecordIDJoinIterator<GeoPointT>>, UnaryFunction=ares::VoidFunctor]"
/root/go/src/github.com/uber/aresdb/query/geo_intersects.cu(282): here
            instantiation of "void ares::calculateBatchIntersection(GeoShapeBatch, InputIterator, uint32_t *, int, uint32_t, uint32_t *, __nv_bool, cudaStream_t) [with InputIterator=ares::RecordIDJoinIterator<GeoPointT>]"
/root/go/src/github.com/uber/aresdb/query/geo_intersects.cu(292): here
            instantiation of "int ares::GeoIntersectionContext::run(uint32_t *, InputIterator) [with InputIterator=ares::RecordIDJoinIterator<GeoPointT>]"
/root/go/src/github.com/uber/aresdb/query/geo_intersects.cu(205): here
            instantiation of "int ares::InputVectorBinder<ares::GeoIntersectionContext, 1>::bind(InputIterators...) [with InputIterators=<>]"
/root/go/src/github.com/uber/aresdb/query/geo_intersects.cu(107): here

/root/go/src/github.com/uber/aresdb/query/utils.hpp(114): warning: floating-point value does not fit in required integral type
          detected during:
            instantiation of "Value ares::get_identity_value<Value>(AggregateFunction) [with Value=uint32_t]"
/root/go/src/github.com/uber/aresdb/query/iterator.hpp(608): here
            instantiation of "ares::MeasureOutputIterator<Value>::MeasureOutputIterator(Value *, const uint32_t *, const uint32_t *, AggregateFunction) [with Value=uint32_t]"
/root/go/src/github.com/uber/aresdb/query/iterator.hpp(650): here
            instantiation of "ares::MeasureOutputIterator<Value> ares::make_measure_output_iterator(Value *, uint32_t *, uint32_t *, AggregateFunction) [with Value=uint32_t]"
/root/go/src/github.com/uber/aresdb/query/measure_transform.cu(32): here
            instantiation of "int ares::OutputVectorBinder<NInput, FunctorType>::transformMeasureOutput(MeasureOutputVector) const [with NInput=1, FunctorType=UnaryFunctorType]"
/root/go/src/github.com/uber/aresdb/query/measure_transform.cu(43): here

/root/go/src/github.com/uber/aresdb/query/utils.hpp(114): warning: floating-point value does not fit in required integral type
          detected during instantiation of "Value ares::get_identity_value<Value>(AggregateFunction) [with Value=int64_t]"
/root/go/src/github.com/uber/aresdb/query/hash_reduction.cu(372): here

/root/go/src/github.com/uber/aresdb/query/utils.hpp(114): warning: floating-point value does not fit in required integral type
          detected during:
            instantiation of "Value ares::get_identity_value<Value>(AggregateFunction) [with Value=int64_t]"
/root/go/src/github.com/uber/aresdb/query/iterator.hpp(608): here
            instantiation of "ares::MeasureOutputIterator<Value>::MeasureOutputIterator(Value *, const uint32_t *, const uint32_t *, AggregateFunction) [with Value=int64_t]"
/root/go/src/github.com/uber/aresdb/query/iterator.hpp(650): here
            instantiation of "ares::MeasureOutputIterator<Value> ares::make_measure_output_iterator(Value *, uint32_t *, uint32_t *, AggregateFunction) [with Value=int64_t]"
/root/go/src/github.com/uber/aresdb/query/measure_transform.cu(34): here
            instantiation of "int ares::OutputVectorBinder<NInput, FunctorType>::transformMeasureOutput(MeasureOutputVector) const [with NInput=1, FunctorType=UnaryFunctorType]"
/root/go/src/github.com/uber/aresdb/query/measure_transform.cu(43): here

/usr/local/cuda/bin/../targets/x86_64-linux/include/thrust/iterator/iterator_facade.h(310): warning: calling a __host__ function("ares::GeoBatchIntersectIterator< ::thrust::permutation_iterator< ::ares::VectorPartyIterator< ::GeoPointT> , unsigned int *> > ::dereference const") from a __host__ __device__ function("thrust::iterator_facade< ::ares::GeoBatchIntersectIterator< ::thrust::permutation_iterator< ::ares::VectorPartyIterator< ::GeoPointT> , unsigned int *> > ,  ::ares::EmptyStruct,  ::thrust::system::cpp::detail::tag,  ::thrust::random_access_traversal_tag,  ::ares::EmptyStruct, long> ::operator * const") is not allowed

/usr/local/cuda/bin/../targets/x86_64-linux/include/thrust/iterator/iterator_facade.h(310): warning: calling a __host__ function("ares::GeoBatchIntersectIterator< ::ares::RecordIDJoinIterator< ::GeoPointT> > ::dereference const") from a __host__ __device__ function("thrust::iterator_facade< ::ares::GeoBatchIntersectIterator< ::ares::RecordIDJoinIterator< ::GeoPointT> > ,  ::ares::EmptyStruct,  ::thrust::system::cpp::detail::tag,  ::thrust::random_access_traversal_tag,  ::ares::EmptyStruct, long> ::operator * const") is not allowed

/root/go/src/github.com/uber/aresdb/query/utils.hpp: In instantiation of 'Value ares::get_identity_value(AggregateFunction) [with Value = unsigned int]':
/root/go/src/github.com/uber/aresdb/query/hash_reduction.cu:364:163:   required from here
/root/go/src/github.com/uber/aresdb/query/utils.hpp:114:47: warning: overflow in implicit constant conversion [-Woverflow]
/root/go/src/github.com/uber/aresdb/query/utils.hpp: In instantiation of 'Value ares::get_identity_value(AggregateFunction) [with Value = long unsigned int]':
/root/go/src/github.com/uber/aresdb/query/hash_reduction.cu:366:178:   required from here
/root/go/src/github.com/uber/aresdb/query/utils.hpp:114:47: warning: overflow in implicit constant conversion [-Woverflow]
/root/go/src/github.com/uber/aresdb/query/utils.hpp: In instantiation of 'Value ares::get_identity_value(AggregateFunction) [with Value = int]':
/root/go/src/github.com/uber/aresdb/query/hash_reduction.cu:370:148:   required from here
/root/go/src/github.com/uber/aresdb/query/utils.hpp:114:47: warning: overflow in implicit constant conversion [-Woverflow]
/root/go/src/github.com/uber/aresdb/query/utils.hpp: In instantiation of 'Value ares::get_identity_value(AggregateFunction) [with Value = long int]':
/root/go/src/github.com/uber/aresdb/query/hash_reduction.cu:372:151:   required from here
/root/go/src/github.com/uber/aresdb/query/utils.hpp:114:47: warning: overflow in implicit constant conversion [-Woverflow]
/root/go/src/github.com/uber/aresdb/query/utils.hpp: In instantiation of 'Value ares::get_identity_value(AggregateFunction) [with Value = int]':
/root/go/src/github.com/uber/aresdb/query/iterator.hpp:608:41:   required from 'ares::MeasureOutputIterator<Value>::MeasureOutputIterator(Value*, const uint32_t*, const uint32_t*, AggregateFunction) [with Value = int; uint32_t = unsigned int]'
/root/go/src/github.com/uber/aresdb/query/iterator.hpp:649:74:   required from 'ares::MeasureOutputIterator<Value> ares::make_measure_output_iterator(Value*, uint32_t*, uint32_t*, AggregateFunction) [with Value = int; uint32_t = unsigned int]'
/root/go/src/github.com/uber/aresdb/query/measure_transform.cu:31:65:   required from 'int ares::OutputVectorBinder<NInput, FunctorType>::transformMeasureOutput(MeasureOutputVector) const [with int NInput = 1; FunctorType = UnaryFunctorType]'
/root/go/src/github.com/uber/aresdb/query/measure_transform.cu:43:108:   required from here
/root/go/src/github.com/uber/aresdb/query/utils.hpp:114:47: warning: overflow in implicit constant conversion [-Woverflow]
/root/go/src/github.com/uber/aresdb/query/utils.hpp: In instantiation of 'Value ares::get_identity_value(AggregateFunction) [with Value = unsigned int]':
/root/go/src/github.com/uber/aresdb/query/iterator.hpp:608:41:   required from 'ares::MeasureOutputIterator<Value>::MeasureOutputIterator(Value*, const uint32_t*, const uint32_t*, AggregateFunction) [with Value = unsigned int; uint32_t = unsigned int]'
/root/go/src/github.com/uber/aresdb/query/iterator.hpp:649:74:   required from 'ares::MeasureOutputIterator<Value> ares::make_measure_output_iterator(Value*, uint32_t*, uint32_t*, AggregateFunction) [with Value = unsigned int; uint32_t = unsigned int]'
/root/go/src/github.com/uber/aresdb/query/measure_transform.cu:32:66:   required from 'int ares::OutputVectorBinder<NInput, FunctorType>::transformMeasureOutput(MeasureOutputVector) const [with int NInput = 1; FunctorType = UnaryFunctorType]'
/root/go/src/github.com/uber/aresdb/query/measure_transform.cu:43:108:   required from here
/root/go/src/github.com/uber/aresdb/query/utils.hpp:114:47: warning: overflow in implicit constant conversion [-Woverflow]
/root/go/src/github.com/uber/aresdb/query/utils.hpp: In instantiation of 'Value ares::get_identity_value(AggregateFunction) [with Value = long int]':
/root/go/src/github.com/uber/aresdb/query/iterator.hpp:608:41:   required from 'ares::MeasureOutputIterator<Value>::MeasureOutputIterator(Value*, const uint32_t*, const uint32_t*, AggregateFunction) [with Value = long int; uint32_t = unsigned int]'
/root/go/src/github.com/uber/aresdb/query/iterator.hpp:649:74:   required from 'ares::MeasureOutputIterator<Value> ares::make_measure_output_iterator(Value*, uint32_t*, uint32_t*, AggregateFunction) [with Value = long int; uint32_t = unsigned int]'
/root/go/src/github.com/uber/aresdb/query/measure_transform.cu:34:65:   required from 'int ares::OutputVectorBinder<NInput, FunctorType>::transformMeasureOutput(MeasureOutputVector) const [with int NInput = 1; FunctorType = UnaryFunctorType]'
/root/go/src/github.com/uber/aresdb/query/measure_transform.cu:43:108:   required from here
/root/go/src/github.com/uber/aresdb/query/utils.hpp:114:47: warning: overflow in implicit constant conversion [-Woverflow]

[ 94%] Linking CUDA device code CMakeFiles/algorithm.dir/cmake_device_link.o
[100%] Linking CUDA shared library lib/libalgorithm.so
[100%] Built target algorithm
Scanning dependencies of target lib
[100%] Built target lib
Scanning dependencies of target aresd
make[3]: go: Command not found
CMakeFiles/aresd.dir/build.make:480: recipe for target 'CMakeFiles/aresd' failed
make[3]: *** [CMakeFiles/aresd] Error 127
CMakeFiles/Makefile2:546: recipe for target 'CMakeFiles/aresd.dir/all' failed
make[2]: *** [CMakeFiles/aresd.dir/all] Error 2
CMakeFiles/Makefile2:553: recipe for target 'CMakeFiles/aresd.dir/rule' failed
make[1]: *** [CMakeFiles/aresd.dir/rule] Error 2
Makefile:311: recipe for target 'aresd' failed
make: *** [aresd] Error 2
The command '/bin/sh -c make aresd -j' returned a non-zero code: 2
yutiansut commented 5 years ago

while using apt-get install go-1.11-golang

go path are in 

/usr/lib/go-1.11/bin

not 

/root/go

here is the docker run -it nvidia/cuda: latest

root@fe9b9e1ef3e4:/usr/lib/go-1.11/bin# ./go version
go version go1.11.5 linux/amd64
root@fe9b9e1ef3e4:/usr/lib/go-1.11/bin#
yutiansut commented 5 years ago

oh i may find the question

in https://github.com/uber/aresdb/blob/master/docker/Dockerfile#L6

ENV PATH=${GOPATH}/bin:/usr/lib/go-1.9/bin:/usr/local/cmake/bin:${PATH}

and in https://github.com/uber/aresdb/blob/master/docker/Dockerfile#L15

RUN apt-get install -y golang-1.11-go git npm wget

here path is go 1.9 and in fact installed 1.11 so that path gone wrong