techascent / tmducken

tech.ml.dataset integration with duckdb
MIT License
58 stars 5 forks source link

`[scripts/enable-duckdb]` Latest version: 0.10.0 #19

Closed harold closed 8 months ago

harold commented 8 months ago

We can use this branch to get everything working on the latest.

Fixes: https://github.com/techascent/tmducken/issues/20

harold commented 8 months ago

Dumping stova core on the latest ddb (version 0.10.0)

harold@freeside:~/src/tmducken [ddb-version-0.10.0]$ rm -rf binaries/
harold@freeside:~/src/tmducken [ddb-version-0.10.0]$ source scripts/enable-duckdb 
--2024-02-17 12:17:48--  https://github.com/duckdb/duckdb/releases/download/v0.10.0/libduckdb-linux-amd64.zip
Resolving github.com (github.com)... 140.82.113.4
Connecting to github.com (github.com)|140.82.113.4|:443... connected.
HTTP request sent, awaiting response... 302 Found
Location: https://objects.githubusercontent.com/github-production-release-asset-2e65be/138754790/9bdcae2e-b5ed-41d6-9db5-5a4447b51b0b?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAVCODYLSA53PQK4ZA%2F20240217%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240217T191749Z&X-Amz-Expires=300&X-Amz-Signature=bf59fb64fd01d29af5f6d16756c80bfff3275ebb0b40a15821a991f527ce14ed&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=138754790&response-content-disposition=attachment%3B%20filename%3Dlibduckdb-linux-amd64.zip&response-content-type=application%2Foctet-stream [following]
--2024-02-17 12:17:49--  https://objects.githubusercontent.com/github-production-release-asset-2e65be/138754790/9bdcae2e-b5ed-41d6-9db5-5a4447b51b0b?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAVCODYLSA53PQK4ZA%2F20240217%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240217T191749Z&X-Amz-Expires=300&X-Amz-Signature=bf59fb64fd01d29af5f6d16756c80bfff3275ebb0b40a15821a991f527ce14ed&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=138754790&response-content-disposition=attachment%3B%20filename%3Dlibduckdb-linux-amd64.zip&response-content-type=application%2Foctet-stream
Resolving objects.githubusercontent.com (objects.githubusercontent.com)... 185.199.110.133, 185.199.108.133, 185.199.111.133, ...
Connecting to objects.githubusercontent.com (objects.githubusercontent.com)|185.199.110.133|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 28687724 (27M) [application/octet-stream]
Saving to: ‘libduckdb-linux-amd64.zip’

libduckdb-linux-amd64.zip       100%[======================================================>]  27.36M   110MB/s    in 0.2s    

2024-02-17 12:17:49 (110 MB/s) - ‘libduckdb-linux-amd64.zip’ saved [28687724/28687724]

Archive:  libduckdb-linux-amd64.zip
  inflating: binaries/libduckdb.so   
  inflating: binaries/libduckdb_static.a  
  inflating: binaries/duckdb.hpp     
  inflating: binaries/duckdb.h       
harold@freeside:~/src/tmducken [ddb-version-0.10.0]$ ./scripts/run-tests 

Running tests in #{"test"}
12:17:58.253 [main] INFO  tmducken.duckdb - Attempting to load duckdb from "/home/harold/src/tmducken/binaries/libduckdb.so"

Testing tmducken.duckdb-test
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by tech.v3.datatype.UnsafeUtil (file:/home/harold/.m2/repository/cnuernber/dtype-next/10.011/dtype-next-10.011.jar) to constructor java.nio.DirectByteBuffer(long,int)
WARNING: Please consider reporting this to the maintainers of tech.v3.datatype.UnsafeUtil
WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
WARNING: All illegal access operations will be denied in a future release

ERROR in (insert-test) (duckdb.clj:321)
Uncaught exception, not in assertion.
expected: nil
terminate called after throwing an instance of 'duckdb::InternalException'
  what():  {"exception_type":"INTERNAL","exception_message":"Invalid PhysicalType for GetTypeIdSize","stack_trace":"\n/home/harold/src/tmducken/binaries/libduckdb.so(_ZN6duckdb9Exception13GetStackTraceEi+0x51) [0x7eff2e638161]\n/home/harold/src/tmducken/binaries/libduckdb.so(_ZN6duckdb9Exception6ToJSONENS_13ExceptionTypeERKSsRKSt13unordered_mapISsSsSt4hashISsESt8equal_toISsESaISt4pairIS2_SsEEE+0x15f) [0x7eff2e64162f]\n/home/harold/src/tmducken/binaries/libduckdb.so(_ZN6duckdb9Exception6ToJSONENS_13ExceptionTypeERKSs+0x53) [0x7eff2e6419b3]\n/home/harold/src/tmducken/binaries/libduckdb.so(_ZN6duckdb9ExceptionC1ENS_13ExceptionTypeERKSs+0x16) [0x7eff2e6419e6]\n/home/harold/src/tmducken/binaries/libduckdb.so(_ZN6duckdb17InternalExceptionC1ERKSs+0x11) [0x7eff2e643ae1]\n/home/harold/src/tmducken/binaries/libduckdb.so(+0x801aea) [0x7eff2da01aea]\n/home/harold/src/tmducken/binaries/libduckdb.so(_ZN6duckdb17VectorCacheBufferC2ERNS_9AllocatorERKNS_11LogicalTypeEm+0x9a) [0x7eff2e51f90a]\n/home/harold/src/tmducken/binaries/libduckdb.so(_ZN6duckdb11VectorCacheC1ERNS_9AllocatorERKNS_11LogicalTypeEm+0x5d) [0x7eff2e50373d]\n/home/harold/src/tmducken/binaries/libduckdb.so(_ZN6duckdb9DataChunk10InitializeERNS_9AllocatorEN9__gnu_cxx17__normal_iteratorIPKNS_11LogicalTypeESt6vectorIS5_SaIS5_EEEESB_m+0xd4) [0x7eff2e509954]\n/home/harold/src/tmducken/binaries/libduckdb.so(duckdb_create_data_chunk+0xab) [0x7eff2e966fab]\n/home/harold/.cache/JNA/temp/jna2327330459583066536.tmp(+0x16052) [0x7eff35a16052]\n/home/harold/.cache/JNA/temp/jna2327330459583066536.tmp(+0x1514c) [0x7eff35a1514c]\n/home/harold/.cache/JNA/temp/jna2327330459583066536.tmp(ffi_call+0xd8) [0x7eff35a15488]\n/home/harold/.cache/JNA/temp/jna2327330459583066536.tmp(+0xe494) [0x7eff35a0e494]\n/home/harold/.cache/JNA/temp/jna2327330459583066536.tmp(+0x14d7b) [0x7eff35a14d7b]\n/home/harold/.cache/JNA/temp/jna2327330459583066536.tmp(+0x161e8) [0x7eff35a161e8]\n[0x7effe460fa30]\n"}
1rlwrap: warning: clojure crashed, killed by SIGABRT (core dumped).
rlwrap itself has not crashed, but for transparency,
it will now kill itself with the same signal

warnings can be silenced by the --no-warnings (-n) option
./scripts/run-tests: line 6: 3368867 Aborted                 (core dumped) clj -M:test
harold commented 8 months ago

Agreed. Tests passing here as well, nice one.