search

redpanda-data / connect

Fancy stream processing made operationally mundane
https://docs.redpanda.com/redpanda-connect/about/
8.1k stars 824 forks source link

Tests fail on various platforms (32bit, s390x, ppc64le) #1915

Open folliehiyuki opened 1 year ago

folliehiyuki commented 1 year ago

I'm attempting to package benthos for AlpineLinux. Currently the build is failing, as can be seen at https://gitlab.alpinelinux.org/FollieHiyuki/aports/-/pipelines/165280.

I don't think 32bit platforms are officially supported, judging that a few dependencies pulled in the testing phase failed to build. Here is the log on x86 pipeline:

go: downloading github.com/apache/pulsar-client-go v0.8.1
go: downloading github.com/DataDog/zstd v1.5.2
go: downloading github.com/spaolacci/murmur3 v1.1.0
go: downloading github.com/AthenZ/athenz v1.10.43
go: downloading github.com/apache/pulsar-client-go/oauth2 v0.0.0-20220524063205-c41616b2f512
go: downloading github.com/ardielle/ardielle-go v1.5.2
go: downloading github.com/ory/dockertest/v3 v3.9.1
go: downloading github.com/stretchr/objx v0.5.0
go: downloading github.com/docker/cli v23.0.1+incompatible
go: downloading github.com/docker/go-units v0.5.0
go: downloading github.com/docker/go-connections v0.4.0
go: downloading github.com/Nvveen/Gotty v0.0.0-20120604004816-cd527374f1e5
go: downloading github.com/moby/term v0.0.0-20210619224110-3f7ff695adc6
go: downloading github.com/opencontainers/runc v1.1.4
go: downloading github.com/opencontainers/image-spec v1.0.3-0.20211202183452-c5a74bcca799
go: downloading github.com/containerd/continuity v0.3.0
go: downloading github.com/opencontainers/go-digest v1.0.0
go: downloading gopkg.in/yaml.v2 v2.4.0
go: downloading github.com/imdario/mergo v0.3.13
go: downloading github.com/docker/docker v23.0.1+incompatible
go: downloading github.com/google/shlex v0.0.0-20191202100458-e7afc7fbc510
# github.com/benthosdev/benthos/v4/internal/bloblang/query [github.com/benthosdev/benthos/v4/internal/bloblang/query.test]
internal/bloblang/query/functions_test.go:491:53: cannot use math.MaxInt64 (untyped int constant 9223372036854775807) as int value in argument to InitFunctionHelper (overflows)
?       github.com/benthosdev/benthos/v4/cmd/benthos    [no test files]
?       github.com/benthosdev/benthos/v4/cmd/serverless/benthos-lambda  [no test files]
?       github.com/benthosdev/benthos/v4/internal/bloblang/plugins  [no test files]
?       github.com/benthosdev/benthos/v4/internal/bundle    [no test files]
?       github.com/benthosdev/benthos/v4/internal/cli/blobl [no test files]
?       github.com/benthosdev/benthos/v4/internal/cli/common    [no test files]
?       github.com/benthosdev/benthos/v4/internal/cli/studio/metrics    [no test files]
?       github.com/benthosdev/benthos/v4/internal/cli/studio/tracing    [no test files]
?       github.com/benthosdev/benthos/v4/internal/cli/template  [no test files]
?       github.com/benthosdev/benthos/v4/internal/cli/test/docs [no test files]
?       github.com/benthosdev/benthos/v4/internal/component/input/processors    [no test files]
?       github.com/benthosdev/benthos/v4/internal/component/interop [no test files]
?       github.com/benthosdev/benthos/v4/internal/component/output/processors   [no test files]
?       github.com/benthosdev/benthos/v4/internal/component/tracer  [no test files]
?       github.com/benthosdev/benthos/v4/internal/config/schema [no test files]
?       github.com/benthosdev/benthos/v4/internal/cuegen    [no test files]
?       github.com/benthosdev/benthos/v4/internal/docs/interop  [no test files]
?       github.com/benthosdev/benthos/v4/internal/impl/amqp1/shared [no test files]
ok      github.com/benthosdev/benthos/v4/cmd/tools/benthos_docs_gen 3.978s
ok      github.com/benthosdev/benthos/v4/internal/api   0.268s
ok      github.com/benthosdev/benthos/v4/internal/autoretry 0.667s
ok      github.com/benthosdev/benthos/v4/internal/batch 0.004s
ok      github.com/benthosdev/benthos/v4/internal/batch/policy  0.543s
ok      github.com/benthosdev/benthos/v4/internal/batch/policy/batchconfig  0.027s
ok      github.com/benthosdev/benthos/v4/internal/bloblang  0.081s
ok      github.com/benthosdev/benthos/v4/internal/bloblang/field    0.012s
ok      github.com/benthosdev/benthos/v4/internal/bloblang/mapping  0.013s
ok      github.com/benthosdev/benthos/v4/internal/bloblang/parser   0.765s
FAIL    github.com/benthosdev/benthos/v4/internal/bloblang/query [build failed]
panic: unaligned 64-bit atomic operation
goroutine 62 [running]:
runtime/internal/atomic.panicUnaligned()
    runtime/internal/atomic/unaligned.go:8 +0x38
runtime/internal/atomic.Load64(0x59d2eec4)
    runtime/internal/atomic/atomic_386.s:225 +0x10
github.com/benthosdev/benthos/v4/internal/bundle/tracing.(*control).EventLimit(...)
    github.com/benthosdev/benthos/v4/internal/bundle/tracing/events.go:96
github.com/benthosdev/benthos/v4/internal/bundle/tracing.(*events).IsEnabled(0x5a05e960)
    github.com/benthosdev/benthos/v4/internal/bundle/tracing/events.go:201 +0x47
github.com/benthosdev/benthos/v4/internal/bundle/tracing.(*tracedInput).loop(0x5a05b4a0)
    github.com/benthosdev/benthos/v4/internal/bundle/tracing/input.go:44 +0xf1
created by github.com/benthosdev/benthos/v4/internal/bundle/tracing.traceInput
    github.com/benthosdev/benthos/v4/internal/bundle/tracing/input.go:28 +0x210
FAIL    github.com/benthosdev/benthos/v4/internal/bundle/tracing    0.042s
ok      github.com/benthosdev/benthos/v4/internal/checkpoint    0.227s
ok      github.com/benthosdev/benthos/v4/internal/cli   0.970s
--- FAIL: TestPullRunnerHappyPath (0.09s)
panic: unaligned 64-bit atomic operation [recovered]
    panic: unaligned 64-bit atomic operation
goroutine 80 [running]:
testing.tRunner.func1.2({0x5795e160, 0x57aa12d8})
    testing/testing.go:1526 +0x2c5
testing.tRunner.func1()
    testing/testing.go:1529 +0x4dd
panic({0x5795e160, 0x57aa12d8})
    runtime/panic.go:890 +0x262
runtime/internal/atomic.panicUnaligned()
    runtime/internal/atomic/unaligned.go:8 +0x38
runtime/internal/atomic.Store64(0x590f30d4, 0x0)
    runtime/internal/atomic/atomic_386.s:237 +0x10
github.com/benthosdev/benthos/v4/internal/bundle/tracing.(*control).SetEventLimit(...)
    github.com/benthosdev/benthos/v4/internal/bundle/tracing/events.go:88
github.com/benthosdev/benthos/v4/internal/bundle/tracing.(*Summary).SetEventLimit(...)
    github.com/benthosdev/benthos/v4/internal/bundle/tracing/events.go:128
github.com/benthosdev/benthos/v4/internal/cli/studio.(*PullRunner).Sync(0x58e62000, {0x57aa7e78, 0x58dcbae0})
    github.com/benthosdev/benthos/v4/internal/cli/studio/pull_runner.go:295 +0x119
github.com/benthosdev/benthos/v4/internal/cli/studio_test.TestPullRunnerHappyPath(0x590e3c20)
    github.com/benthosdev/benthos/v4/internal/cli/studio/pull_runner_test.go:243 +0x482
testing.tRunner(0x590e3c20, 0x57a9dc5c)
    testing/testing.go:1576 +0x150
created by testing.(*T).Run
    testing/testing.go:1629 +0x46f
FAIL    github.com/benthosdev/benthos/v4/internal/cli/studio    0.145s
ok      github.com/benthosdev/benthos/v4/internal/cli/test  0.222s
ok      github.com/benthosdev/benthos/v4/internal/codec 0.063s
ok      github.com/benthosdev/benthos/v4/internal/component 0.018s
ok      github.com/benthosdev/benthos/v4/internal/component/buffer  0.111s
ok      github.com/benthosdev/benthos/v4/internal/component/cache   0.014s
ok      github.com/benthosdev/benthos/v4/internal/component/input   2.902s
ok      github.com/benthosdev/benthos/v4/internal/component/input/batcher   0.020s
ok      github.com/benthosdev/benthos/v4/internal/component/input/span  0.042s
ok      github.com/benthosdev/benthos/v4/internal/component/metrics 0.084s
ok      github.com/benthosdev/benthos/v4/internal/component/output  0.042s
?       github.com/benthosdev/benthos/v4/internal/impl/aws/config   [no test files]
?       github.com/benthosdev/benthos/v4/internal/impl/aws/session  [no test files]
?       github.com/benthosdev/benthos/v4/internal/impl/azure/shared [no test files]
?       github.com/benthosdev/benthos/v4/internal/impl/couchbase/client [no test files]
?       github.com/benthosdev/benthos/v4/internal/impl/discord  [no test files]
?       github.com/benthosdev/benthos/v4/internal/impl/jsonpath [no test files]
?       github.com/benthosdev/benthos/v4/internal/impl/kafka/aws    [no test files]
?       github.com/benthosdev/benthos/v4/internal/impl/kafka/sasl   [no test files]
?       github.com/benthosdev/benthos/v4/internal/impl/mongodb/client   [no test files]
?       github.com/benthosdev/benthos/v4/internal/impl/mqtt/shared  [no test files]
?       github.com/benthosdev/benthos/v4/internal/impl/nats/auth    [no test files]
?       github.com/benthosdev/benthos/v4/internal/impl/nsq  [no test files]
?       github.com/benthosdev/benthos/v4/internal/impl/otlp [no test files]
ok      github.com/benthosdev/benthos/v4/internal/component/output/batcher  30.123s
ok      github.com/benthosdev/benthos/v4/internal/component/processor   0.018s
ok      github.com/benthosdev/benthos/v4/internal/component/ratelimit   0.017s
ok      github.com/benthosdev/benthos/v4/internal/config    2.882s
ok      github.com/benthosdev/benthos/v4/internal/docs  0.394s
ok      github.com/benthosdev/benthos/v4/internal/filepath  0.017s
ok      github.com/benthosdev/benthos/v4/internal/filepath/ifs  0.006s
ok      github.com/benthosdev/benthos/v4/internal/httpclient    0.861s
ok      github.com/benthosdev/benthos/v4/internal/httpserver    0.008s
ok      github.com/benthosdev/benthos/v4/internal/impl/amqp09   0.013s
ok      github.com/benthosdev/benthos/v4/internal/impl/amqp1    0.013s
ok      github.com/benthosdev/benthos/v4/internal/impl/avro 0.021s
ok      github.com/benthosdev/benthos/v4/internal/impl/awk  0.034s
ok      github.com/benthosdev/benthos/v4/internal/impl/aws  3.403s
ok      github.com/benthosdev/benthos/v4/internal/impl/azure    0.024s
ok      github.com/benthosdev/benthos/v4/internal/impl/beanstalkd   0.021s
ok      github.com/benthosdev/benthos/v4/internal/impl/cassandra    0.027s
ok      github.com/benthosdev/benthos/v4/internal/impl/confluent    0.042s
ok      github.com/benthosdev/benthos/v4/internal/impl/couchbase    0.289s
ok      github.com/benthosdev/benthos/v4/internal/impl/crypto   0.399s
ok      github.com/benthosdev/benthos/v4/internal/impl/dgraph   0.246s
ok      github.com/benthosdev/benthos/v4/internal/impl/elasticsearch    0.040s
ok      github.com/benthosdev/benthos/v4/internal/impl/elasticsearch/aws    0.043s
ok      github.com/benthosdev/benthos/v4/internal/impl/gcp  0.478s
ok      github.com/benthosdev/benthos/v4/internal/impl/hdfs 0.030s
ok      github.com/benthosdev/benthos/v4/internal/impl/influxdb 0.014s
ok      github.com/benthosdev/benthos/v4/internal/impl/jaeger   0.022s
ok      github.com/benthosdev/benthos/v4/internal/impl/javascript   0.204s
ok      github.com/benthosdev/benthos/v4/internal/impl/kafka    0.142s
ok      github.com/benthosdev/benthos/v4/internal/impl/lang 0.016s
ok      github.com/benthosdev/benthos/v4/internal/impl/maxmind  0.047s
ok      github.com/benthosdev/benthos/v4/internal/impl/memcached    0.040s
ok      github.com/benthosdev/benthos/v4/internal/impl/mongodb  0.034s
ok      github.com/benthosdev/benthos/v4/internal/impl/mqtt 0.021s
ok      github.com/benthosdev/benthos/v4/internal/impl/msgpack  0.023s
ok      github.com/benthosdev/benthos/v4/internal/impl/nanomsg  0.021s
ok      github.com/benthosdev/benthos/v4/internal/impl/nats 0.129s
ok      github.com/benthosdev/benthos/v4/internal/impl/parquet  0.389s
ok      github.com/benthosdev/benthos/v4/internal/impl/prometheus   0.039s
?       github.com/benthosdev/benthos/v4/internal/impl/pusher   [no test files]
?       github.com/benthosdev/benthos/v4/internal/impl/redis/old    [no test files]
?       github.com/benthosdev/benthos/v4/internal/impl/sftp/shared  [no test files]
?       github.com/benthosdev/benthos/v4/internal/impl/statsd   [no test files]
?       github.com/benthosdev/benthos/v4/internal/impl/twitter  [no test files]
?       github.com/benthosdev/benthos/v4/internal/integration   [no test files]
?       github.com/benthosdev/benthos/v4/internal/old/util/retries  [no test files]
?       github.com/benthosdev/benthos/v4/internal/serverless/lambda [no test files]
?       github.com/benthosdev/benthos/v4/internal/template  [no test files]
?       github.com/benthosdev/benthos/v4/public/components/all  [no test files]
?       github.com/benthosdev/benthos/v4/public/components/amqp09   [no test files]
?       github.com/benthosdev/benthos/v4/public/components/amqp1    [no test files]
?       github.com/benthosdev/benthos/v4/public/components/avro [no test files]
?       github.com/benthosdev/benthos/v4/public/components/aws  [no test files]
?       github.com/benthosdev/benthos/v4/public/components/azure    [no test files]
?       github.com/benthosdev/benthos/v4/public/components/beanstalkd   [no test files]
?       github.com/benthosdev/benthos/v4/public/components/cassandra    [no test files]
?       github.com/benthosdev/benthos/v4/public/components/confluent    [no test files]
?       github.com/benthosdev/benthos/v4/public/components/couchbase    [no test files]
?       github.com/benthosdev/benthos/v4/public/components/crypto   [no test files]
?       github.com/benthosdev/benthos/v4/public/components/dgraph   [no test files]
?       github.com/benthosdev/benthos/v4/public/components/discord  [no test files]
?       github.com/benthosdev/benthos/v4/public/components/elasticsearch    [no test files]
?       github.com/benthosdev/benthos/v4/public/components/gcp  [no test files]
?       github.com/benthosdev/benthos/v4/public/components/hdfs [no test files]
?       github.com/benthosdev/benthos/v4/public/components/influxdb [no test files]
?       github.com/benthosdev/benthos/v4/public/components/io   [no test files]
?       github.com/benthosdev/benthos/v4/public/components/jaeger   [no test files]
?       github.com/benthosdev/benthos/v4/public/components/javascript   [no test files]
?       github.com/benthosdev/benthos/v4/public/components/kafka    [no test files]
?       github.com/benthosdev/benthos/v4/public/components/maxmind  [no test files]
?       github.com/benthosdev/benthos/v4/public/components/memcached    [no test files]
?       github.com/benthosdev/benthos/v4/public/components/mongodb  [no test files]
?       github.com/benthosdev/benthos/v4/public/components/mqtt [no test files]
?       github.com/benthosdev/benthos/v4/public/components/msgpack  [no test files]
?       github.com/benthosdev/benthos/v4/public/components/nanomsg  [no test files]
?       github.com/benthosdev/benthos/v4/public/components/nats [no test files]
?       github.com/benthosdev/benthos/v4/public/components/nsq  [no test files]
?       github.com/benthosdev/benthos/v4/public/components/otlp [no test files]
?       github.com/benthosdev/benthos/v4/public/components/prometheus   [no test files]
ok      github.com/benthosdev/benthos/v4/internal/impl/pulsar   0.021s
?       github.com/benthosdev/benthos/v4/public/components/pulsar   [no test files]
?       github.com/benthosdev/benthos/v4/public/components/pure [no test files]
?       github.com/benthosdev/benthos/v4/public/components/pure/extended    [no test files]
?       github.com/benthosdev/benthos/v4/public/components/pusher   [no test files]
?       github.com/benthosdev/benthos/v4/public/components/redis    [no test files]
?       github.com/benthosdev/benthos/v4/public/components/sftp [no test files]
?       github.com/benthosdev/benthos/v4/public/components/snowflake    [no test files]
?       github.com/benthosdev/benthos/v4/public/components/sql  [no test files]
?       github.com/benthosdev/benthos/v4/public/components/sql/base [no test files]
?       github.com/benthosdev/benthos/v4/public/components/statsd   [no test files]
?       github.com/benthosdev/benthos/v4/public/components/twitter  [no test files]
?       github.com/benthosdev/benthos/v4/public/components/wasm [no test files]
?       github.com/benthosdev/benthos/v4/public/wasm/tinygo [no test files]
level=info msg="Sending inproc messages to ID: 3adcd704-2d5c-449b-9b98-08d67575947e" @service=benthos label="" path=root.output
level=info msg="Sending inproc messages to ID: 3a60e676-da9f-45f7-8809-b237b0cf6c2b" @service=benthos label="" path=root.output
level=info msg="Receiving inproc messages from ID: 568d4fe2-cccb-44a8-bf94-115b9ac029cd" @service=benthos label="" path=root.input
panic: unaligned 64-bit atomic operation
goroutine 94857 [running]:
runtime/internal/atomic.panicUnaligned()
    runtime/internal/atomic/unaligned.go:8 +0x38
runtime/internal/atomic.Load64(0x5ad1acc4)
    runtime/internal/atomic/atomic_386.s:225 +0x10
github.com/benthosdev/benthos/v4/internal/bundle/tracing.(*control).EventLimit(...)
    github.com/benthosdev/benthos/v4/internal/bundle/tracing/events.go:96
github.com/benthosdev/benthos/v4/internal/bundle/tracing.(*events).IsEnabled(0x5b94be80)
    github.com/benthosdev/benthos/v4/internal/bundle/tracing/events.go:201 +0x47
github.com/benthosdev/benthos/v4/internal/bundle/tracing.(*tracedInput).loop(0x5a14e6c0)
    github.com/benthosdev/benthos/v4/internal/bundle/tracing/input.go:44 +0xf1
created by github.com/benthosdev/benthos/v4/internal/bundle/tracing.traceInput
    github.com/benthosdev/benthos/v4/internal/bundle/tracing/input.go:28 +0x210
FAIL    github.com/benthosdev/benthos/v4/internal/impl/pure 7.567s
ok      github.com/benthosdev/benthos/v4/internal/impl/pure/extended    0.052s
ok      github.com/benthosdev/benthos/v4/internal/impl/redis    0.064s
ok      github.com/benthosdev/benthos/v4/internal/impl/sftp 0.029s
ok      github.com/benthosdev/benthos/v4/internal/impl/snowflake    0.529s
--- FAIL: TestBufferSQLiteAck (0.00s)
    buffer_sqlite_test.go:338: 
            Error Trace:    /builds/FollieHiyuki/aports/testing/benthos/src/benthos-4.15.0/internal/impl/sql/buffer_sqlite_test.go:29
                                        /builds/FollieHiyuki/aports/testing/benthos/src/benthos-4.15.0/internal/impl/sql/buffer_sqlite_test.go:338
            Error:          Not equal: 
                            expected: "1"
                            actual  : "2"

                            Diff:
                            --- Expected
                            +++ Actual
                            @@ -1 +1 @@
                            -1
                            +2
            Test:           TestBufferSQLiteAck
    buffer_sqlite_test.go:343: 
            Error Trace:    /builds/FollieHiyuki/aports/testing/benthos/src/benthos-4.15.0/internal/impl/sql/buffer_sqlite_test.go:343
            Error:          Received unexpected error:
                            sql: Scan error on column index 2, name "requeue": converting driver.Value type int64 ("1684578832255088081") to a int: value out of range
            Test:           TestBufferSQLiteAck
--- FAIL: TestBufferSQLiteCloseAfterNack (0.00s)
    buffer_sqlite_test.go:437: 
            Error Trace:    /builds/FollieHiyuki/aports/testing/benthos/src/benthos-4.15.0/internal/impl/sql/buffer_sqlite_test.go:29
                                        /builds/FollieHiyuki/aports/testing/benthos/src/benthos-4.15.0/internal/impl/sql/buffer_sqlite_test.go:437
            Error:          Not equal: 
                            expected: "hello world 1"
                            actual  : "hello world 3"

                            Diff:
                            --- Expected
                            +++ Actual
                            @@ -1 +1 @@
                            -hello world 1
                            +hello world 3
            Test:           TestBufferSQLiteCloseAfterNack
    buffer_sqlite_test.go:441: 
            Error Trace:    /builds/FollieHiyuki/aports/testing/benthos/src/benthos-4.15.0/internal/impl/sql/buffer_sqlite_test.go:441
            Error:          Received unexpected error:
                            sql: Scan error on column index 2, name "requeue": converting driver.Value type int64 ("1684578832364239465") to a int: value out of range
            Test:           TestBufferSQLiteCloseAfterNack
FAIL
FAIL    github.com/benthosdev/benthos/v4/internal/impl/sql  2.076s
ok      github.com/benthosdev/benthos/v4/internal/impl/wasm 0.019s
ok      github.com/benthosdev/benthos/v4/internal/impl/xml  0.014s
ok      github.com/benthosdev/benthos/v4/internal/log   0.011s
ok      github.com/benthosdev/benthos/v4/internal/manager   0.604s
ok      github.com/benthosdev/benthos/v4/internal/manager/mock  0.013s [no tests to run]
ok      github.com/benthosdev/benthos/v4/internal/message   0.010s
ok      github.com/benthosdev/benthos/v4/internal/metadata  0.012s
ok      github.com/benthosdev/benthos/v4/internal/old/util/throttle 0.006s
ok      github.com/benthosdev/benthos/v4/internal/pipeline  0.031s
ok      github.com/benthosdev/benthos/v4/internal/serverless    0.042s
ok      github.com/benthosdev/benthos/v4/internal/shutdown  0.003s
ok      github.com/benthosdev/benthos/v4/internal/stream    1.074s
ok      github.com/benthosdev/benthos/v4/internal/stream/manager    0.515s
ok      github.com/benthosdev/benthos/v4/internal/tls   9.323s
ok      github.com/benthosdev/benthos/v4/internal/tracing   0.009s
ok      github.com/benthosdev/benthos/v4/internal/transaction   0.003s
--- FAIL: Example_bloblangMethodPluginV2 (0.01s)
got:
{"new_summary":"meowquackwoof","reversed":["denny","pixie","olaf","jen","spuz"]}
want:
{"new_summary":"meowquackwoof","reversed":["spuz","jen","olaf","pixie","denny"]}
FAIL
FAIL    github.com/benthosdev/benthos/v4/public/bloblang    0.113s
panic: unaligned 64-bit atomic operation
goroutine 665 [running]:
runtime/internal/atomic.panicUnaligned()
    runtime/internal/atomic/unaligned.go:8 +0x38
runtime/internal/atomic.Xadd64(0x5a4bd614, 0x1)
    runtime/internal/atomic/atomic_386.s:125 +0x11
github.com/benthosdev/benthos/v4/public/service_test.(*chaosOutput).Write(0x5a4bd600, {0x57a9c1c8, 0x5a584000}, 0x5958c1c8)
    github.com/benthosdev/benthos/v4/public/service/chaos_test.go:36 +0x142
github.com/benthosdev/benthos/v4/public/service.(*airGapWriter).WriteBatch(0x5a4c4738, {0x57a9c1c8, 0x5a584000}, {0x5a6c8010, 0x1, 0x1})
    github.com/benthosdev/benthos/v4/public/service/output.go:88 +0xa4
github.com/benthosdev/benthos/v4/internal/component/output.(*AsyncWriter).latencyMeasuringWrite(0x5a303680, {0x57a9c1c8, 0x5a584000}, {0x5a6c8010, 0x1, 0x1})
    github.com/benthosdev/benthos/v4/internal/component/output/async_writer.go:86 +0x65
github.com/benthosdev/benthos/v4/internal/component/output.(*AsyncWriter).loop.func4()
    github.com/benthosdev/benthos/v4/internal/component/output/async_writer.go:228 +0x3e4
created by github.com/benthosdev/benthos/v4/internal/component/output.(*AsyncWriter).loop
    github.com/benthosdev/benthos/v4/internal/component/output/async_writer.go:266 +0x83e
FAIL    github.com/benthosdev/benthos/v4/public/service 0.504s
ok      github.com/benthosdev/benthos/v4/public/service/servicetest 0.927s

And here is the failed log for s390x and ppc64le:

...
ok      github.com/benthosdev/benthos/v4/internal/impl/nats 0.079s
--- FAIL: TestParquetParseBloblang (0.00s)
    bloblang_test.go:42: 
            Error Trace:    /builds/FollieHiyuki/aports/testing/benthos/src/benthos-4.15.0/internal/impl/parquet/bloblang_test.go:42
            Error:          Received unexpected error:
                            failed assignment (line 1): decoding page 0 of column "D": DELTA_LENGTH_BYTE_ARRAY: invalid negative value length: -1
            Test:           TestParquetParseBloblang
--- FAIL: TestParquetParseBloblangAsStrings (0.02s)
    bloblang_test.go:73: 
            Error Trace:    /builds/FollieHiyuki/aports/testing/benthos/src/benthos-4.15.0/internal/impl/parquet/bloblang_test.go:73
            Error:          Received unexpected error:
                            failed assignment (line 1): decoding page 0 of column "D": DELTA_LENGTH_BYTE_ARRAY: invalid negative value length: -1
            Test:           TestParquetParseBloblangAsStrings
--- FAIL: TestParquetHappy (0.00s)
    input_parquet_test.go:71: 
            Error Trace:    /builds/FollieHiyuki/aports/testing/benthos/src/benthos-4.15.0/internal/impl/parquet/input_parquet_test.go:71
            Error:          Received unexpected error:
                            decoding page 0 of column "Value": DELTA_LENGTH_BYTE_ARRAY: invalid negative value length: -5
            Test:           TestParquetHappy
--- FAIL: TestParquetEncodeDecodeRoundTrip (0.02s)
    --- FAIL: TestParquetEncodeDecodeRoundTrip/basic_values (0.00s)
        processor_encode_test.go:181: 
                Error Trace:    /builds/FollieHiyuki/aports/testing/benthos/src/benthos-4.15.0/internal/impl/parquet/processor_encode_test.go:181
                Error:          Not equal: 
                                expected: map[string]interface {}{"as":[]interface {}{0.1, 0.2, 0.3, 0.4}, "b":"hello world basic values", "c":0.5, "d":true, "e":6, "f":7, "g":"logical string represent", "id":3, "nested_stuff":map[string]interface {}{"a_stuff":"a value", "b_stuff":"b value"}}
                                actual  : map[string]interface {}{"as":[]interface {}{0.1, 0.2, 0.3, 0.4}, "b":"hello world basic values", "c":0, "d":false, "e":0, "f":7, "g":"logical string represent", "id":3, "nested_stuff":map[string]interface {}{"a_stuff":"a value", "b_stuff":"b value"}}

                                Diff:
                                --- Expected
                                +++ Actual
                                @@ -8,5 +8,5 @@
                                  (string) (len=1) "b": (string) (len=24) "hello world basic values",
                                - (string) (len=1) "c": (float64) 0.5,
                                - (string) (len=1) "d": (bool) true,
                                - (string) (len=1) "e": (float64) 6,
                                + (string) (len=1) "c": (float64) 0,
                                + (string) (len=1) "d": (bool) false,
                                + (string) (len=1) "e": (float64) 0,
                                  (string) (len=1) "f": (float64) 7,
                Test:           TestParquetEncodeDecodeRoundTrip/basic_values
    --- FAIL: TestParquetEncodeDecodeRoundTrip/miss_all_optionals (0.02s)
        processor_encode_test.go:181: 
                Error Trace:    /builds/FollieHiyuki/aports/testing/benthos/src/benthos-4.15.0/internal/impl/parquet/processor_encode_test.go:181
                Error:          Not equal: 
                                expected: map[string]interface {}{"as":interface {}(nil), "b":"hello world basic values", "c":0.5, "d":true, "e":interface {}(nil), "f":7, "g":"logical string represent", "id":3, "nested_stuff":interface {}(nil)}
                                actual  : map[string]interface {}{"as":interface {}(nil), "b":"hello world basic values", "c":0, "d":false, "e":interface {}(nil), "f":7, "g":"logical string represent", "id":3, "nested_stuff":interface {}(nil)}

                                Diff:
                                --- Expected
                                +++ Actual
                                @@ -3,4 +3,4 @@
                                  (string) (len=1) "b": (string) (len=24) "hello world basic values",
                                - (string) (len=1) "c": (float64) 0.5,
                                - (string) (len=1) "d": (bool) true,
                                + (string) (len=1) "c": (float64) 0,
                                + (string) (len=1) "d": (bool) false,
                                  (string) (len=1) "e": (interface {}) <nil>,
                Test:           TestParquetEncodeDecodeRoundTrip/miss_all_optionals
--- FAIL: TestParquetEncodeDecodeRoundTripPlainEncoding (0.00s)
    --- FAIL: TestParquetEncodeDecodeRoundTripPlainEncoding/basic_values (0.00s)
        processor_encode_test.go:181: 
                Error Trace:    /builds/FollieHiyuki/aports/testing/benthos/src/benthos-4.15.0/internal/impl/parquet/processor_encode_test.go:181
                Error:          Not equal: 
                                expected: map[string]interface {}{"as":[]interface {}{0.1, 0.2, 0.3, 0.4}, "b":"hello world basic values", "c":0.5, "d":true, "e":6, "f":7, "g":"logical string represent", "id":3, "nested_stuff":map[string]interface {}{"a_stuff":"a value", "b_stuff":"b value"}}
                                actual  : map[string]interface {}{"as":[]interface {}{0.1, 0.2, 0.3, 0.4}, "b":"hello world basic values", "c":0, "d":false, "e":0, "f":7, "g":"logical string represent", "id":3, "nested_stuff":map[string]interface {}{"a_stuff":"a value", "b_stuff":"b value"}}

                                Diff:
                                --- Expected
                                +++ Actual
                                @@ -8,5 +8,5 @@
                                  (string) (len=1) "b": (string) (len=24) "hello world basic values",
                                - (string) (len=1) "c": (float64) 0.5,
                                - (string) (len=1) "d": (bool) true,
                                - (string) (len=1) "e": (float64) 6,
                                + (string) (len=1) "c": (float64) 0,
                                + (string) (len=1) "d": (bool) false,
                                + (string) (len=1) "e": (float64) 0,
                                  (string) (len=1) "f": (float64) 7,
                Test:           TestParquetEncodeDecodeRoundTripPlainEncoding/basic_values
    --- FAIL: TestParquetEncodeDecodeRoundTripPlainEncoding/miss_all_optionals (0.00s)
        processor_encode_test.go:181: 
                Error Trace:    /builds/FollieHiyuki/aports/testing/benthos/src/benthos-4.15.0/internal/impl/parquet/processor_encode_test.go:181
                Error:          Not equal: 
                                expected: map[string]interface {}{"as":interface {}(nil), "b":"hello world basic values", "c":0.5, "d":true, "e":interface {}(nil), "f":7, "g":"logical string represent", "id":3, "nested_stuff":interface {}(nil)}
                                actual  : map[string]interface {}{"as":interface {}(nil), "b":"hello world basic values", "c":0, "d":false, "e":interface {}(nil), "f":7, "g":"logical string represent", "id":3, "nested_stuff":interface {}(nil)}

                                Diff:
                                --- Expected
                                +++ Actual
                                @@ -3,4 +3,4 @@
                                  (string) (len=1) "b": (string) (len=24) "hello world basic values",
                                - (string) (len=1) "c": (float64) 0.5,
                                - (string) (len=1) "d": (bool) true,
                                + (string) (len=1) "c": (float64) 0,
                                + (string) (len=1) "d": (bool) false,
                                  (string) (len=1) "e": (interface {}) <nil>,
                Test:           TestParquetEncodeDecodeRoundTripPlainEncoding/miss_all_optionals
--- FAIL: TestParquetEncodeProcessor (0.02s)
    --- FAIL: TestParquetEncodeProcessor/all_together (0.00s)
        processor_encode_test.go:419: 
                Error Trace:    /builds/FollieHiyuki/aports/testing/benthos/src/benthos-4.15.0/internal/impl/parquet/processor_encode_test.go:419
                Error:          Target error should be in err chain:
                                expected: "EOF"
                                in chain: "OB → row is missing optional column 25"
                                    "row is missing optional column 25"
                Test:           TestParquetEncodeProcessor/all_together
FAIL
FAIL    github.com/benthosdev/benthos/v4/internal/impl/parquet  0.322s
ok      github.com/benthosdev/benthos/v4/internal/impl/prometheus   0.038s
...
?       github.com/benthosdev/benthos/v4/public/wasm/tinygo [no test files]
--- FAIL: TestBufferSQLiteBasic (0.00s)
    buffer_sqlite_test.go:74: 
            Error Trace:    /builds/FollieHiyuki/aports/testing/benthos/src/benthos-4.15.0/internal/impl/sql/buffer_sqlite_test.go:65
                                        /builds/FollieHiyuki/aports/testing/benthos/src/benthos-4.15.0/internal/impl/sql/buffer_sqlite_test.go:74
            Error:          Received unexpected error:
                            sql: unknown driver "sqlite" (forgotten import?)
            Test:           TestBufferSQLiteBasic
--- FAIL: TestBufferSQLiteBatchPreservation (0.00s)
    buffer_sqlite_test.go:102: 
            Error Trace:    /builds/FollieHiyuki/aports/testing/benthos/src/benthos-4.15.0/internal/impl/sql/buffer_sqlite_test.go:65
                                        /builds/FollieHiyuki/aports/testing/benthos/src/benthos-4.15.0/internal/impl/sql/buffer_sqlite_test.go:102
            Error:          Received unexpected error:
                            sql: unknown driver "sqlite" (forgotten import?)
            Test:           TestBufferSQLiteBatchPreservation
--- FAIL: TestBufferSQLiteBatchSplit (0.00s)
    buffer_sqlite_test.go:132: 
            Error Trace:    /builds/FollieHiyuki/aports/testing/benthos/src/benthos-4.15.0/internal/impl/sql/buffer_sqlite_test.go:65
                                        /builds/FollieHiyuki/aports/testing/benthos/src/benthos-4.15.0/internal/impl/sql/buffer_sqlite_test.go:132
            Error:          Received unexpected error:
                            sql: unknown driver "sqlite" (forgotten import?)
            Test:           TestBufferSQLiteBatchSplit
--- FAIL: TestBufferSQLiteProcessors (0.00s)
    buffer_sqlite_test.go:164: 
            Error Trace:    /builds/FollieHiyuki/aports/testing/benthos/src/benthos-4.15.0/internal/impl/sql/buffer_sqlite_test.go:65
                                        /builds/FollieHiyuki/aports/testing/benthos/src/benthos-4.15.0/internal/impl/sql/buffer_sqlite_test.go:164
            Error:          Received unexpected error:
                            sql: unknown driver "sqlite" (forgotten import?)
            Test:           TestBufferSQLiteProcessors
--- FAIL: TestBufferSQLiteOwnership (0.00s)
    buffer_sqlite_test.go:198: 
            Error Trace:    /builds/FollieHiyuki/aports/testing/benthos/src/benthos-4.15.0/internal/impl/sql/buffer_sqlite_test.go:65
                                        /builds/FollieHiyuki/aports/testing/benthos/src/benthos-4.15.0/internal/impl/sql/buffer_sqlite_test.go:198
            Error:          Received unexpected error:
                            sql: unknown driver "sqlite" (forgotten import?)
            Test:           TestBufferSQLiteOwnership
--- FAIL: TestBufferSQLiteLoopingRandom (0.00s)
    buffer_sqlite_test.go:243: 
            Error Trace:    /builds/FollieHiyuki/aports/testing/benthos/src/benthos-4.15.0/internal/impl/sql/buffer_sqlite_test.go:65
                                        /builds/FollieHiyuki/aports/testing/benthos/src/benthos-4.15.0/internal/impl/sql/buffer_sqlite_test.go:243
            Error:          Received unexpected error:
                            sql: unknown driver "sqlite" (forgotten import?)
            Test:           TestBufferSQLiteLoopingRandom
--- FAIL: TestBufferSQLiteLockStep (0.00s)
    buffer_sqlite_test.go:273: 
            Error Trace:    /builds/FollieHiyuki/aports/testing/benthos/src/benthos-4.15.0/internal/impl/sql/buffer_sqlite_test.go:65
                                        /builds/FollieHiyuki/aports/testing/benthos/src/benthos-4.15.0/internal/impl/sql/buffer_sqlite_test.go:273
            Error:          Received unexpected error:
                            sql: unknown driver "sqlite" (forgotten import?)
            Test:           TestBufferSQLiteLockStep
--- FAIL: TestBufferSQLiteAck (0.00s)
    buffer_sqlite_test.go:311: 
            Error Trace:    /builds/FollieHiyuki/aports/testing/benthos/src/benthos-4.15.0/internal/impl/sql/buffer_sqlite_test.go:65
                                        /builds/FollieHiyuki/aports/testing/benthos/src/benthos-4.15.0/internal/impl/sql/buffer_sqlite_test.go:311
            Error:          Received unexpected error:
                            sql: unknown driver "sqlite" (forgotten import?)
            Test:           TestBufferSQLiteAck
--- FAIL: TestBufferSQLiteCloseWithPending (0.00s)
    buffer_sqlite_test.go:360: 
            Error Trace:    /builds/FollieHiyuki/aports/testing/benthos/src/benthos-4.15.0/internal/impl/sql/buffer_sqlite_test.go:65
                                        /builds/FollieHiyuki/aports/testing/benthos/src/benthos-4.15.0/internal/impl/sql/buffer_sqlite_test.go:360
            Error:          Received unexpected error:
                            sql: unknown driver "sqlite" (forgotten import?)
            Test:           TestBufferSQLiteCloseWithPending
--- FAIL: TestBufferSQLiteCloseAfterNack (0.00s)
    buffer_sqlite_test.go:405: 
            Error Trace:    /builds/FollieHiyuki/aports/testing/benthos/src/benthos-4.15.0/internal/impl/sql/buffer_sqlite_test.go:65
                                        /builds/FollieHiyuki/aports/testing/benthos/src/benthos-4.15.0/internal/impl/sql/buffer_sqlite_test.go:405
            Error:          Received unexpected error:
                            sql: unknown driver "sqlite" (forgotten import?)
            Test:           TestBufferSQLiteCloseAfterNack
--- FAIL: TestConnSettingsInitStmt (30.00s)
    conn_fields_test.go:60: 
            Error Trace:    /builds/FollieHiyuki/aports/testing/benthos/src/benthos-4.15.0/internal/impl/sql/conn_fields_test.go:60
            Error:          Received unexpected error:
                            context deadline exceeded
            Test:           TestConnSettingsInitStmt
    conn_fields_test.go:57: 
            Error Trace:    /builds/FollieHiyuki/aports/testing/benthos/src/benthos-4.15.0/internal/impl/sql/conn_fields_test.go:57
                                        /builds/FollieHiyuki/aports/testing/benthos/src/benthos-4.15.0/internal/impl/sql/asm_s390x.s:749
            Error:          Received unexpected error:
                            context deadline exceeded
            Test:           TestConnSettingsInitStmt
--- FAIL: TestConnSettingsInitFiles (30.00s)
    conn_fields_test.go:147: 
            Error Trace:    /builds/FollieHiyuki/aports/testing/benthos/src/benthos-4.15.0/internal/impl/sql/conn_fields_test.go:147
            Error:          Received unexpected error:
                            context deadline exceeded
            Test:           TestConnSettingsInitFiles
    conn_fields_test.go:144: 
            Error Trace:    /builds/FollieHiyuki/aports/testing/benthos/src/benthos-4.15.0/internal/impl/sql/conn_fields_test.go:144
                                        /builds/FollieHiyuki/aports/testing/benthos/src/benthos-4.15.0/internal/impl/sql/asm_s390x.s:749
            Error:          Received unexpected error:
                            context deadline exceeded
            Test:           TestConnSettingsInitFiles
FAIL
FAIL    github.com/benthosdev/benthos/v4/internal/impl/sql  60.050s
...

Is it sufficient to just add s390x and ppc64le to https://github.com/benthosdev/benthos/blob/main/public/components/sql/sqlite.go and update the sqlite dependency? modernc.org/sqlite@v1.22.1 supports these platforms, as shown at https://pkg.go.dev/modernc.org/sqlite#hdr-Supported_platforms_and_architectures.

Jeffail commented 1 year ago

Hey @FollieHiyuki, there's likely a few places that will need either excluding from 32-bit builds or fixed, the studio pull runner test fail looks like it's a bug for 32-bit systems we ought to get fixed.