[Failing Test]: Utilization of 'Source' and 'Sink' - Githubissues

apache / beam

Apache Beam is a unified programming model for Batch and Streaming data processing.

https://beam.apache.org/

Apache License 2.0

7.9k stars 4.27k forks source link

[Failing Test]: Utilization of 'Source' and 'Sink' #32870

Open ujjwalrajanand opened 1 month ago

ujjwalrajanand commented 1 month ago

What happened?

https://github.com/vaishnavipandey-vp/Apache-Beam-YAML/blob/c467c59f5f13a00514e90be1cfd505982577524b/Apache-Beam-YAML/Pipelines/transformUsingSourceSink.yaml#L1C1-L24C17

Not able to utilize 'source' and 'sink' transforms, facing challenges.

Issue Failure

Failure: Test is continually failing

Issue Priority

Priority: 1 (unhealthy code / failing or flaky postcommit so we cannot be sure the product is healthy)

Issue Components

[ ] Component: Python SDK
[ ] Component: Java SDK
[ ] Component: Go SDK
[ ] Component: Typescript SDK
[ ] Component: IO connector
[X] Component: Beam YAML
[ ] Component: Beam examples
[ ] Component: Beam playground
[ ] Component: Beam katas
[ ] Component: Website
[ ] Component: Infrastructure
[ ] Component: Spark Runner
[ ] Component: Flink Runner
[ ] Component: Samza Runner
[ ] Component: Twister2 Runner
[ ] Component: Hazelcast Jet Runner
[ ] Component: Google Cloud Dataflow Runner

robertwb commented 1 month ago

Your source and sink parameters should contain a single transform not a list of them (even if this is a list of size 1). We could look into providing a better error here.