apache / beam

Apache Beam is a unified programming model for Batch and Streaming data processing.
https://beam.apache.org/
Apache License 2.0
7.8k stars 4.23k forks source link

[Bug]: [Python] BatchElements and ToList website examples are broken #32544

Open hjtran opened 6 days ago

hjtran commented 6 days ago

What happened?

https://beam.apache.org/documentation/transforms/python/aggregation/batchelements/ https://beam.apache.org/documentation/transforms/python/aggregation/tolist/

These were introduced by https://github.com/apache/beam/pull/30788

I checked in Beam Playground with print(beam.__version__) and it looks like it's' running 2.56 which is when these examples were added. I'm not sure if maybe there's an extra step somewhere to update some database of examples used for the website?

Issue Priority

Priority: 2 (default / most bugs should be filed as P2)

Issue Components

hjtran commented 6 days ago

@damccorm You helped me with the original PR. Any idea what's missing here?

Amar3tto commented 6 days ago

I think I already fixed broken examples here: https://github.com/apache/beam/pull/31647. I guess there is need to update website

tvalentyn commented 6 days ago

Also came across this issue; to my knowledge, the website is are being updated regularly, most likely additional changes are necessary

tvalentyn commented 6 days ago

@Amar3tto For example, fixes in https://github.com/apache/beam/pull/31778 point to currently working examples

Amar3tto commented 5 days ago

Also came across this issue; to my knowledge, the website is are being updated regularly, most likely additional changes are necessary

The website uses beam 2.56.0 which doesn't have transforms with the correct names

damccorm commented 5 days ago

I don't think the problem is with the website, it is with the playground itself. If you click through to playground, the same problem exists - https://play.beam.apache.org/?path=SDK_PYTHON_ToList&sdk=python

volatilemolotov commented 5 days ago

There was a issue in inline yaml for prod playground deploy. That is fixed and is running 2.59 now

Amar3tto commented 3 days ago

The version has been updated, but the examples are still broken. We are working on it.

hjtran commented 3 days ago

Thanks for the update!