search

apache / arrow

Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics
https://arrow.apache.org/
Apache License 2.0
14.65k stars 3.55k forks source link

[Archery] Suppress pull/push progress logs #44667

Closed kou closed 2 weeks ago

kou commented 2 weeks ago

Describe the enhancement requested

They are useless and noisy in CI log.

For example: https://github.com/ursacomputing/crossbow/actions/runs/11712683518/job/32623909860#step:7:55

 53  DEBUG:archery:Executing `['docker', 'compose', '--file=/home/runner/work/crossbow/crossbow/arrow/docker-compose.yml', 'pull', '--ignore-pull-failures', 'python-wheel-manylinux-2014']`
 54   python-wheel-manylinux-2014 Pulling 
 55   2d473b07cdd5 Pulling fs layer 
...
802   8e8a019736ff Extracting [==================================================>]  52.55MB/52.55MB
803   8e8a019736ff Pull complete 
804   python-wheel-manylinux-2014 Pulled

Component(s)

Archery

assignUser commented 2 weeks ago

Issue resolved by pull request 44669 https://github.com/apache/arrow/pull/44669

pitrou commented 12 hours ago

I just noticed this change. Can this be reverted, or at least made optional? When running locally it is quite annoying to wait for minutes without being informed.

pitrou commented 12 hours ago

By the way, Archery has a --quiet flag already, why not use its value?

pitrou commented 11 hours ago

Followup PR in https://github.com/apache/arrow/pull/44850

assignUser commented 11 hours ago

Oh sorry, good point!