apache / paimon

Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.
https://paimon.apache.org/
Apache License 2.0
2.35k stars 928 forks source link

[test] Fix flaky test for ConcurrentModificationException with TraceableFileIO #3525

Closed Zouxxyy closed 3 months ago

Zouxxyy commented 3 months ago

Purpose

see https://github.com/apache/paimon/actions/runs/9525273231/job/26259178799

Sorry for https://github.com/apache/paimon/pull/3447 is invalid, because new ArrayList<>(OPEN_INPUT_STREAMS) still has thread problems...

Tests

API and Format

Documentation

Zouxxyy commented 3 months ago

Besides, here may have probems, because I just copy from this:

https://github.com/apache/paimon/blob/8b4f3df89d73398c09310434ede8e02009772fd3/paimon-common/src/main/java/org/apache/paimon/io/cache/FileBasedRandomInputView.java#L109