uber / RemoteShuffleService

Remote shuffle service for Apache Spark to store shuffle data on remote servers.
Other
321 stars 100 forks source link

Fix Rss getReader mapIdx bug #100

Open YutingWang98 opened 1 year ago

YutingWang98 commented 1 year ago

Pass the startmapIndex and endMapIdx to getReaderForRange. And with this change, the AQE realted issues are fixed https://github.com/uber/RemoteShuffleService/issues/99

CLAassistant commented 1 year ago

CLA assistant check
All committers have signed the CLA.

hiboyang commented 1 year ago

Nice fix, thanks @YutingWang98! @mabansal @mayurdb , would you help to merge the PR?