Open andersy005 opened 3 years ago
my understanding is that xESMF only runs the regridding weights computation on one core so this is maybe why your computation is slow. The workaround is to built weights using the command line tool ESMF_RegridWeightGen
like I described in the doc.
A further development could be to have xESMF runs the ESMpy code in parallel using mpi4py
Version 0.8 supports chunking along the horizontal axes. It's slower for small grids, but faster for large ones.
@huard v0.8 looks very promising for our use case, thanks! One question: Are the weight files generated by v0.8+ compatible with xesmf v0.6?
And conversely, are weight files generated by xesmf v0.6 compatible with xesmf v0.8+?
Even if we'll be testing before going into Production, we would be grateful if you could provide us your insights!
Yes to both, the weights format has not changed.
When working with large/complex grids, the weights generation step appears to be computationally expensive. I am wondering whether this is documented somewhere? If so, can we improve this?
Here's an example
Here's an interactive version of profiling results: https://gist.githack.com/andersy005/329d52f08aaa654527921de609016b77/raw/ad2973e74e990d2bf5cad7586a364968425bb13e/xesmf-profiler.svg?x=0.5529%25&y=100