I don't know if there is work that needs to be done on the fuse-overlayfs side to utliize it, but seeing the android documentation, it seems to be a yes.
When the FUSE daemon receives a request to open a file, it decides whether FUSE passthrough should be available for that particular file. If it's available, the daemon:
Notifies the FUSE driver about this request.
Enables FUSE passthrough for the file using the FUSE_DEV_IOC_PASSTHROUGH_OPEN ioctl, which must be performed on the file descriptor of the opened /dev/fuse.
Linux 6.9 introduced FUSE passthrough, which will allow better performance for fuse-based filesystems. https://source.android.com/docs/core/storage/fuse-passthrough
I don't know if there is work that needs to be done on the fuse-overlayfs side to utliize it, but seeing the android documentation, it seems to be a yes.