openzfs / zfs

OpenZFS on Linux and FreeBSD
https://openzfs.github.io/openzfs-docs
Other
10.38k stars 1.72k forks source link

QAT-accelerated ZSTD #15731

Open sempervictus opened 7 months ago

sempervictus commented 7 months ago

Describe the feature would like to see added to OpenZFS

Seems that Intel has a QAT-accelerated ZSTD plugin which handles up to ZSTD12. Might be a very handy thing to have running for high-throughput ZSTD systems.

How will this feature improve OpenZFS?

Offload the defacto modern compression implementation to hardware

jiaolovekt commented 7 months ago

Currently have some systems running with QAT-gzip on 8950/8970. It would be really nice if zstd offload is implemented. Update: Seems this is only implemented on 4th Gen QAT(Xeon x4xx LGA4677), really far for me go get one.