search

NVIDIA-Merlin / HugeCTR

HugeCTR is a high efficiency GPU framework designed for Click-Through-Rate (CTR) estimating training
Apache License 2.0
905 stars 196 forks source link

[Question] Does HugeCTR support all P-series GPUs? and does it support tfserving as inference? #411

Closed Shu-HowTing closed 8 months ago

Shu-HowTing commented 11 months ago

Does HugeCTR support all P-series GPUs? and does it support tfserving as inference?

yingcanw commented 10 months ago

Thanks for your question. The computing compatibility of the data center product supported by HugeCTR can be found here (CC>=6.0).

The native models trained with HugeCTR cannot be deployed directly through tfs. For the trained embedding table, it can be deployed on the tf-related inference platform through the customized HPS plug-in for TensorFlow.

minseokl commented 10 months ago

Hi @Shu-HowTing even if the HugeCTR supports CC>=6.0 for now, please note that we will deprecate their support in a future release.