[REA] Benchmark Criteo NVTabular+TensorFlow Inference

NVIDIA-Merlin / NVTabular

NVTabular is a feature engineering and preprocessing library for tabular data designed to quickly and easily manipulate terabyte scale datasets used to train deep learning based recommender systems.

Apache License 2.0

1.04k stars 143 forks source link

[REA] Benchmark Criteo NVTabular+TensorFlow Inference #1236

Open bschifferer opened 2 years ago

bschifferer commented 2 years ago

What questions are you trying to answer? Please describe. Analyze latency/throughput for NVTabular+TensorFlow for Triton Inference Server

bschifferer commented 2 years ago

I benchmarked NVTabular+TensorFlow for the criteo example and numbers do not as expected. I think we need a follow-up / profile investigation in NVTabular latency numbers.