alibaba / EasyRec

A framework for large scale recommendation algorithms.
Apache License 2.0
1.71k stars 311 forks source link

模型太大如何用easyrec保存不带embedding并在serving的时候直接输入embedding的模型? #451

Open supercocoa opened 7 months ago

supercocoa commented 7 months ago

模型训练时输入是userId/ItemId这些特征,训练好后模型很大,想把训练好的模型里把Embedding层单独拿出来存Redis,然后推理的时候从redis查询embedding后直接给模型serving推理,这个用easyrec如何实现导出这样的模型? 参考:embedding层单独拿出来存Redis,Redis放不下就可以放Hbase

chengmengli06 commented 7 months ago

Will add a document on this, but redis is not efficient, we are developing a new embedding server.