search

personalizedretrieval / xpert

Code for XPERT algorithm from Personalized Retrieval over Millions of Items
8 stars 2 forks source link

End to End Training Code Morph Operators #9

Open NitinAggarwal1 opened 11 months ago

NitinAggarwal1 commented 11 months ago

Hi Team ,

Waiting for the features to be added . It will allow to benchmark on multiple data sets as well as add XPERT retrieval candidates into reranking pipelines.

NitinAggarwal1 commented 11 months ago
  1. Add Amazon-10M dataset also. ( Can be done later as 1M if reproducible would suffice to follow)
  2. Add text format for both Amazon-1M and Amazon-10M dataset. ( only for 1M )
  3. Add dataset creation scripts. ( This would be needed)
  4. Add base embedding extractions scripts and model. ( Ngame embeddings are part of NGAME repo in extreme repository , for now normal sentence transformers etc can be done for reproducibility)
  5. Add global interest creation (clustering) code. ( This would be needed for reproducibility)
  6. Add training scripts for morph operators. ( This would be needed for reproducibility)
akamil-etsy commented 10 months ago

+1, especially training for morph operators seems to be a missing critical piece

NitinAggarwal1 commented 6 months ago

Hi folks , Any updates here @shivam-msft @sheshanshag