anhaidgroup / deepmatcher

Python package for performing Entity and Text Matching using Deep Learning.
BSD 3-Clause "New" or "Revised" License
565 stars 130 forks source link

Optimization of service running deepmatcher #100

Open vadimatwork opened 2 years ago

vadimatwork commented 2 years ago

My understanding is deepmatcher is designed for classification of pairs if they represent the same entity. In typical projects, say we have a product to add to the store -- we want to check if the product already exists in the store. During this inference, the product needs to be scored with respect to each item in the catalogue, which is computationally very expensive. What are the suggestions for optimization of this inference setup?