pamaxie / --OLD--Pamaxie

Worker "clients" for analyzing media content. Pamaxie is a Natural Learning API for accessing several Neural Networks and hand-crafted algorithms for moderating content on platforms.
https://pamaxie.com
Apache License 2.0
2 stars 2 forks source link

Seperate Pamaxies API from the Scanning #40

Open ghost opened 3 years ago

ghost commented 3 years ago

We need to seperate the API from the actual process of scanning since the process of scanning can take over 1 second which during high workloads may cause issues. I am thinking about a work handler that distributes all work tasks on a backbone dynamically via gRPC. We could then work via a queue system where work nodes take work out of the queue once they are ready.

Please, if you have another idea contact me this is quite complicated as an implementation.