feat(nlu-server): Make the connection between Botpress and NLU stateless

charlescatta commented 3 years ago

The training state management in the current implementation of the nlu-server and the NLU module in Botpress do not allow for typical cloud deployments causing limited flexibility.

Current behavior:

Each running Botpress instance must have its own dedicated instance of nlu-server running

Expected behavior:

nlu-servers can be scaled from 1 to N independently from the number of running botpress/server instances
Any nlu-server instance can receive and process any requests from any running botpress/server instance connected to the same database (NLU server bound requests can be load balanced between any nlu-server instances)

franklevasseur commented 3 years ago

This is a very good and valid point.

This will be my main focus for the next month.

franklevasseur commented 3 years ago

This PR #72 solves your issue.

franklevasseur commented 2 years ago

Closing as this is fixed on branch https://github.com/botpress/nlu/pull/78. The fix is available in binaries 1.0.0-rc.x. The latest currently is this one.

botpress / nlu

feat(nlu-server): Make the connection between Botpress and NLU stateless #62