search

botpress / v12

Botpress OSS – v12
https://v12.botpress.com
GNU Affero General Public License v3.0
83 stars 91 forks source link

[BUG] Error at the end of a training (Massive Training) #1285

Closed sebburon closed 3 years ago

sebburon commented 3 years ago

Describe the bug When doing a big training, it can't be completed.

To Reproduce Try to train a bot with 20+ intents

LOG:

03/15/2021 15:49:53.073 Mod[nlu] Training could not finish because of an unexpected error. [Error, Can’t load model 52317b2d443a6212.8d1f3f78f7520e8a.3728.en as it is bigger than the maximum allowed size (model size: 1009.11MB, max allowed: 850MB).] STACK TRACE Error: Can’t load model 52317b2d443a6212.8d1f3f78f7520e8a.3728.en as it is bigger than the maximum allowed size (model size: 1009.11MB, max allowed: 850MB). at Engine. (/snapshot/build-linux/out/bp/nlu-core/engine.js) at Generator.next () at fulfilled (/snapshot/build-linux/out/bp/nlu-core/engine.js) at tryCatcher (/botpress/modules/.cache/module045c78af6f06b6213c652d45aa1b3696188561d6628097cbf5ddc7b80c9b3947/node_production_modules/bluebird/js/release/util.js:16:23) at Promise._settlePromiseFromHandler (/botpress/modules/.cache/module__045c78af6f06b6213c652d45aa1b3696188561d6628097cbf5ddc7b80c9b3947/node_production_modules/bluebird/js/release/promise.js:547:31) at Promise._settlePromise (/botpress/modules/.cache/module045c78af6f06b6213c652d45aa1b3696188561d6628097cbf5ddc7b80c9b3947/node_production_modules/bluebird/js/release/promise.js:604:18) at Promise._settlePromise0 (/botpress/modules/.cache/module045c78af6f06b6213c652d45aa1b3696188561d6628097cbf5ddc7b80c9b3947/node_production_modules/bluebird/js/release/promise.js:649:10) at Promise._settlePromises (/botpress/modules/.cache/module__045c78af6f06b6213c652d45aa1b3696188561d6628097cbf5ddc7b80c9b3947/node_production_modules/bluebird/js/release/promise.js:729:18) at _drainQueueStep (/botpress/modules/.cache/module045c78af6f06b6213c652d45aa1b3696188561d6628097cbf5ddc7b80c9b3947/node_production_modules/bluebird/js/release/async.js:93:12) at _drainQueue (/botpress/modules/.cache/module045c78af6f06b6213c652d45aa1b3696188561d6628097cbf5ddc7b80c9b3947/node_production_modules/bluebird/js/release/async.js:86:9) at Async._drainQueues (/botpress/modules/.cache/module__045c78af6f06b6213c652d45aa1b3696188561d6628097cbf5ddc7b80c9b3947/node_production_modules/bluebird/js/release/async.js:102:5) at Immediate.Async.drainQueues [as _onImmediate] (/botpress/modules/.cache/module045c78af6f06b6213c652d45aa1b3696188561d6628097cbf5ddc7b80c9b3947/node_production_modules/bluebird/js/release/async.js:15:14) at processImmediate (internal/timers.js:456:21) at process.topLevelDomainCallback (domain.js:137:15)

Environment (please complete the following information):

spg commented 3 years ago

The default cache size can be overridden using the nlu module config:

...
modelCacheSize: "850mb" // default, increase as needed (see https://www.npmjs.com/package/bytes for supported formats)