numerai / numerai-cli

Automated submission workflows in the cloud.
MIT License
91 stars 28 forks source link

update troubleshooting guide with new cli command for adjusting memory #66

Closed gosuto-inzasheru closed 1 year ago

gosuto-inzasheru commented 1 year ago

im running into out of memory issues when following the getting started article.

according to the troubleshooting guide, this can be mitigated by adjusting memory configuration:

numerai setup -c 4096 -m 30720

however:

Usage: numerai setup [OPTIONS]
Try 'numerai setup --help' for help.

Error: No such option: -c

did this flag get renamed, or deprecated? if so, how do i adjust memory config now?

ah also, i cannot find the ~/.numerai/variables.tf mentioned.

best i could do is

numerai list-constants
SIZE_PRESETS:
  gen-sm -> cpus: 1.0, mem: 4.0 GB 
  gen-md -> cpus: 2.0, mem: 8.0 GB 
  gen-lg -> cpus: 4.0, mem: 16.0 GB 
  cpu-xs -> cpus: 0.5, mem: 1.0 GB 
  cpu-sm -> cpus: 1.0, mem: 2.0 GB 
  cpu-md -> cpus: 2.0, mem: 4.0 GB 
  cpu-lg -> cpus: 4.0, mem: 8.0 GB 
  mem-sm -> cpus: 1.0, mem: 8.0 GB 
  mem-md -> cpus: 2.0, mem: 16.0 GB (default)
  mem-lg -> cpus: 4.0, mem: 30.0 GB 
See https://docs.aws.amazon.com/AmazonECS/latest/developerguide/task-cpu-memory-error.html for more info about size presets.

all this is with numerai-cli==0.3.4

gosuto-inzasheru commented 1 year ago

solved through numerai node config -s mem-lg

this is not documented yet though in the docs i linked

gosuto-inzasheru commented 1 year ago

this might also mean there are more changes that havent been documented.

i am not sure of the scope of breaking changes and their coverage in the docs, please advice.

ndharasz commented 1 year ago

fixed in both the wiki and the readme.