search

CJWorkbench / cjworkbench

The data journalism platform with built in training
http://workbenchdata.com
Other
304 stars 45 forks source link

Changing processing limits for local instance #268

Closed mpiccolino-tealblue closed 2 years ago

mpiccolino-tealblue commented 2 years ago

Where can I change processing limits (e.g. max number of importable rows) for a local CJW instance?

adamhooper commented 2 years ago

Edit cjwkernel/settings.py to set data limits. These aren't configurable by environment variable because we've never encountered a use case.

Modifying cjwkernel/settings.py stuff doesn't change CPU/RAM requirements at all. You can always write a Python step that consumes 100% of all CPU and RAM. We limit CPU/RAM in Kubernetes, not in CJWorkbench; and there is no limiting mechanism in development mode. The main goal of cjworkbench/settings.py is to produce gentler error messages and nudge users towards patterns we've prepared for.