search

truecharts / charts

Community Helm Chart Repository
https://truecharts.org
GNU Affero General Public License v3.0
1.13k stars 622 forks source link

Impossible to set proper max body size #2510

Closed phpb-com closed 2 years ago

phpb-com commented 2 years ago

App Name

nocodb

SCALE Version

22.02.0

App Version

0.90.3_0.0.4

Application Events

2022-04-19 17:06:34
Started container nocodb
2022-04-19 17:06:34
Created container nocodb
2022-04-19 17:06:28
Container image "nocodb/nocodb:0.90.3@sha256:63158174ce8a88eecfa332e223cee8cd11c1670090324d1d4264348930cb43db" already present on machine
2022-04-19 17:06:26
Started container postgresql-init
2022-04-19 17:06:26
Created container postgresql-init
2022-04-19 17:06:17
Container image "ghcr.io/truecharts/postgresql:v14.2.0@sha256:797177c01e1b7f363278dd2ec7fa0e63bfe85a92e0cc785042b12c533a56737c" already present on machine
2022-04-19 17:06:17
Started container hostpatch
2022-04-19 17:06:16
Created container hostpatch
2022-04-19 17:06:12
Container image "ghcr.io/truecharts/alpine:v3.15.2@sha256:29ed3480a0ee43f7af681fed5d4fc215516abf1c41eade6938b26d8c9c2c7583" already present on machine
2022-04-19 17:06:10
Started container autopermissions
2022-04-19 17:06:10
Created container autopermissions
2022-04-19 17:06:05
Container image "ghcr.io/truecharts/alpine:v3.15.2@sha256:29ed3480a0ee43f7af681fed5d4fc215516abf1c41eade6938b26d8c9c2c7583" already present on machine
2022-04-19 17:06:05
Add eth0 [172.16.0.240/16] from ix-net
Successfully assigned ix-nocodb/nocodb-d55fdfb56-htqpp to ix-truenas
2022-04-19 17:05:53
Created pod: nocodb-d55fdfb56-htqpp
2022-04-19 17:05:53
Scaled up replica set nocodb-d55fdfb56 to 1
2022-04-19 17:05:42
Stopping container nocodb
2022-04-19 17:05:42
Deleted pod: nocodb-767976bfdd-wf5pc
2022-04-19 17:05:42
Scaled down replica set nocodb-767976bfdd to 0
2022-04-19 16:59:34
Started container nocodb
2022-04-19 16:59:34
Created container nocodb
2022-04-19 16:59:29
Container image "nocodb/nocodb:0.90.3@sha256:63158174ce8a88eecfa332e223cee8cd11c1670090324d1d4264348930cb43db" already present on machine
2022-04-19 16:59:28
Started container postgresql-init
2022-04-19 16:59:28
Created container postgresql-init
2022-04-19 16:59:23
Container image "ghcr.io/truecharts/postgresql:v14.2.0@sha256:797177c01e1b7f363278dd2ec7fa0e63bfe85a92e0cc785042b12c533a56737c" already present on machine
2022-04-19 16:59:22
Started container hostpatch
2022-04-19 16:59:20
Created container hostpatch
2022-04-19 16:59:14
Container image "ghcr.io/truecharts/alpine:v3.15.2@sha256:29ed3480a0ee43f7af681fed5d4fc215516abf1c41eade6938b26d8c9c2c7583" already present on machine
2022-04-19 16:59:13
Started container autopermissions
2022-04-19 16:59:11
Created container autopermissions
2022-04-19 16:59:04
Container image "ghcr.io/truecharts/alpine:v3.15.2@sha256:29ed3480a0ee43f7af681fed5d4fc215516abf1c41eade6938b26d8c9c2c7583" already present on machine
2022-04-19 16:59:04
Add eth0 [172.16.0.239/16] from ix-net
Successfully assigned ix-nocodb/nocodb-767976bfdd-wf5pc to ix-truenas
2022-04-19 16:58:51
Created pod: nocodb-767976bfdd-wf5pc
2022-04-19 16:58:51
Scaled up replica set nocodb-767976bfdd to 1
2022-04-19 16:58:41
Readiness probe failed: dial tcp 172.16.0.238:10226: connect: connection refused
2022-04-19 16:58:41
Liveness probe failed: dial tcp 172.16.0.238:10226: connect: connection refused
2022-04-19 16:58:40
Stopping container nocodb
2022-04-19 16:58:40
Deleted pod: nocodb-5dd445c8d7-hz598
2022-04-19 16:58:40
Scaled down replica set nocodb-5dd445c8d7 to 0
2022-04-19 16:44:04
Started container nocodb
2022-04-19 16:44:03
Created container nocodb
2022-04-19 16:44:00
Container image "nocodb/nocodb:0.90.3@sha256:63158174ce8a88eecfa332e223cee8cd11c1670090324d1d4264348930cb43db" already present on machine
2022-04-19 16:43:59
Started container postgresql-init
2022-04-19 16:43:58
Created container postgresql-init
2022-04-19 16:43:55
Container image "ghcr.io/truecharts/postgresql:v14.2.0@sha256:797177c01e1b7f363278dd2ec7fa0e63bfe85a92e0cc785042b12c533a56737c" already present on machine
2022-04-19 16:43:54
Started container hostpatch
2022-04-19 16:43:53
Created container hostpatch
2022-04-19 16:43:50
Container image "ghcr.io/truecharts/alpine:v3.15.2@sha256:29ed3480a0ee43f7af681fed5d4fc215516abf1c41eade6938b26d8c9c2c7583" already present on machine
2022-04-19 16:43:50
Started container autopermissions
2022-04-19 16:43:49
Created container autopermissions
2022-04-19 16:43:46
Container image "ghcr.io/truecharts/alpine:v3.15.2@sha256:29ed3480a0ee43f7af681fed5d4fc215516abf1c41eade6938b26d8c9c2c7583" already present on machine
2022-04-19 16:43:46
Add eth0 [172.16.0.238/16] from ix-net
Successfully assigned ix-nocodb/nocodb-5dd445c8d7-hz598 to ix-truenas
2022-04-19 16:43:41
Created pod: nocodb-5dd445c8d7-hz598
2022-04-19 16:43:41
Scaled up replica set nocodb-5dd445c8d7 to 1
2022-04-19 16:43:34
Stopping container nocodb
2022-04-19 16:43:34
Deleted pod: nocodb-5d4c45d758-fvhtr
2022-04-19 16:43:34
Scaled down replica set nocodb-5d4c45d758 to 0
2022-04-19 16:37:10
Started container nocodb
2022-04-19 16:37:10
Created container nocodb
2022-04-19 16:37:06
Container image "nocodb/nocodb:0.90.3@sha256:63158174ce8a88eecfa332e223cee8cd11c1670090324d1d4264348930cb43db" already present on machine
2022-04-19 16:37:05
Started container postgresql-init
2022-04-19 16:37:05
Created container postgresql-init
2022-04-19 16:37:02
Container image "ghcr.io/truecharts/postgresql:v14.2.0@sha256:797177c01e1b7f363278dd2ec7fa0e63bfe85a92e0cc785042b12c533a56737c" already present on machine
2022-04-19 16:37:01
Started container hostpatch
2022-04-19 16:37:00
Created container hostpatch
2022-04-19 16:36:57
Container image "ghcr.io/truecharts/alpine:v3.15.2@sha256:29ed3480a0ee43f7af681fed5d4fc215516abf1c41eade6938b26d8c9c2c7583" already present on machine
2022-04-19 16:36:57
Started container autopermissions
2022-04-19 16:36:56
Created container autopermissions
2022-04-19 16:36:53
Container image "ghcr.io/truecharts/alpine:v3.15.2@sha256:29ed3480a0ee43f7af681fed5d4fc215516abf1c41eade6938b26d8c9c2c7583" already present on machine
2022-04-19 16:36:53
Add eth0 [172.16.0.237/16] from ix-net
Successfully assigned ix-nocodb/nocodb-5d4c45d758-fvhtr to ix-truenas
2022-04-19 16:36:48
Created pod: nocodb-5d4c45d758-fvhtr
2022-04-19 16:36:48
Scaled up replica set nocodb-5d4c45d758 to 1
2022-04-19 16:36:47
Liveness probe failed: dial tcp 172.16.0.236:10226: i/o timeout
2022-04-19 16:36:47
Readiness probe failed: dial tcp 172.16.0.236:10226: i/o timeout
2022-04-19 16:36:41
Stopping container nocodb
2022-04-19 16:36:41
Deleted pod: nocodb-6bc5b57f9b-gl98f
2022-04-19 16:36:41
Scaled down replica set nocodb-6bc5b57f9b to 0
2022-04-19 16:26:55
Started container nocodb
2022-04-19 16:26:55
Created container nocodb
2022-04-19 16:26:52
Container image "nocodb/nocodb:0.90.3@sha256:63158174ce8a88eecfa332e223cee8cd11c1670090324d1d4264348930cb43db" already present on machine
2022-04-19 16:26:51
Started container postgresql-init
2022-04-19 16:26:50
Created container postgresql-init
2022-04-19 16:26:47
Container image "ghcr.io/truecharts/postgresql:v14.2.0@sha256:797177c01e1b7f363278dd2ec7fa0e63bfe85a92e0cc785042b12c533a56737c" already present on machine
2022-04-19 16:26:47
Started container hostpatch
2022-04-19 16:26:46
Created container hostpatch
2022-04-19 16:26:43
Container image "ghcr.io/truecharts/alpine:v3.15.2@sha256:29ed3480a0ee43f7af681fed5d4fc215516abf1c41eade6938b26d8c9c2c7583" already present on machine
2022-04-19 16:26:43
Started container autopermissions
2022-04-19 16:26:42
Created container autopermissions
2022-04-19 16:26:38
Container image "ghcr.io/truecharts/alpine:v3.15.2@sha256:29ed3480a0ee43f7af681fed5d4fc215516abf1c41eade6938b26d8c9c2c7583" already present on machine
2022-04-19 16:26:38
Add eth0 [172.16.0.236/16] from ix-net
Successfully assigned ix-nocodb/nocodb-6bc5b57f9b-gl98f to ix-truenas
2022-04-19 16:26:32
Created pod: nocodb-6bc5b57f9b-gl98f
2022-04-19 16:26:32
Scaled up replica set nocodb-6bc5b57f9b to 1
2022-04-19 16:26:24
Stopping container nocodb
2022-04-19 16:26:24
Deleted pod: nocodb-574b55dcd4-8x896
2022-04-19 16:26:24
Scaled down replica set nocodb-574b55dcd4 to 0
2022-04-19 16:20:58
Started container nocodb
2022-04-19 16:20:58
Created container nocodb
2022-04-19 16:20:52
Container image "nocodb/nocodb:0.90.3@sha256:63158174ce8a88eecfa332e223cee8cd11c1670090324d1d4264348930cb43db" already present on machine
2022-04-19 16:20:51
Started container postgresql-init
2022-04-19 16:20:51
Created container postgresql-init
2022-04-19 16:20:48
Container image "ghcr.io/truecharts/postgresql:v14.2.0@sha256:797177c01e1b7f363278dd2ec7fa0e63bfe85a92e0cc785042b12c533a56737c" already present on machine
2022-04-19 16:20:48
Started container hostpatch
2022-04-19 16:20:47
Created container hostpatch
2022-04-19 16:20:44
Container image "ghcr.io/truecharts/alpine:v3.15.2@sha256:29ed3480a0ee43f7af681fed5d4fc215516abf1c41eade6938b26d8c9c2c7583" already present on machine
2022-04-19 16:20:43
Started container autopermissions
2022-04-19 16:20:42
Created container autopermissions
2022-04-19 16:20:39
Container image "ghcr.io/truecharts/alpine:v3.15.2@sha256:29ed3480a0ee43f7af681fed5d4fc215516abf1c41eade6938b26d8c9c2c7583" already present on machine
2022-04-19 16:20:39
Add eth0 [172.16.0.235/16] from ix-net
Successfully assigned ix-nocodb/nocodb-574b55dcd4-8x896 to ix-truenas
2022-04-19 16:20:33
Created pod: nocodb-574b55dcd4-8x896
2022-04-19 16:20:33
Scaled up replica set nocodb-574b55dcd4 to 1
2022-04-19 16:20:23
Readiness probe failed: dial tcp 172.16.0.234:10226: connect: connection refused
2022-04-19 16:20:23
Liveness probe failed: dial tcp 172.16.0.234:10226: connect: connection refused
2022-04-19 16:20:22
Stopping container nocodb
2022-04-19 16:20:22
Deleted pod: nocodb-556ccd778f-7lbwr
2022-04-19 16:20:22
Scaled down replica set nocodb-556ccd778f to 0
2022-04-19 16:18:36
Started container nocodb
2022-04-19 16:18:35
Created container nocodb
2022-04-19 16:18:32
Container image "nocodb/nocodb:0.90.3@sha256:63158174ce8a88eecfa332e223cee8cd11c1670090324d1d4264348930cb43db" already present on machine
2022-04-19 16:18:32
Started container postgresql-init
2022-04-19 16:18:31
Created container postgresql-init
2022-04-19 16:18:28
Container image "ghcr.io/truecharts/postgresql:v14.2.0@sha256:797177c01e1b7f363278dd2ec7fa0e63bfe85a92e0cc785042b12c533a56737c" already present on machine
2022-04-19 16:18:27
Started container hostpatch
2022-04-19 16:18:26
Created container hostpatch
2022-04-19 16:18:23
Container image "ghcr.io/truecharts/alpine:v3.15.2@sha256:29ed3480a0ee43f7af681fed5d4fc215516abf1c41eade6938b26d8c9c2c7583" already present on machine
2022-04-19 16:18:23
Started container autopermissions
2022-04-19 16:18:22
Created container autopermissions
2022-04-19 16:18:18
Container image "ghcr.io/truecharts/alpine:v3.15.2@sha256:29ed3480a0ee43f7af681fed5d4fc215516abf1c41eade6938b26d8c9c2c7583" already present on machine
2022-04-19 16:18:18
Add eth0 [172.16.0.234/16] from ix-net
Successfully assigned ix-nocodb/nocodb-556ccd778f-7lbwr to ix-truenas
2022-04-19 16:18:13
Created pod: nocodb-556ccd778f-7lbwr
2022-04-19 16:18:13
Scaled up replica set nocodb-556ccd778f to 1
2022-04-19 16:18:05
Stopping container nocodb
2022-04-19 16:18:05
Deleted pod: nocodb-74d48d65d6-kxdct
2022-04-19 16:18:05
Scaled down replica set nocodb-74d48d65d6 to 0

Application Logs

2022-04-19 08:06:38.586092+00:00App started successfully.
2022-04-19 08:06:38.586170+00:00Visit -> http://localhost:10226/dashboard
2022-04-19 08:09:54.068177+00:00GET /dashboard/ 304 - - 27.672 ms
2022-04-19 08:09:54.129995+00:00GET /dashboard/_nuxt/9f8cc12.js 304 - - 4.387 ms
2022-04-19 08:09:54.131782+00:00GET /dashboard/_nuxt/45b30a8.js 304 - - 4.495 ms
2022-04-19 08:09:54.137837+00:00GET /dashboard/_nuxt/3985927.js 304 - - 3.388 ms
2022-04-19 08:09:54.138752+00:00GET /dashboard/_nuxt/d0100fe.js 304 - - 3.047 ms
2022-04-19 08:09:54.234939+00:00GET /dashboard/_nuxt/b0fc4f4.js 304 - - 8.683 ms
2022-04-19 08:09:54.236015+00:00GET /dashboard/_nuxt/77ee188.js 304 - - 8.255 ms
2022-04-19 08:09:54.237152+00:00GET /dashboard/_nuxt/48bf7d9.js 304 - - 7.708 ms
2022-04-19 08:09:54.238734+00:00GET /dashboard/_nuxt/74b363a.js 304 - - 7.774 ms
2022-04-19 08:09:54.243541+00:00GET /dashboard/_nuxt/7a52687.js 304 - - 1.634 ms
2022-04-19 08:09:54.487830+00:00GET /dashboard/_nuxt/70a7279.js 304 - - 1.946 ms
2022-04-19 08:09:54.499605+00:00GET /dashboard/_nuxt/f5657fe.js 304 - - 1.895 ms
2022-04-19 08:09:54.541129+00:00GET /dashboard/favicon-32.png 304 - - 9.794 ms
2022-04-19 08:09:54.552462+00:00GET /api/v1/db/meta/nocodb/info 304 - - 15.833 ms
2022-04-19 08:09:54.569379+00:00GET /dashboard/_nuxt/b065a64.js 304 - - 5.824 ms
2022-04-19 08:09:54.570558+00:00GET /dashboard/_nuxt/f911f31.js 304 - - 5.566 ms
2022-04-19 08:09:54.596003+00:00GET /api/v1/db/meta/nocodb/info 304 - - 3.798 ms
2022-04-19 08:09:54.659521+00:00GET /dashboard/_nuxt/img/discourse-icon.de1f266.png 304 - - 4.991 ms
2022-04-19 08:09:54.660774+00:00GET /dashboard/_nuxt/fonts/materialdesignicons-webfont.e9db400.woff2 304 - - 4.270 ms
2022-04-19 08:09:54.746797+00:00GET /dashboard/_nuxt/img/512x512-trans.5601bce.png 304 - - 69.091 ms
2022-04-19 08:09:54.769390+00:00GET /api/v1/db/auth/user/me?project_id=p_a5gh633zqfwsbf 304 - - 23.245 ms
2022-04-19 08:09:54.797513+00:00GET /api/v1/db/meta/projects/p_a5gh633zqfwsbf 304 - - 12.067 ms
2022-04-19 08:09:54.853813+00:00GET /api/v1/db/meta/projects/p_a5gh633zqfwsbf/tables?includeM2M= 304 - - 32.893 ms
2022-04-19 08:09:54.888629+00:00GET /api/v1/db/meta/projects/p_a5gh633zqfwsbf/tables?includeM2M= 304 - - 9.915 ms
2022-04-19 08:09:54.963729+00:00GET /api/v1/db/meta/tables/md_6mqhtga53qjy48 200 7872 - 27.392 ms
2022-04-19 08:09:55.060723+00:00GET /dashboard/ants-leaf-cutter.jpeg 304 - - 40.563 ms
2022-04-19 08:09:55.082333+00:00GET /api/v1/db/meta/tables/md_6mqhtga53qjy48/views 304 - - 70.947 ms
2022-04-19 08:09:55.144134+00:00GET /api/v1/db/meta/views/vw_kg7cc56d74y8p1/sorts 304 - - 18.351 ms
2022-04-19 08:09:55.148938+00:00GET /api/v1/db/meta/views/vw_kg7cc56d74y8p1/filters 304 - - 21.455 ms
2022-04-19 08:09:55.330645+00:00GET /api/v1/db/meta/grids/vw_kg7cc56d74y8p1/grid-columns 304 - - 209.384 ms
2022-04-19 08:09:55.332595+00:00GET /api/v1/db/meta/views/vw_kg7cc56d74y8p1/columns 304 - - 210.123 ms
2022-04-19 08:09:55.367436+00:00GET /api/v1/db/data/noco/Test/test-table/views/test-table?limit=25&offset=0&where= 304 - - 35.433 ms
2022-04-19 08:09:55.392867+00:00GET /api/v1/db/meta/audits/comments/count?ids[]=1&fk_model_id=md_6mqhtga53qjy48 304 - - 4.582 ms
2022-04-19 08:09:55.601150+00:00GET /api/v1/db/meta/nocodb/version 304 - - 924.787 ms
2022-04-19 08:09:56.631643+00:00GET /api/v1/db/meta/audits/comments/count?ids[]=1&ids[]=&fk_model_id=md_6mqhtga53qjy48 304 - - 5.445 ms
2022-04-19 08:09:59.026965+00:00GET /api/v1/db/meta/audits/comments/count?ids[]=1&ids[]=&fk_model_id=md_6mqhtga53qjy48 304 - - 15.803 ms
2022-04-19 08:09:59.052971+00:00GET /api/v1/db/data/noco/Test/test-table/views/test-table/count 304 - - 16.040 ms
2022-04-19 08:15:30.407897+00:00GET /api/v1/db/data/noco/Test/test-table/views/test-table/count 304 - - 26.230 ms
2022-04-19 08:19:55.779737+00:00GET /api/v1/db/meta/nocodb/info 304 - - 7.357 ms
2022-04-19 08:19:56.584923+00:00GET /api/v1/db/meta/nocodb/version 304 - - 786.995 ms

Application Configuration

All set to default except for the body size.

Describe the bug

When trying to login or submit any sort of html body via post, you get an error that the "request entity too large". Investigating further, it seems that one configuration ENV variable is not set correctly - NC_REQUEST_BODY_SIZE=5.24288e+06 . Note that the entry in the app config is set to 5MiB (Request Body Size : 5242880). According to the nocodb config, this environment variable should be set to a number of bytes or literal 100Kb, etc (which config form will not accept, only integers allowed). It works if it is set to a small integer, like 5kb (spelled in bytes).

To Reproduce

  1. install nocodb with default config
  2. try to create initial account
  3. get error message that "request entity too large"

Expected Behavior

I am supposed to be able to submit entries larger than 5 bytes. I am also supposed to be able to set request body size to a more significant numbers, multiple of GiB.

Screenshots

none

Additional Context

none

I've read and agree with the following

phpb-com commented 2 years ago

https://github.com/truecharts/apps/blob/7d37a9d212d8498b564642d826156f226fb55272/charts/incubator/nocodb/questions.yaml#L176 this should be set to string to allow for the correct configuration. Help should also be update to tell what units (Kb,KiB,Mb,Mib,Bytes,etc) are used and allow user to use units in the entry. See: https://expressjs.com/en/resources/middleware/body-parser.html#limit and https://docs.nocodb.com/getting-started/installation/

stavros-k commented 2 years ago

I've set it to int because it defaults to an int number based on their installation docs image

But I'm aware it's not working currently because of the request limit.

phpb-com commented 2 years ago

If you click through the limits link, you will see that the entry is passed to https://www.npmjs.com/package/bytes which parses declaration with units. The nocodb doc does not explicitly state that it must be int, it has default that is a number. If it is int, it is likely to be converted into a scientific notation that is not parsed by the above-mentioned lib.

stavros-k commented 2 years ago

If you click through the limits link, you will see that the entry is passed to https://www.npmjs.com/package/bytes which parses declaration with units. The nocodb doc does not explicitly state that it must be int, it has default that is a number. If it is int, it is likely to be converted into a scientific notation that is not parsed by the above-mentioned lib.

I'll change it to string and default it to 1mb ( which is the 1048576 bytes they default). Also strings can be left empty and then the default of the docker image is used As for the "help" popup, I'm just copying whatever the upstream dev has in his docs

phpb-com commented 2 years ago

Thank you, @stavros-k ! Really appreciate your work on this :-)

stavros-k commented 2 years ago

After the PR is merged, and you still have problems, create a support ticket on discord and tag me, for more direct chat ;)

phpb-com commented 2 years ago

Absolutely, thanks for a quick follow-up and fix. I'll try it again once the PR is merged. Thank you!

truecharts-admin commented 1 year ago

This issue is locked to prevent necro-posting on closed issues. Please create a new issue or contact staff on discord of the problem persists