V1.6.1初始化出现访问的集群不可用

liu-shaobo commented 2 months ago

v1.6.1 初始化出现集群不可用

从日志看是mis的数据库连接有问题，但是数据库密码正确。比较奇怪的是，同样的配置文件在v1.5.2里面运行就没有问题。并且从1.5.2升级到1.6.1，运行正常。如果单独用1.6.1，初始化时提示404。

容器状态

NAME                       IMAGE                                         COMMAND                  SERVICE         CREATED          STATUS          PORTS
scow-161-audit-db-1        mysql:8                                       "docker-entrypoint.s…"   audit-db        59 minutes ago   Up 59 minutes   3306/tcp, 33060/tcp
scow-161-audit-server-1    mirrors.pku.edu.cn/pkuhpc-icode/scow:v1.6.1   "./entrypoint.sh"        audit-server    59 minutes ago   Up 58 minutes   80/tcp, 3000/tcp, 5000/tcp
scow-161-auth-1            mirrors.pku.edu.cn/pkuhpc-icode/scow:v1.6.1   "./entrypoint.sh"        auth            59 minutes ago   Up 59 minutes   80/tcp, 3000/tcp, 5000/tcp
scow-161-db-1              mysql:8                                       "docker-entrypoint.s…"   db              59 minutes ago   Up 59 minutes   3306/tcp, 33060/tcp
scow-161-gateway-1         mirrors.pku.edu.cn/pkuhpc-icode/scow:v1.6.1   "./entrypoint.sh"        gateway         59 minutes ago   Up 59 minutes   3000/tcp, 0.0.0.0:80->80/tcp, :::80->80/tcp, 5000/tcp
scow-161-log-1             fluentd:v1.14.0-1.0                           "tini -- /bin/entryp…"   log             59 minutes ago   Up 59 minutes   5140/tcp, 0.0.0.0:24224->24224/tcp, 0.0.0.0:24224->24224/udp, :::24224->24224/tcp, :::24224->24224/udp
scow-161-mis-server-1      mirrors.pku.edu.cn/pkuhpc-icode/scow:v1.6.1   "./entrypoint.sh"        mis-server      59 minutes ago   Up 58 minutes   80/tcp, 3000/tcp, 5000/tcp
scow-161-mis-web-1         mirrors.pku.edu.cn/pkuhpc-icode/scow:v1.6.1   "./entrypoint.sh"        mis-web         59 minutes ago   Up 59 minutes   80/tcp, 3000/tcp, 5000/tcp
scow-161-novnc-1           ghcr.io/pkuhpc/novnc-client-docker:master     "/docker-entrypoint.…"   novnc           59 minutes ago   Up 59 minutes   80/tcp
scow-161-portal-server-1   mirrors.pku.edu.cn/pkuhpc-icode/scow:v1.6.1   "./entrypoint.sh"        portal-server   59 minutes ago   Up 59 minutes   80/tcp, 3000/tcp, 5000/tcp
scow-161-portal-web-1      mirrors.pku.edu.cn/pkuhpc-icode/scow:v1.6.1   "./entrypoint.sh"        portal-web      59 minutes ago   Up 59 minutes   80/tcp, 3000/tcp, 5000/tcp
scow-161-redis-1           redis:alpine                                  "docker-entrypoint.s…"   redis           59 minutes ago   Up 59 minutes   6379/tcp

mis-web日志

mis-web-1  |  ✓ Starting...
mis-web-1  | TypeError: fetch failed
mis-web-1  |     at node:internal/deps/undici/undici:12502:13
mis-web-1  |     at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
mis-web-1  |     at async getCapabilities (/app/libs/auth/build/getCapabilities.js:24:19)
mis-web-1  |     at async queryCapabilities (/app/apps/mis-web/config.js:33:12)
mis-web-1  |     at async buildRuntimeConfig (/app/apps/mis-web/config.js:90:24)
mis-web-1  |     at async module.exports (/app/apps/mis-web/next.config.js:31:25)
mis-web-1  |     at async normalizeConfig (/app/node_modules/.pnpm/next@14.2.4_patch_hash=xwomt2iqq5liv3pq43ybpoioua_@babel+core@7.24.4_react-dom@18.3.1_react@18.3.1__react@18.3.1/node_modules/next/dist/server/config-shared.js:160:12)
mis-web-1  |     at async loadConfig (/app/node_modules/.pnpm/next@14.2.4_patch_hash=xwomt2iqq5liv3pq43ybpoioua_@babel+core@7.24.4_react-dom@18.3.1_react@18.3.1__react@18.3.1/node_modules/next/dist/server/config.js:714:28)
mis-web-1  |     at async initialize (/app/node_modules/.pnpm/next@14.2.4_patch_hash=xwomt2iqq5liv3pq43ybpoioua_@babel+core@7.24.4_react-dom@18.3.1_react@18.3.1__react@18.3.1/node_modules/next/dist/server/lib/router-server.js:54:20)
mis-web-1  |     at async Server.<anonymous> (/app/node_modules/.pnpm/next@14.2.4_patch_hash=xwomt2iqq5liv3pq43ybpoioua_@babel+core@7.24.4_react-dom@18.3.1_react@18.3.1__react@18.3.1/node_modules/next/dist/server/lib/start-server.js:249:36) {
mis-web-1  |   [cause]: Error: connect ECONNREFUSED 172.18.0.10:5000
mis-web-1  |       at TCPConnectWrap.afterConnect [as oncomplete] (node:net:1606:16) {
mis-web-1  |     errno: -111,
mis-web-1  |     code: 'ECONNREFUSED',
mis-web-1  |     syscall: 'connect',
mis-web-1  |     address: '172.18.0.10',
mis-web-1  |     port: 5000
mis-web-1  |   }
mis-web-1  | }

mis-server日志

mis-server-1  | > @scow/mis-server@1.6.1 serve
mis-server-1  | > node build/index.js
mis-server-1  |
mis-server-1  | {"level":30,"time":"2024-07-03T01:44:40.841Z","pid":19,"hostname":"b9370605bbda","msg":"Hook is not configured."}
mis-server-1  | {"level":30,"time":"2024-07-03T01:44:41.533Z","pid":19,"hostname":"b9370605bbda","version":{"tag":"v1.6.1","commit":"e159d24ce12401e15fa2bf8e684c0c57725afdab"},"msg":"@scow/mis-server: "}
mis-server-1  | {"level":30,"time":"2024-07-03T01:44:41.533Z","pid":19,"hostname":"b9370605bbda","config":{"HOST":"0.0.0.0","PORT":5000,"LOG_LEVEL":"info","LOG_PRETTY":false,"SSH_PRIVATE_KEY_PATH":"/root/.ssh/id_rsa","SSH_PUBLIC_KEY_PATH":"/root/.ssh/id_rsa.pub","AUTH_URL":"","DB_PASSWORD":"must!chang3this"},"msg":"Loaded env config"}
mis-server-1  | node:internal/process/promises:289
mis-server-1  |             triggerUncaughtException(err, true /* fromPromise */);
mis-server-1  |             ^
mis-server-1  |
mis-server-1  | Error: connect ECONNREFUSED 172.18.0.5:3306
mis-server-1  |     at TCPConnectWrap.afterConnect [as oncomplete] (node:net:1606:16) {
mis-server-1  |   errno: -111,
mis-server-1  |   code: 'ECONNREFUSED',
mis-server-1  |   syscall: 'connect',
mis-server-1  |   address: '172.18.0.5',
mis-server-1  |   port: 3306,
mis-server-1  |   fatal: true
mis-server-1  | }
mis-server-1  |
mis-server-1  | Node.js v20.14.0
mis-server-1  | npm notice
mis-server-1  | npm notice New minor version of npm available! 10.7.0 -> 10.8.1
mis-server-1  | npm notice Changelog: https://github.com/npm/cli/releases/tag/v10.8.1
mis-server-1  | npm notice To update run: npm install -g npm@10.8.1
mis-server-1  | npm notice

install.yaml文件

port: 80
basePath: /
imageTag: v1.6.1
portal: {}
mis:
dbPassword: "must!chang3this"
log:
fluentd:
logDir: /var/log/fluentd
auth: {}
audit: {}
gateway:
proxyReadTimeout: 120s
uploadFileSizeLimit: 2G

运行环境 | Environment

- OS: ubuntu 20.04
- Scheduler: 23.11.0
- Docker: 24.0.9
- Docker-compose: v2.24.1
- SCOW cli: 1.6.1
- SCOW: 1.6.1
- Adapter: 1.5

liu-shaobo commented 2 months ago

install.yaml文件使用imageTag: master 后，删除docker镜像，重新初始化scow，又出现作业价格表的错误。

错误内容如下：


{
  "code": "QUERY_VALIDATION_ERROR",
  "errors": [
    {
      "instancePath": "",
      "schemaPath": "#/required",
      "keyword": "required",
      "params": {
        "missingProperty": "clusterSortedIdList"
      },
      "message": "must have required property 'clusterSortedIdList'"
    }
  ]
}

piccaSun commented 2 months ago

@liu-shaobo 您好，感谢确认。已修改，最新改动已合并至master。

PKUHPC / OpenSCOW

V1.6.1初始化出现访问的集群不可用 #1335

运行环境 | Environment