不能在 docker 上的 TideBit DeFi 入金

[arealclimber]

在 docker 上運行 mongo db, nest.js, next.js ，登入後不能入金，Network request 回傳201，backend console 顯示以下錯誤訊息，餘額沒有增加，因為我沒有設定 replica set

[DepositService] balanceEntity: {
  _id: '65b7797f05fd6172cb99bf38',
  user_address: '0xb54898DB1250A6a629E5B566367E9C60a7Dd6C30',
  currency: 'USDT',
  available: '100',
  locked: '0',
  block_number: 0,
  created_at: 1706523007,
  updated_at: 1706525220,
  __v: 0
}
[DepositService] addDepositToDB error MongoServerError: Transaction numbers are only allowed on a replica set member or mongos
    at Connection.onMessage (/usr/src/app/node_modules/mongoose/node_modules/mongodb/lib/cmap/connection.js:202:26)
    at MessageStream.<anonymous> (/usr/src/app/node_modules/mongoose/node_modules/mongodb/lib/cmap/connection.js:61:60)
    at MessageStream.emit (node:events:517:28)
    at processIncomingData (/usr/src/app/node_modules/mongoose/node_modules/mongodb/lib/cmap/message_stream.js:124:16)
    at MessageStream._write (/usr/src/app/node_modules/mongoose/node_modules/mongodb/lib/cmap/message_stream.js:33:9)
    at writeOrBuffer (node:internal/streams/writable:392:12)
    at _write (node:internal/streams/writable:333:10)
    at Writable.write (node:internal/streams/writable:337:10)
    at Socket.ondata (node:internal/streams/readable:809:22)
    at Socket.emit (node:events:517:28) {
  ok: 0,
  code: 20,
  codeName: 'IllegalOperation',
  [Symbol(errorLabels)]: Set(0) {}
}
[DepositService] addDepositToDB abortTransaction
[DepositService] addDepositToDB endSession
[DepositServices] error MongoServerError: Transaction numbers are only allowed on a replica set member or mongos
    at Connection.onMessage (/usr/src/app/node_modules/mongoose/node_modules/mongodb/lib/cmap/connection.js:202:26)
    at MessageStream.<anonymous> (/usr/src/app/node_modules/mongoose/node_modules/mongodb/lib/cmap/connection.js:61:60)
    at MessageStream.emit (node:events:517:28)
    at processIncomingData (/usr/src/app/node_modules/mongoose/node_modules/mongodb/lib/cmap/message_stream.js:124:16)
    at MessageStream._write (/usr/src/app/node_modules/mongoose/node_modules/mongodb/lib/cmap/message_stream.js:33:9)
    at writeOrBuffer (node:internal/streams/writable:392:12)
    at _write (node:internal/streams/writable:333:10)
    at Writable.write (node:internal/streams/writable:337:10)
    at Socket.ondata (node:internal/streams/readable:809:22)
    at Socket.emit (node:events:517:28) {
  ok: 0,
  code: 20,
  codeName: 'IllegalOperation',
  [Symbol(errorLabels)]: Set(0) {}
} depositId undefined

MongoDB 設定

• ref:
  • https://github.com/CAFECA-IO/tbd-backend/blob/TzuHanLiang-patch-1/README.md
  • https://github.com/CAFECA-IO/tbd-backend/pull/325/files
  • https://zhuanlan.zhihu.com/p/91278279
  • https://www.mongodb.com/community/forums/t/able-to-connect-to-containerized-db-but-only-without-replica-set/10043/3

[arealclimber]

docker-compose.yml

version: "3.1"
services:
  mongo:
    image: mongo
    restart: always
    command: mongod --replSet rs0
    networks:
      - mongodb-net
    ports:
      - 27017:27017
    volumes:
      - mongo_data:/data/db

networks:
  mongodb-net:
    driver: bridge

volumes:
  mongo_data:

mongod.conf

replication:
  replSetName: rs0

• 在 docker-compose.yaml 目錄下執行 docker run --name tbd-db -d -p 27017:27017 -v /mongod.conf:/etc/mongo/mongod.conf mongo 會有檔案存取的問題：

  
  docker run --name tbd-db -d -p 27017:27017 -v /mongod.conf:/etc/mongo/mongod.conf mongo

5ee439fc01412e2b956160b15e6aad6c3724cbaca6383ea4888b18b55f71af51 docker: Error response from daemon: Mounts denied: The path /mongod.conf is not shared from the host and is not known to Docker. You can configure shared paths from Docker -> Preferences... -> Resources -> File Sharing. See https://docs.docker.com/desktop/mac for more info.

- 

[arealclimber]

用 https://github.com/CAFECA-IO/tbd-backend/pull/325 的方法重新試一遍之後，拿到 replica set state log，但 tableplus 還連不上，但是輸入 http://127.0.0.1:27017/ 可以拿到 It looks like you are trying to access MongoDB over HTTP on the native driver port.

從log 跟連線看起來沒問題，但是要找 tableplus 跟後端連線入口

rs0 [direct: primary] testdb> rs.status()
{
  set: 'rs0',
  date: ISODate('2024-02-01T10:06:00.196Z'),
  myState: 1,
  term: Long('1'),
  syncSourceHost: '',
  syncSourceId: -1,
  heartbeatIntervalMillis: Long('2000'),
  majorityVoteCount: 1,
  writeMajorityCount: 1,
  votingMembersCount: 1,
  writableVotingMembersCount: 1,
  optimes: {
    lastCommittedOpTime: { ts: Timestamp({ t: 1706781953, i: 1 }), t: Long('1') },
    lastCommittedWallTime: ISODate('2024-02-01T10:05:53.033Z'),
    readConcernMajorityOpTime: { ts: Timestamp({ t: 1706781953, i: 1 }), t: Long('1') },
    appliedOpTime: { ts: Timestamp({ t: 1706781953, i: 1 }), t: Long('1') },
    durableOpTime: { ts: Timestamp({ t: 1706781953, i: 1 }), t: Long('1') },
    lastAppliedWallTime: ISODate('2024-02-01T10:05:53.033Z'),
    lastDurableWallTime: ISODate('2024-02-01T10:05:53.033Z')
  },
  lastStableRecoveryTimestamp: Timestamp({ t: 1706781893, i: 1 }),
  electionCandidateMetrics: {
    lastElectionReason: 'electionTimeout',
    lastElectionDate: ISODate('2024-02-01T09:59:02.746Z'),
    electionTerm: Long('1'),
    lastCommittedOpTimeAtElection: { ts: Timestamp({ t: 1706781542, i: 1 }), t: Long('-1') },
    lastSeenOpTimeAtElection: { ts: Timestamp({ t: 1706781542, i: 1 }), t: Long('-1') },
    numVotesNeeded: 1,
    priorityAtElection: 1,
    electionTimeoutMillis: Long('10000'),
    newTermStartDate: ISODate('2024-02-01T09:59:02.816Z'),
    wMajorityWriteAvailabilityDate: ISODate('2024-02-01T09:59:02.849Z')
  },
  members: [
    {
      _id: 0,
      name: 'f7efa7552798:27017',
      health: 1,
      state: 1,
      stateStr: 'PRIMARY',
      uptime: 564,
      optime: { ts: Timestamp({ t: 1706781953, i: 1 }), t: Long('1') },
      optimeDate: ISODate('2024-02-01T10:05:53.000Z'),
      lastAppliedWallTime: ISODate('2024-02-01T10:05:53.033Z'),
      lastDurableWallTime: ISODate('2024-02-01T10:05:53.033Z'),
      syncSourceHost: '',
      syncSourceId: -1,
      infoMessage: '',
      electionTime: Timestamp({ t: 1706781542, i: 2 }),
      electionDate: ISODate('2024-02-01T09:59:02.000Z'),
      configVersion: 46994,
      configTerm: -1,
      self: true,
      lastHeartbeatMessage: ''
    }
  ],
  ok: 1,
  '$clusterTime': {
    clusterTime: Timestamp({ t: 1706781953, i: 1 }),
    signature: {
      hash: Binary.createFromBase64('AAAAAAAAAAAAAAAAAAAAAAAAAAA=', 0),
      keyId: Long('0')
    }
  },
  operationTime: Timestamp({ t: 1706781953, i: 1 })
}

[arealclimber]

taking 0.5 hrs remaining 2.5 hrs

[arealclimber]

後端跟資料庫設置

• 在 tbd-backend root directory 下，新增 Dockerfile, docker-compose.yml

• 更改完以下檔案後，依序執行指令

  • docker-compose down -v
    • 清除之前的 volume
  • docker-compose build
  • docker-compose up -d
  • docker ps
  • docker exec -it <CONTAINER_ID> bin/bash
  • mongosh
  • rs.status()
    • 檢查 replica set 狀態
  • 為了讓容器之間可以互相連線，host 需設定為 docker-compose.yml 裡面的 service 名稱

  rs.initiate({
  _id: "rs0",
  members: [{ _id: 0, host: "mongodb:27017" }]
  })

  • rs.status()
  • 其餘指令
    • docker network inspect mongodb-net
      • 檢查 mongodb-net 網路
    • docker network ls
      • 列出所有網路

Dockerfile

# Base image
FROM node:18

# Create app directory
WORKDIR /usr/src/app

# A wildcard is used to ensure both package.json AND package-lock.json are copied
COPY package*.json ./

# Install app dependencies
RUN npm install

# Bundle app source
COPY . .

# Copy the .env and .env.development files
COPY development.env ./

# Creates a "dist" folder with the production build
RUN npm run build

# Expose the port on which the app will run
EXPOSE 3001

# Start the server using the production build
CMD ["npm", "run", "start:prod"]

docker-compose.yml

version: '3.8'
services:
  mongodb:
    image: mongo:latest
    command: mongod --replSet rs0 --bind_ip_all
    ports:
      - '27017:27017'
    volumes:
      - mongodb-data:/data/db
    networks:
      - mongodb-net

  nestjs-app:
    build: .
    ports:
      - '3001:80'
    environment:
      - MONGO_URI=mongodb://mongodb:27017/nestjs?replicaSet=rs0
    depends_on:
      - mongodb
    networks:
      - mongodb-net

networks:
  mongodb-net:
    name: mongodb-net
    driver: bridge

volumes:
  mongodb-data:

development.env

MONGO_PROTOCOL=mongodb
MONGO_USERNAME=
MONGO_PASSWORD=
MONGO_RESOURCE=mongodb
MONGO_DATABASE=nestjs
MONGO_PORT=27017
MONGO_URI=mongodb://mongodb:27017/nestjs?replicaSet=rs0

• demo 用的 mongo db 沒有 username 跟 password，所以需要對應調整 code 才能連上

mongo.config.ts

import { registerAs } from '@nestjs/config';

export default registerAs('mongo', () => {
  const protocol = process.env.MONGO_PROTOCOL;
  const username = process.env.MONGO_USERNAME;
  const password = encodeURIComponent(process.env.MONGO_PASSWORD);
  const resource = process.env.MONGO_RESOURCE;
  const database = process.env.MONGO_DATABASE;
  const port = process.env.MONGO_PORT;
  const URL = process.env.MONGO_URL;
  const uri = `${protocol}://${resource}:${port}/${database}?retryWrites=true&w=majority`;
  console.log('uri in registerAs', uri);
  console.log('MONGO_URI in registerAs', URL);
  return {
    username,
    password,
    resource,
    uri,
    useNewUrlParser: true,
    useUnifiedTopology: true,
  };
});

common.module.ts

 MongooseModule.forRootAsync({
      imports: [ConfigModule],
      inject: [ConfigService],
      useFactory: async (config: ConfigService) => ({
        // uri: config.get<string>('MONGO_URI'),
        uri: config.get<string>('mongo.uri'),
      }),
    }),

table plus 連線

URL: mongodb://localhost:27017

[arealclimber]

前端設置

• 在 tbd-backend root directory 的 docker-compose.yml 改為：

  
  version: '3.8'
  services:
  mongodb:
  image: mongo:latest
  command: mongod --replSet rs0 --bind_ip_all
  ports:
    - '27017:27017'
  volumes:
    - mongodb-data:/data/db
  networks:
    - mongodb-net
  
  nestjs-app:
  build: .
  ports:
    - '3001:80'
  environment:
    - MONGO_URI=mongodb://mongodb:27017/nestjs?replicaSet=rs0
  depends_on:
    - mongodb
  networks:
    - mongodb-net
  
  nextjs-app:
  build:
    context: ../tidebit-defi-dev
    dockerfile: Dockerfile
  ports:
    - '3000:3000'
  environment:
    - API_URL=http://nestjs-app:3001
  depends_on:
    - nestjs-app

networks: mongodb-net: name: mongodb-net driver: bridge

volumes: mongodb-data:

- 接著在 tbd-backend 底下執行指令，就能在 `http:localhost:3000` 執行登入、入金、開倉、更新倉位、關倉
    - `docker-compose build`
    - `docker-compose up -d`

[arealclimber]

Open position

https://github.com/CAFECA-IO/TideBit-DeFi/assets/20677913/f4dbf454-7d10-4f3a-aaf6-8d2cb3beda93

Update position

https://github.com/CAFECA-IO/TideBit-DeFi/assets/20677913/e5cf436d-6179-4270-98bc-73f314926dee

Close position

https://github.com/CAFECA-IO/TideBit-DeFi/assets/20677913/a088d464-ea4b-4765-931b-52d23aff62c7

Leaderboard & My assets

https://github.com/CAFECA-IO/TideBit-DeFi/assets/20677913/f4f0065d-ff3f-4d49-a5d3-a621ec03a4b9

交易之後的首頁

[arealclimber]

taking 6 hrs

• 了解 Docker 基本運行原理、Dockerfile vs docker-compose.yml 的差別
• 測試 Nest.js running locally 可以連接 MongoDB replica set running on Docker
• 除錯為何 Nest.js running on Docker 不可以連接 MongoDB replica set running on Docker
  • 包含測試 MongoDB 有設定用戶名、密碼、密鑰，以及都沒設定用戶名、密碼、密鑰
  • 確認 Table Plus 或 MongoDB compass 可以連上
  • 查詢容器之間的連線
  • 最後一個一個指令往上查，發現 rs.initiate({ _id: "rs0", members: [{ _id: 0, host: "127.0.0.1:27017" }] }) 是導致後端容器連不上DB容器的原因，要讓 Docker 容器彼此連線的前提下，需要用“可尋址(addressable)”的設定，例如用<MONGO_SERVICE_NAME>:<PORT>，用 127.0.0.1:27017 會找不到