Added support for multiple transactor accounts when running the server, so we can take advantage of ability for operators to assign different transactor accounts per bucket.
Added support specifying which buckets to serve when running a server.
Bump version to v3.6.0
In combination these two changes now allows workers who operate multiple buckets to be able to run multiple nodes, for example with each node serving a single bucket.
Also finally added behavior to allow server to startup even if transactor account is not provided to one or more buckets. The server will still serve downloads and sync those buckets. This is very useful for testing. I can run a node and specify a valid worker id and test the nodes behavior, open telemetry traces etc.
yarn storage-node server -d ~/tmp/ -o 3333 --apiUrl wss://rpc.joystream.org \
-s -r 1 -w 8 --buckets 0,1,2,3,4,5,6,7
2023-07-16 03:07:35:735 info: Initializing runtime connection to: wss://rpc.joystream.org
2023-07-16 03:07:38:738 info: Waiting for chain to be synced before proceeding.
2023-07-16 03:07:38:738 info: Query node endpoint set: http://localhost:8081/graphql
2023-07-16 03:07:38:738 debug: Query - storageBucketsConnection
› Warning: Missing transactor key for bucket 1
2023-07-16 03:07:39:739 warn: Only subset of buckets will process uploads!
2023-07-16 03:07:39:739 info: Buckets synced and served: 1
2023-07-16 03:07:39:739 info: Buckets accepting uploads:
2023-07-16 03:07:39:739 info: Removing temp directory ...
2023-07-16 03:07:39:739 info: Creating temp directory ...
2023-07-16 03:07:39:739 debug: Local ID cache loaded.
2023-07-16 03:07:39:739 info: Synchronization enabled.
2023-07-16 03:07:39:739 debug: Max file size runtime parameter: 64424509440
2023-07-16 03:07:39:739 info: Listening on http://localhost:3333
2023-07-16 03:07:39:739 info: Sync paused for 1 minute(s).
~Even an invalid worker id can be specified, in which-case the server will startup, but with very limited functionality. This is useful for preparing a new node, testing endpoint accessibility, and general testing.~ We should add a separate command for this purpose.
Fixes https://github.com/Joystream/joystream/issues/4794
Added support for multiple transactor accounts when running the server, so we can take advantage of ability for operators to assign different transactor accounts per bucket.
Added support specifying which buckets to serve when running a server.
Bump version to v3.6.0
In combination these two changes now allows workers who operate multiple buckets to be able to run multiple nodes, for example with each node serving a single bucket.
~Even an invalid worker id can be specified, in which-case the server will startup, but with very limited functionality. This is useful for preparing a new node, testing endpoint accessibility, and general testing.~ We should add a separate command for this purpose.