dragonflyoss / Dragonfly2

Dragonfly is an open source P2P-based file distribution and image acceleration system. It is hosted by the Cloud Native Computing Foundation (CNCF) as an Incubating Level Project.
https://d7y.io
Apache License 2.0
2.1k stars 264 forks source link

It takes 1-2 seconds to download the preheated image and download it directly from the harbor warehouse. #3298

Closed mansoncui closed 1 month ago

mansoncui commented 1 month ago

harbor download image

image

prehaet proxy download image image

schedule core.log core-seed-peer.log

seed peer core.log scheduler-core.log

helm install value.yaml config: value.txt

gaius-qi commented 1 month ago

I can't understand the your problem from your description.

mansoncui commented 1 month ago

Problem: 1、How to determine from the log that the download is from the seed peer 2、Preheating the harbor public warehouse through dragonfly proxy pull image takes longer than pulling the image directly

helm install dragonfly

## cat value.yaml
containerRuntime:
  containerd:
    enable: true
    registries:
      - 'https://harbor.test.wifi.com'

scheduler:
  replicas: 1
  metrics:
    enable: true
    serviceMonitor:
      enable: true
  config:
    verbose: true
    pprofPort: 18066
    scheduler:
      gc:
        peerTTL: 96h
        hostGCInterval: 72h

seedPeer:
  enable: true
  image:
    repository: dragonflyoss/dfdaemon
    tag: latest
  replicas: 1
  metrics:
    enable: true
    serviceMonitor:
      enable: true
  config:
    verbose: true
    pprofPort: 18066
    proxy:
      defaultFilter: 'Expires&Signature&ns'
      security:
        insecure: true
      tcpListen:
        listen: 0.0.0.0
        port: 65001
      registryMirror:
        dynamic: true
        url: https://harbor.test.wifi.com
        insecure: true
      proxies:
        - regx: blobs/sha256.*

dfdaemon:
  enable: true
  image:
    registry: harbor-wf.internal.zenmen.com
    repository: dragonflyoss/dfdaemon-certs-1
    tag: latest
  metrics:
    enable: true
    serviceMonitor:
      enable: true
  config:
    verbose: true
    pprofPort: 18066
    storage:
      taskExpireTime: 72h
    download:
      totalRateLimit: 4096Mi
      perPeerRateLimit: 4096Mi
    upload:
      rateLimit: 4096Mi
    scheduler:
      manager:
        enable: true
        seedPeer:
          enable: false
          type: super
          clusterID: 1
          keepAlive:
            internal: 5s
    proxy:
      defaultFilter: 'Expires&Signature&ns'
      security:
        insecure: true
      tcpListen:
        listen: 0.0.0.0
        port: 65001
      registryMirror:
        dynamic: true
        url: https://harbor.test.wifi.com
        insecure: true
        certs:
          - /etc/docker/certs.d/ca.crt
      proxies:
        - regx: blobs/sha256.*

manager:
  replicas: 1
  metrics:
    enable: true
    serviceMonitor:
      enable: true
  config:
    verbose: true
    pprofPort: 18066
    job:
      syncPeers:
        interval: 13h
        timeout: 10m
      preheat:
        registryTimeout: 1m
        tls:
          # caCert is the CA certificate for preheat tls handshake, it can be path or PEM format string.
          caCert: |
            -----BEGIN CERTIFICATE-----
            -----END CERTIFICATE-----

jaeger:
  enable: true

##containerd config
containerd /etc/containerd/config.toml
[plugins."io.containerd.grpc.v1.cri".registry.mirrors."harbor.test.wifi.com"]
  endpoint = ["http://127.0.0.1:65001","https://harbor.test.wifi.com"]
image seed peer task info:
#cat /var/log/dragonfly/daemon/core.log | grep "peer task done" 
{"level":"info","ts":"2024-05-29 08:13:38.512","caller":"peer/peertask_conductor.go:1383","msg":"peer task done, cost: 148ms","peer":"10.222.79.36-1-fb908c9b-f968-4891-bb07-7eff77cd3c57_Seed","task":"f8e79490f3ec5fcbdf7b082992dfe303f2cbf16e11058dae47afd94fc2420973","component":"PeerTask","trace":"cfb90b36c95a53c950b2a001101017a7"}
{"level":"info","ts":"2024-05-29 08:13:38.518","caller":"peer/peertask_conductor.go:1383","msg":"peer task done, cost: 154ms","peer":"10.222.79.36-1-7d16c20f-409c-405a-b6a0-db165f3f9707_Seed","task":"a40bc6de3c414d6e82701c62c2df66187ba86d048af8bab03660411d4e431c5a","component":"PeerTask","trace":"44b99ebbb34ab822840d3a913d86f75f"} 
{"level":"info","ts":"2024-05-29 08:13:38.526","caller":"peer/peertask_conductor.go:1383","msg":"peer task done, cost: 162ms","peer":"10.222.79.36-1-25c083bb-c59f-4ade-af87-1ad123341ae7_Seed","task":"e1697ef5bc877913be3673a58f8e6a91ec807039b14790171170a3a1b3078db6","component":"PeerTask","trace":"e026dab6cc4c0e2b8e37c480b84e9a4a"} 
{"level":"info","ts":"2024-05-29 08:13:38.541","caller":"peer/peertask_conductor.go:1383","msg":"peer task done, cost: 177ms","peer":"10.222.79.36-1-0541862c-4732-4812-b466-ad2aea370a09_Seed","task":"bfccdc5c4e40ef4d09183fef6b023660135657c330282b3d8ca29470eb6018b5","component":"PeerTask","trace":"75936a8da0af2da86a985c4f973520da"}
{"level":"info","ts":"2024-05-29 08:13:38.545","caller":"peer/peertask_conductor.go:1383","msg":"peer task done, cost: 181ms","peer":"10.222.79.36-1-dc1c860d-ba14-49ba-b07e-97b6bee2c6b4_Seed","task":"5dec570990b5ae12d1f417af02d25673992f0e0bdd8b281f18893daeb1d2b3b7","component":"PeerTask","trace":"fd224730f4cc50349c66c2339d9e0794"} 
{"level":"info","ts":"2024-05-29 08:13:38.546","caller":"peer/peertask_conductor.go:1383","msg":"peer task done, cost: 182ms","peer":"10.222.79.36-1-bb4f2752-8267-4809-aebb-049619da735c_Seed","task":"55477514a8c921ee18a841c5cb91be59cb51fdc8a5beac7154301347b6fa8c3d","component":"PeerTask","trace":"1658ae6d5c73f828dd9dbb5ad16d0fba"} 
{"level":"info","ts":"2024-05-29 08:13:38.551","caller":"peer/peertask_conductor.go:1383","msg":"peer task done, cost: 186ms","peer":"10.222.79.36-1-d67340c7-44e6-420d-bc1e-c9c6646e12f3_Seed","task":"ab44a04a9132ae0397d390ca8267e0d808e683cabbbbdf97f05ce501ac5bc463","component":"PeerTask","trace":"d08fbe92eec34b008bc0bd0fb6c654b1"} 
{"level":"info","ts":"2024-05-29 08:13:38.551","caller":"peer/peertask_conductor.go:1383","msg":"peer task done, cost: 186ms","peer":"10.222.79.36-1-d414d0f3-6aa6-4f72-8830-cde1c6c38824_Seed","task":"0169e9cf1d18142e91bba460de2dd34056401d8c8a50a4c6d0b180a0f8c2a307","component":"PeerTask","trace":"43cf521210ce68302cfd6e07afd7f87f"} 
{"level":"info","ts":"2024-05-29 08:13:38.619","caller":"peer/peertask_conductor.go:1383","msg":"peer task done, cost: 254ms","peer":"10.222.79.36-1-9e3a8a46-301d-468f-969b-20c9ec5d1089_Seed","task":"161489e324f62e68361c2ecc76e668195427e796f623dfb4b8cea48111d94fa6","component":"PeerTask","trace":"008037ab6f75818417427e58c9f9223c"} 
{"level":"info","ts":"2024-05-29 08:13:38.677","caller":"peer/peertask_conductor.go:1383","msg":"peer task done, cost: 313ms","peer":"10.222.79.36-1-e5c8c2a6-e357-4804-a505-66a7196c1f58_Seed","task":"18629e15046b94c410db71976477880ba3aac2fe7b168d8df75f20b3a94c0b96","component":"PeerTask","trace":"5d189ceda68729653153b8d4ad6ae150"}
{"level":"info","ts":"2024-05-29 08:13:38.736","caller":"peer/peertask_conductor.go:1383","msg":"peer task done, cost: 371ms","peer":"10.222.79.36-1-108a160c-4be8-45b0-be90-5e14427cc146_Seed","task":"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320","component":"PeerTask","trace":"d92725773677bebe09e38a27807e4efc"} 
{"level":"info","ts":"2024-05-29 08:13:38.752","caller":"peer/peertask_conductor.go:1383","msg":"peer task done, cost: 388ms","peer":"10.222.79.36-1-a7f56d5c-f73c-470b-8a03-1001d8bca5f3_Seed","task":"c6ed1f62d8990ac98b27010c3155f29552512a04cf309950330d4ea7747b95b1","component":"PeerTask","trace":"30f17c55946dabb4d16474ff9123c202"} 
{"level":"info","ts":"2024-05-29 08:30:15.856","caller":"peer/peertask_conductor.go:1383","msg":"peer task done, cost: 140ms","peer":"10.222.79.36-1-c109768f-7b74-46db-8a69-6ec0511fcd85_Seed","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","component":"PeerTask","trace":"26233a0c850d0075214200aa531bb23f"} 
{"level":"info","ts":"2024-05-29 08:30:16.558","caller":"peer/peertask_conductor.go:1383","msg":"peer task done, cost: 129ms","peer":"10.222.79.36-1-3462f1bc-bc81-4991-9ce1-bbea039026b4_Seed","task":"f5cd5868a3a7f3572307f669c303f49e4e3960bac2b26e473bfd08c16849e58b","component":"PeerTask","trace":"45bc804979a8a284c66b3332d632d3e8"}

scheduler log info:

{"level":"info","ts":"2024-05-29 08:13:38.362","caller":"job/job.go:249","msg":"preheat(v2) https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:ca3cd42a7c9525f6ce3d64c1a70982613a8235f0cc057ec9244052921853ef15 tag: , filtered query params: , digest: , headers: map[string]string{\"Accept\":\"application/vnd.docker.image.rootfs.diff.tar.gzip\", \"Authorization\":\"Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IjdXTUE6S1ZYTzpLRjI1OjM1TkE6R0ozNTpaR0tZOlBHWVQ6STVVVDpUR1dZOlVVSTQ6UFQ3WjpYM0tXIiwidHlwIjoiSldUIn0.eyJhdWQiOiJoYXJib3ItcmVnaXN0cnkiLCJleHAiOjE3MTY5NzIyMTgsImp0aSI6IndCQXJhVEMydjRhd2lFU2siLCJpYXQiOjE3MTY5NzA0MTgsImlzcyI6ImhhcmJvci10b2tlbi1pc3N1ZXIiLCJuYmYiOjE3MTY5NzA0MTgsImFjY2VzcyI6W3sidHlwZSI6InJlcG9zaXRvcnkiLCJuYW1lIjoiaW5pdC1pbWFnZXMvYmlnZGF0YS0xMCIsImFjdGlvbnMiOlsicHVsbCJdfV19.UBm9l1XMipmsRXFjR9y0347gqHlkC8DpAocQgaqwjgEVRD-drlPOHnUIY1WHIBidcfpUCr60QKb53hSnZ__mdqb6IFDYiO4xcSeINxtSD9vYaxSAEKL2fRJxhbP1lCN556W03Dav8NxS_8ULJO2pZDzJXY7n4ICDJFWwGInf4VqgrRFz0CAm8wpf_WceAKWZwG_evZKISDRG4hSfZhQMqI2CWoOR6hHeokuK2mIBYKnq0wixbN9Oi7_6Muxh2HvFKlog5OCwyaivLCfCfziZ3jTwpC1J4r-gaizsvq3Je0neXDhuK5kNAKDO_SIPJTcoK6EipltNcr0kVFINkWEOxhq7ejs3Z1qh7elVqyXI2S9FOeuK7RVWvnkgaCt2kDA75itap0JYVjRKMopAEM5ujvStlUL66J_NF5RWuAScbw7kTh2vRAPQ9dA0hKTXzWQgtKmaP4u7UbG29TF2lx2_FAqSD9gSkMXdOX_5cUyRE3cx2glvrGq4jn6I5rUW4-cil_Ik_TGGsrsNFCZuvCFL25ssus0D2w0BjO4fWZtFQxRD7_EyrMb6HWcarCWr7OT1SEc-_WG8jWHYfegesE-erZkt8Uj033lZUmIixJt6v_8RQT5ZRWtlbLT3eTnPUd_lQZOE5rqtWaSXIXDznngaFgV4xc8DMxNkpPA5wTj1U_E\"}","taskID":"6835f6e5125bf596f79aa6bb3b5b2059c44f699f3d7c1f0b3f308bdef8bf9a05","url":"https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:ca3cd42a7c9525f6ce3d64c1a70982613a8235f0cc057ec9244052921853ef15"}
{"level":"info","ts":"2024-05-29 08:13:38.362","caller":"job/job.go:249","msg":"preheat(v2) https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:18e7ff17db9d6afa1446adc4cdc56503ab6eead8549322304c33141fbe83de7d tag: , filtered query params: , digest: , headers: map[string]string{\"Accept\":\"application/vnd.docker.image.rootfs.diff.tar.gzip\", \"Authorization\":\"Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IjdXTUE6S1ZYTzpLRjI1OjM1TkE6R0ozNTpaR0tZOlBHWVQ6STVVVDpUR1dZOlVVSTQ6UFQ3WjpYM0tXIiwidHlwIjoiSldUIn0.eyJhdWQiOiJoYXJib3ItcmVnaXN0cnkiLCJleHAiOjE3MTY5NzIyMTgsImp0aSI6IndCQXJhVEMydjRhd2lFU2siLCJpYXQiOjE3MTY5NzA0MTgsImlzcyI6ImhhcmJvci10b2tlbi1pc3N1ZXIiLCJuYmYiOjE3MTY5NzA0MTgsImFjY2VzcyI6W3sidHlwZSI6InJlcG9zaXRvcnkiLCJuYW1lIjoiaW5pdC1pbWFnZXMvYmlnZGF0YS0xMCIsImFjdGlvbnMiOlsicHVsbCJdfV19.UBm9l1XMipmsRXFjR9y0347gqHlkC8DpAocQgaqwjgEVRD-drlPOHnUIY1WHIBidcfpUCr60QKb53hSnZ__mdqb6IFDYiO4xcSeINxtSD9vYaxSAEKL2fRJxhbP1lCN556W03Dav8NxS_8ULJO2pZDzJXY7n4ICDJFWwGInf4VqgrRFz0CAm8wpf_WceAKWZwG_evZKISDRG4hSfZhQMqI2CWoOR6hHeokuK2mIBYKnq0wixbN9Oi7_6Muxh2HvFKlog5OCwyaivLCfCfziZ3jTwpC1J4r-gaizsvq3Je0neXDhuK5kNAKDO_SIPJTcoK6EipltNcr0kVFINkWEOxhq7ejs3Z1qh7elVqyXI2S9FOeuK7RVWvnkgaCt2kDA75itap0JYVjRKMopAEM5ujvStlUL66J_NF5RWuAScbw7kTh2vRAPQ9dA0hKTXzWQgtKmaP4u7UbG29TF2lx2_FAqSD9gSkMXdOX_5cUyRE3cx2glvrGq4jn6I5rUW4-cil_Ik_TGGsrsNFCZuvCFL25ssus0D2w0BjO4fWZtFQxRD7_EyrMb6HWcarCWr7OT1SEc-_WG8jWHYfegesE-erZkt8Uj033lZUmIixJt6v_8RQT5ZRWtlbLT3eTnPUd_lQZOE5rqtWaSXIXDznngaFgV4xc8DMxNkpPA5wTj1U_E\"}","taskID":"dba2d1ee4566c39eef8bb5346c5c70ca8c8b4213c08c37a982dfcb238b13f936","url":"https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:18e7ff17db9d6afa1446adc4cdc56503ab6eead8549322304c33141fbe83de7d"}
{"level":"info","ts":"2024-05-29 08:13:38.362","caller":"job/job.go:249","msg":"preheat(v2) https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:7f76cf5961f2c6bca667702008cb73bd980d11f68cabf61c0f4713e98421b3c6 tag: , filtered query params: , digest: , headers: map[string]string{\"Accept\":\"application/vnd.docker.image.rootfs.diff.tar.gzip\", \"Authorization\":\"Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IjdXTUE6S1ZYTzpLRjI1OjM1TkE6R0ozNTpaR0tZOlBHWVQ6STVVVDpUR1dZOlVVSTQ6UFQ3WjpYM0tXIiwidHlwIjoiSldUIn0.eyJhdWQiOiJoYXJib3ItcmVnaXN0cnkiLCJleHAiOjE3MTY5NzIyMTgsImp0aSI6IndCQXJhVEMydjRhd2lFU2siLCJpYXQiOjE3MTY5NzA0MTgsImlzcyI6ImhhcmJvci10b2tlbi1pc3N1ZXIiLCJuYmYiOjE3MTY5NzA0MTgsImFjY2VzcyI6W3sidHlwZSI6InJlcG9zaXRvcnkiLCJuYW1lIjoiaW5pdC1pbWFnZXMvYmlnZGF0YS0xMCIsImFjdGlvbnMiOlsicHVsbCJdfV19.UBm9l1XMipmsRXFjR9y0347gqHlkC8DpAocQgaqwjgEVRD-drlPOHnUIY1WHIBidcfpUCr60QKb53hSnZ__mdqb6IFDYiO4xcSeINxtSD9vYaxSAEKL2fRJxhbP1lCN556W03Dav8NxS_8ULJO2pZDzJXY7n4ICDJFWwGInf4VqgrRFz0CAm8wpf_WceAKWZwG_evZKISDRG4hSfZhQMqI2CWoOR6hHeokuK2mIBYKnq0wixbN9Oi7_6Muxh2HvFKlog5OCwyaivLCfCfziZ3jTwpC1J4r-gaizsvq3Je0neXDhuK5kNAKDO_SIPJTcoK6EipltNcr0kVFINkWEOxhq7ejs3Z1qh7elVqyXI2S9FOeuK7RVWvnkgaCt2kDA75itap0JYVjRKMopAEM5ujvStlUL66J_NF5RWuAScbw7kTh2vRAPQ9dA0hKTXzWQgtKmaP4u7UbG29TF2lx2_FAqSD9gSkMXdOX_5cUyRE3cx2glvrGq4jn6I5rUW4-cil_Ik_TGGsrsNFCZuvCFL25ssus0D2w0BjO4fWZtFQxRD7_EyrMb6HWcarCWr7OT1SEc-_WG8jWHYfegesE-erZkt8Uj033lZUmIixJt6v_8RQT5ZRWtlbLT3eTnPUd_lQZOE5rqtWaSXIXDznngaFgV4xc8DMxNkpPA5wTj1U_E\"}","taskID":"76cf590438480c1687db83b3a92d47855fb6e9ff47bd951ad92a2ca8426b54d8","url":"https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:7f76cf5961f2c6bca667702008cb73bd980d11f68cabf61c0f4713e98421b3c6"}
{"level":"info","ts":"2024-05-29 08:13:38.362","caller":"job/job.go:249","msg":"preheat(v2) https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:f38403c80edca2edf058a023893e1d649c8538180916aac6aa0842b25dd845ec tag: , filtered query params: , digest: , headers: map[string]string{\"Accept\":\"application/vnd.docker.image.rootfs.diff.tar.gzip\", \"Authorization\":\"Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IjdXTUE6S1ZYTzpLRjI1OjM1TkE6R0ozNTpaR0tZOlBHWVQ6STVVVDpUR1dZOlVVSTQ6UFQ3WjpYM0tXIiwidHlwIjoiSldUIn0.eyJhdWQiOiJoYXJib3ItcmVnaXN0cnkiLCJleHAiOjE3MTY5NzIyMTgsImp0aSI6IndCQXJhVEMydjRhd2lFU2siLCJpYXQiOjE3MTY5NzA0MTgsImlzcyI6ImhhcmJvci10b2tlbi1pc3N1ZXIiLCJuYmYiOjE3MTY5NzA0MTgsImFjY2VzcyI6W3sidHlwZSI6InJlcG9zaXRvcnkiLCJuYW1lIjoiaW5pdC1pbWFnZXMvYmlnZGF0YS0xMCIsImFjdGlvbnMiOlsicHVsbCJdfV19.UBm9l1XMipmsRXFjR9y0347gqHlkC8DpAocQgaqwjgEVRD-drlPOHnUIY1WHIBidcfpUCr60QKb53hSnZ__mdqb6IFDYiO4xcSeINxtSD9vYaxSAEKL2fRJxhbP1lCN556W03Dav8NxS_8ULJO2pZDzJXY7n4ICDJFWwGInf4VqgrRFz0CAm8wpf_WceAKWZwG_evZKISDRG4hSfZhQMqI2CWoOR6hHeokuK2mIBYKnq0wixbN9Oi7_6Muxh2HvFKlog5OCwyaivLCfCfziZ3jTwpC1J4r-gaizsvq3Je0neXDhuK5kNAKDO_SIPJTcoK6EipltNcr0kVFINkWEOxhq7ejs3Z1qh7elVqyXI2S9FOeuK7RVWvnkgaCt2kDA75itap0JYVjRKMopAEM5ujvStlUL66J_NF5RWuAScbw7kTh2vRAPQ9dA0hKTXzWQgtKmaP4u7UbG29TF2lx2_FAqSD9gSkMXdOX_5cUyRE3cx2glvrGq4jn6I5rUW4-cil_Ik_TGGsrsNFCZuvCFL25ssus0D2w0BjO4fWZtFQxRD7_EyrMb6HWcarCWr7OT1SEc-_WG8jWHYfegesE-erZkt8Uj033lZUmIixJt6v_8RQT5ZRWtlbLT3eTnPUd_lQZOE5rqtWaSXIXDznngaFgV4xc8DMxNkpPA5wTj1U_E\"}","taskID":"a1a77c48a1ba90382d7edae996d03b7d022bac7727fcd1a9d674469d3e85bff6","url":"https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:f38403c80edca2edf058a023893e1d649c8538180916aac6aa0842b25dd845ec"}
{"level":"info","ts":"2024-05-29 08:13:38.362","caller":"job/job.go:249","msg":"preheat(v2) https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:9f0d5f02d7d1c35dc742d202ba49ee4b7fe9f26bb03cd1768043cbe5fc1e817b tag: , filtered query params: , digest: , headers: map[string]string{\"Accept\":\"application/vnd.docker.image.rootfs.diff.tar.gzip\", \"Authorization\":\"Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IjdXTUE6S1ZYTzpLRjI1OjM1TkE6R0ozNTpaR0tZOlBHWVQ6STVVVDpUR1dZOlVVSTQ6UFQ3WjpYM0tXIiwidHlwIjoiSldUIn0.eyJhdWQiOiJoYXJib3ItcmVnaXN0cnkiLCJleHAiOjE3MTY5NzIyMTgsImp0aSI6IndCQXJhVEMydjRhd2lFU2siLCJpYXQiOjE3MTY5NzA0MTgsImlzcyI6ImhhcmJvci10b2tlbi1pc3N1ZXIiLCJuYmYiOjE3MTY5NzA0MTgsImFjY2VzcyI6W3sidHlwZSI6InJlcG9zaXRvcnkiLCJuYW1lIjoiaW5pdC1pbWFnZXMvYmlnZGF0YS0xMCIsImFjdGlvbnMiOlsicHVsbCJdfV19.UBm9l1XMipmsRXFjR9y0347gqHlkC8DpAocQgaqwjgEVRD-drlPOHnUIY1WHIBidcfpUCr60QKb53hSnZ__mdqb6IFDYiO4xcSeINxtSD9vYaxSAEKL2fRJxhbP1lCN556W03Dav8NxS_8ULJO2pZDzJXY7n4ICDJFWwGInf4VqgrRFz0CAm8wpf_WceAKWZwG_evZKISDRG4hSfZhQMqI2CWoOR6hHeokuK2mIBYKnq0wixbN9Oi7_6Muxh2HvFKlog5OCwyaivLCfCfziZ3jTwpC1J4r-gaizsvq3Je0neXDhuK5kNAKDO_SIPJTcoK6EipltNcr0kVFINkWEOxhq7ejs3Z1qh7elVqyXI2S9FOeuK7RVWvnkgaCt2kDA75itap0JYVjRKMopAEM5ujvStlUL66J_NF5RWuAScbw7kTh2vRAPQ9dA0hKTXzWQgtKmaP4u7UbG29TF2lx2_FAqSD9gSkMXdOX_5cUyRE3cx2glvrGq4jn6I5rUW4-cil_Ik_TGGsrsNFCZuvCFL25ssus0D2w0BjO4fWZtFQxRD7_EyrMb6HWcarCWr7OT1SEc-_WG8jWHYfegesE-erZkt8Uj033lZUmIixJt6v_8RQT5ZRWtlbLT3eTnPUd_lQZOE5rqtWaSXIXDznngaFgV4xc8DMxNkpPA5wTj1U_E\"}","taskID":"5ce8a2ce5106ed821ba880d28138531b2c4247b4bc4749b48999e6d9238f28c8","url":"https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:9f0d5f02d7d1c35dc742d202ba49ee4b7fe9f26bb03cd1768043cbe5fc1e817b"}
{"level":"info","ts":"2024-05-29 08:13:38.362","caller":"job/job.go:249","msg":"preheat(v2) https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:6254de9101460ea689bd3a171a4f1e5e85b54f38a73f378f59f836c4321674b5 tag: , filtered query params: , digest: , headers: map[string]string{\"Accept\":\"application/vnd.docker.image.rootfs.diff.tar.gzip\", \"Authorization\":\"Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IjdXTUE6S1ZYTzpLRjI1OjM1TkE6R0ozNTpaR0tZOlBHWVQ6STVVVDpUR1dZOlVVSTQ6UFQ3WjpYM0tXIiwidHlwIjoiSldUIn0.eyJhdWQiOiJoYXJib3ItcmVnaXN0cnkiLCJleHAiOjE3MTY5NzIyMTgsImp0aSI6IndCQXJhVEMydjRhd2lFU2siLCJpYXQiOjE3MTY5NzA0MTgsImlzcyI6ImhhcmJvci10b2tlbi1pc3N1ZXIiLCJuYmYiOjE3MTY5NzA0MTgsImFjY2VzcyI6W3sidHlwZSI6InJlcG9zaXRvcnkiLCJuYW1lIjoiaW5pdC1pbWFnZXMvYmlnZGF0YS0xMCIsImFjdGlvbnMiOlsicHVsbCJdfV19.UBm9l1XMipmsRXFjR9y0347gqHlkC8DpAocQgaqwjgEVRD-drlPOHnUIY1WHIBidcfpUCr60QKb53hSnZ__mdqb6IFDYiO4xcSeINxtSD9vYaxSAEKL2fRJxhbP1lCN556W03Dav8NxS_8ULJO2pZDzJXY7n4ICDJFWwGInf4VqgrRFz0CAm8wpf_WceAKWZwG_evZKISDRG4hSfZhQMqI2CWoOR6hHeokuK2mIBYKnq0wixbN9Oi7_6Muxh2HvFKlog5OCwyaivLCfCfziZ3jTwpC1J4r-gaizsvq3Je0neXDhuK5kNAKDO_SIPJTcoK6EipltNcr0kVFINkWEOxhq7ejs3Z1qh7elVqyXI2S9FOeuK7RVWvnkgaCt2kDA75itap0JYVjRKMopAEM5ujvStlUL66J_NF5RWuAScbw7kTh2vRAPQ9dA0hKTXzWQgtKmaP4u7UbG29TF2lx2_FAqSD9gSkMXdOX_5cUyRE3cx2glvrGq4jn6I5rUW4-cil_Ik_TGGsrsNFCZuvCFL25ssus0D2w0BjO4fWZtFQxRD7_EyrMb6HWcarCWr7OT1SEc-_WG8jWHYfegesE-erZkt8Uj033lZUmIixJt6v_8RQT5ZRWtlbLT3eTnPUd_lQZOE5rqtWaSXIXDznngaFgV4xc8DMxNkpPA5wTj1U_E\"}","taskID":"c235919131bd06e36880aefeec38535bbcf68ddcc1af68f759abb6053de95ce9","url":"https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:6254de9101460ea689bd3a171a4f1e5e85b54f38a73f378f59f836c4321674b5"}
{"level":"info","ts":"2024-05-29 08:13:38.362","caller":"job/job.go:249","msg":"preheat(v2) https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:5ba57a76386b0fe8402f1ce711b83af6ef093b831cea561015f5d5c2a1531a17 tag: , filtered query params: , digest: , headers: map[string]string{\"Accept\":\"application/vnd.docker.image.rootfs.diff.tar.gzip\", \"Authorization\":\"Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IjdXTUE6S1ZYTzpLRjI1OjM1TkE6R0ozNTpaR0tZOlBHWVQ6STVVVDpUR1dZOlVVSTQ6UFQ3WjpYM0tXIiwidHlwIjoiSldUIn0.eyJhdWQiOiJoYXJib3ItcmVnaXN0cnkiLCJleHAiOjE3MTY5NzIyMTgsImp0aSI6IndCQXJhVEMydjRhd2lFU2siLCJpYXQiOjE3MTY5NzA0MTgsImlzcyI6ImhhcmJvci10b2tlbi1pc3N1ZXIiLCJuYmYiOjE3MTY5NzA0MTgsImFjY2VzcyI6W3sidHlwZSI6InJlcG9zaXRvcnkiLCJuYW1lIjoiaW5pdC1pbWFnZXMvYmlnZGF0YS0xMCIsImFjdGlvbnMiOlsicHVsbCJdfV19.UBm9l1XMipmsRXFjR9y0347gqHlkC8DpAocQgaqwjgEVRD-drlPOHnUIY1WHIBidcfpUCr60QKb53hSnZ__mdqb6IFDYiO4xcSeINxtSD9vYaxSAEKL2fRJxhbP1lCN556W03Dav8NxS_8ULJO2pZDzJXY7n4ICDJFWwGInf4VqgrRFz0CAm8wpf_WceAKWZwG_evZKISDRG4hSfZhQMqI2CWoOR6hHeokuK2mIBYKnq0wixbN9Oi7_6Muxh2HvFKlog5OCwyaivLCfCfziZ3jTwpC1J4r-gaizsvq3Je0neXDhuK5kNAKDO_SIPJTcoK6EipltNcr0kVFINkWEOxhq7ejs3Z1qh7elVqyXI2S9FOeuK7RVWvnkgaCt2kDA75itap0JYVjRKMopAEM5ujvStlUL66J_NF5RWuAScbw7kTh2vRAPQ9dA0hKTXzWQgtKmaP4u7UbG29TF2lx2_FAqSD9gSkMXdOX_5cUyRE3cx2glvrGq4jn6I5rUW4-cil_Ik_TGGsrsNFCZuvCFL25ssus0D2w0BjO4fWZtFQxRD7_EyrMb6HWcarCWr7OT1SEc-_WG8jWHYfegesE-erZkt8Uj033lZUmIixJt6v_8RQT5ZRWtlbLT3eTnPUd_lQZOE5rqtWaSXIXDznngaFgV4xc8DMxNkpPA5wTj1U_E\"}","taskID":"86ae8d65f5716911ab27bad808f5e963e9a529ddf9dea3edcb9d73b4b9142c2b","url":"https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:5ba57a76386b0fe8402f1ce711b83af6ef093b831cea561015f5d5c2a1531a17"}
{"level":"info","ts":"2024-05-29 08:13:38.362","caller":"job/job.go:249","msg":"preheat(v2) https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:fec9938e9c9cf860b9dcb7f9cf8885d1341a70e7d89bc5305056a9b1bdf76fcf tag: , filtered query params: , digest: , headers: map[string]string{\"Accept\":\"application/vnd.docker.image.rootfs.diff.tar.gzip\", \"Authorization\":\"Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IjdXTUE6S1ZYTzpLRjI1OjM1TkE6R0ozNTpaR0tZOlBHWVQ6STVVVDpUR1dZOlVVSTQ6UFQ3WjpYM0tXIiwidHlwIjoiSldUIn0.eyJhdWQiOiJoYXJib3ItcmVnaXN0cnkiLCJleHAiOjE3MTY5NzIyMTgsImp0aSI6IndCQXJhVEMydjRhd2lFU2siLCJpYXQiOjE3MTY5NzA0MTgsImlzcyI6ImhhcmJvci10b2tlbi1pc3N1ZXIiLCJuYmYiOjE3MTY5NzA0MTgsImFjY2VzcyI6W3sidHlwZSI6InJlcG9zaXRvcnkiLCJuYW1lIjoiaW5pdC1pbWFnZXMvYmlnZGF0YS0xMCIsImFjdGlvbnMiOlsicHVsbCJdfV19.UBm9l1XMipmsRXFjR9y0347gqHlkC8DpAocQgaqwjgEVRD-drlPOHnUIY1WHIBidcfpUCr60QKb53hSnZ__mdqb6IFDYiO4xcSeINxtSD9vYaxSAEKL2fRJxhbP1lCN556W03Dav8NxS_8ULJO2pZDzJXY7n4ICDJFWwGInf4VqgrRFz0CAm8wpf_WceAKWZwG_evZKISDRG4hSfZhQMqI2CWoOR6hHeokuK2mIBYKnq0wixbN9Oi7_6Muxh2HvFKlog5OCwyaivLCfCfziZ3jTwpC1J4r-gaizsvq3Je0neXDhuK5kNAKDO_SIPJTcoK6EipltNcr0kVFINkWEOxhq7ejs3Z1qh7elVqyXI2S9FOeuK7RVWvnkgaCt2kDA75itap0JYVjRKMopAEM5ujvStlUL66J_NF5RWuAScbw7kTh2vRAPQ9dA0hKTXzWQgtKmaP4u7UbG29TF2lx2_FAqSD9gSkMXdOX_5cUyRE3cx2glvrGq4jn6I5rUW4-cil_Ik_TGGsrsNFCZuvCFL25ssus0D2w0BjO4fWZtFQxRD7_EyrMb6HWcarCWr7OT1SEc-_WG8jWHYfegesE-erZkt8Uj033lZUmIixJt6v_8RQT5ZRWtlbLT3eTnPUd_lQZOE5rqtWaSXIXDznngaFgV4xc8DMxNkpPA5wTj1U_E\"}","taskID":"f24884411f72f0d4955665b7e8ea13fec25e299a74a87c420b76681a488609f7","url":"https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:fec9938e9c9cf860b9dcb7f9cf8885d1341a70e7d89bc5305056a9b1bdf76fcf"}
{"level":"info","ts":"2024-05-29 08:13:38.362","caller":"job/job.go:249","msg":"preheat(v2) https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:de48f30650ccde3e8186cc4c7634cab55ab8c031cc108e34a91b20a8f1deec1b tag: , filtered query params: , digest: , headers: map[string]string{\"Accept\":\"application/vnd.docker.image.rootfs.diff.tar.gzip\", \"Authorization\":\"Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IjdXTUE6S1ZYTzpLRjI1OjM1TkE6R0ozNTpaR0tZOlBHWVQ6STVVVDpUR1dZOlVVSTQ6UFQ3WjpYM0tXIiwidHlwIjoiSldUIn0.eyJhdWQiOiJoYXJib3ItcmVnaXN0cnkiLCJleHAiOjE3MTY5NzIyMTgsImp0aSI6IndCQXJhVEMydjRhd2lFU2siLCJpYXQiOjE3MTY5NzA0MTgsImlzcyI6ImhhcmJvci10b2tlbi1pc3N1ZXIiLCJuYmYiOjE3MTY5NzA0MTgsImFjY2VzcyI6W3sidHlwZSI6InJlcG9zaXRvcnkiLCJuYW1lIjoiaW5pdC1pbWFnZXMvYmlnZGF0YS0xMCIsImFjdGlvbnMiOlsicHVsbCJdfV19.UBm9l1XMipmsRXFjR9y0347gqHlkC8DpAocQgaqwjgEVRD-drlPOHnUIY1WHIBidcfpUCr60QKb53hSnZ__mdqb6IFDYiO4xcSeINxtSD9vYaxSAEKL2fRJxhbP1lCN556W03Dav8NxS_8ULJO2pZDzJXY7n4ICDJFWwGInf4VqgrRFz0CAm8wpf_WceAKWZwG_evZKISDRG4hSfZhQMqI2CWoOR6hHeokuK2mIBYKnq0wixbN9Oi7_6Muxh2HvFKlog5OCwyaivLCfCfziZ3jTwpC1J4r-gaizsvq3Je0neXDhuK5kNAKDO_SIPJTcoK6EipltNcr0kVFINkWEOxhq7ejs3Z1qh7elVqyXI2S9FOeuK7RVWvnkgaCt2kDA75itap0JYVjRKMopAEM5ujvStlUL66J_NF5RWuAScbw7kTh2vRAPQ9dA0hKTXzWQgtKmaP4u7UbG29TF2lx2_FAqSD9gSkMXdOX_5cUyRE3cx2glvrGq4jn6I5rUW4-cil_Ik_TGGsrsNFCZuvCFL25ssus0D2w0BjO4fWZtFQxRD7_EyrMb6HWcarCWr7OT1SEc-_WG8jWHYfegesE-erZkt8Uj033lZUmIixJt6v_8RQT5ZRWtlbLT3eTnPUd_lQZOE5rqtWaSXIXDznngaFgV4xc8DMxNkpPA5wTj1U_E\"}","taskID":"1533c9ee8eb887a9b69470095c3d0547fa60ab10c4071dd17ed00cade829aeec","url":"https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:de48f30650ccde3e8186cc4c7634cab55ab8c031cc108e34a91b20a8f1deec1b"}
{"level":"info","ts":"2024-05-29 08:13:38.362","caller":"job/job.go:249","msg":"preheat(v2) https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:3561442fed515eec59c9770b8891462cc848e92bbe1b6887e448969bbb8caa9e tag: , filtered query params: , digest: , headers: map[string]string{\"Accept\":\"application/vnd.docker.image.rootfs.diff.tar.gzip\", \"Authorization\":\"Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IjdXTUE6S1ZYTzpLRjI1OjM1TkE6R0ozNTpaR0tZOlBHWVQ6STVVVDpUR1dZOlVVSTQ6UFQ3WjpYM0tXIiwidHlwIjoiSldUIn0.eyJhdWQiOiJoYXJib3ItcmVnaXN0cnkiLCJleHAiOjE3MTY5NzIyMTgsImp0aSI6IndCQXJhVEMydjRhd2lFU2siLCJpYXQiOjE3MTY5NzA0MTgsImlzcyI6ImhhcmJvci10b2tlbi1pc3N1ZXIiLCJuYmYiOjE3MTY5NzA0MTgsImFjY2VzcyI6W3sidHlwZSI6InJlcG9zaXRvcnkiLCJuYW1lIjoiaW5pdC1pbWFnZXMvYmlnZGF0YS0xMCIsImFjdGlvbnMiOlsicHVsbCJdfV19.UBm9l1XMipmsRXFjR9y0347gqHlkC8DpAocQgaqwjgEVRD-drlPOHnUIY1WHIBidcfpUCr60QKb53hSnZ__mdqb6IFDYiO4xcSeINxtSD9vYaxSAEKL2fRJxhbP1lCN556W03Dav8NxS_8ULJO2pZDzJXY7n4ICDJFWwGInf4VqgrRFz0CAm8wpf_WceAKWZwG_evZKISDRG4hSfZhQMqI2CWoOR6hHeokuK2mIBYKnq0wixbN9Oi7_6Muxh2HvFKlog5OCwyaivLCfCfziZ3jTwpC1J4r-gaizsvq3Je0neXDhuK5kNAKDO_SIPJTcoK6EipltNcr0kVFINkWEOxhq7ejs3Z1qh7elVqyXI2S9FOeuK7RVWvnkgaCt2kDA75itap0JYVjRKMopAEM5ujvStlUL66J_NF5RWuAScbw7kTh2vRAPQ9dA0hKTXzWQgtKmaP4u7UbG29TF2lx2_FAqSD9gSkMXdOX_5cUyRE3cx2glvrGq4jn6I5rUW4-cil_Ik_TGGsrsNFCZuvCFL25ssus0D2w0BjO4fWZtFQxRD7_EyrMb6HWcarCWr7OT1SEc-_WG8jWHYfegesE-erZkt8Uj033lZUmIixJt6v_8RQT5ZRWtlbLT3eTnPUd_lQZOE5rqtWaSXIXDznngaFgV4xc8DMxNkpPA5wTj1U_E\"}","taskID":"8df63847acd443d63f6c2eaf92aa80455081346a35f84845f54681aad7aded08","url":"https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:3561442fed515eec59c9770b8891462cc848e92bbe1b6887e448969bbb8caa9e"}
{"level":"info","ts":"2024-05-29 08:13:38.362","caller":"job/job.go:249","msg":"preheat(v2) https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:6a3c54bbefc34e610982671dce1f9cc42fc7bce7768ebd88e6b2e9f95a2c10d6 tag: , filtered query params: , digest: , headers: map[string]string{\"Accept\":\"application/vnd.docker.image.rootfs.diff.tar.gzip\", \"Authorization\":\"Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IjdXTUE6S1ZYTzpLRjI1OjM1TkE6R0ozNTpaR0tZOlBHWVQ6STVVVDpUR1dZOlVVSTQ6UFQ3WjpYM0tXIiwidHlwIjoiSldUIn0.eyJhdWQiOiJoYXJib3ItcmVnaXN0cnkiLCJleHAiOjE3MTY5NzIyMTgsImp0aSI6IndCQXJhVEMydjRhd2lFU2siLCJpYXQiOjE3MTY5NzA0MTgsImlzcyI6ImhhcmJvci10b2tlbi1pc3N1ZXIiLCJuYmYiOjE3MTY5NzA0MTgsImFjY2VzcyI6W3sidHlwZSI6InJlcG9zaXRvcnkiLCJuYW1lIjoiaW5pdC1pbWFnZXMvYmlnZGF0YS0xMCIsImFjdGlvbnMiOlsicHVsbCJdfV19.UBm9l1XMipmsRXFjR9y0347gqHlkC8DpAocQgaqwjgEVRD-drlPOHnUIY1WHIBidcfpUCr60QKb53hSnZ__mdqb6IFDYiO4xcSeINxtSD9vYaxSAEKL2fRJxhbP1lCN556W03Dav8NxS_8ULJO2pZDzJXY7n4ICDJFWwGInf4VqgrRFz0CAm8wpf_WceAKWZwG_evZKISDRG4hSfZhQMqI2CWoOR6hHeokuK2mIBYKnq0wixbN9Oi7_6Muxh2HvFKlog5OCwyaivLCfCfziZ3jTwpC1J4r-gaizsvq3Je0neXDhuK5kNAKDO_SIPJTcoK6EipltNcr0kVFINkWEOxhq7ejs3Z1qh7elVqyXI2S9FOeuK7RVWvnkgaCt2kDA75itap0JYVjRKMopAEM5ujvStlUL66J_NF5RWuAScbw7kTh2vRAPQ9dA0hKTXzWQgtKmaP4u7UbG29TF2lx2_FAqSD9gSkMXdOX_5cUyRE3cx2glvrGq4jn6I5rUW4-cil_Ik_TGGsrsNFCZuvCFL25ssus0D2w0BjO4fWZtFQxRD7_EyrMb6HWcarCWr7OT1SEc-_WG8jWHYfegesE-erZkt8Uj033lZUmIixJt6v_8RQT5ZRWtlbLT3eTnPUd_lQZOE5rqtWaSXIXDznngaFgV4xc8DMxNkpPA5wTj1U_E\"}","taskID":"55aece5aab752209ed36b5bfcf20171c8082aaf850831911e01b4ac8729b0e16","url":"https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:6a3c54bbefc34e610982671dce1f9cc42fc7bce7768ebd88e6b2e9f95a2c10d6"}
{"level":"info","ts":"2024-05-29 08:13:38.363","caller":"job/job.go:249","msg":"preheat(v2) https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:4445ea2ce25d955765d7daeb03314106c52fe845df9bdf41c20a58fede61d7f1 tag: , filtered query params: , digest: , headers: map[string]string{\"Accept\":\"application/vnd.docker.container.image.v1+json\", \"Authorization\":\"Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IjdXTUE6S1ZYTzpLRjI1OjM1TkE6R0ozNTpaR0tZOlBHWVQ6STVVVDpUR1dZOlVVSTQ6UFQ3WjpYM0tXIiwidHlwIjoiSldUIn0.eyJhdWQiOiJoYXJib3ItcmVnaXN0cnkiLCJleHAiOjE3MTY5NzIyMTgsImp0aSI6IndCQXJhVEMydjRhd2lFU2siLCJpYXQiOjE3MTY5NzA0MTgsImlzcyI6ImhhcmJvci10b2tlbi1pc3N1ZXIiLCJuYmYiOjE3MTY5NzA0MTgsImFjY2VzcyI6W3sidHlwZSI6InJlcG9zaXRvcnkiLCJuYW1lIjoiaW5pdC1pbWFnZXMvYmlnZGF0YS0xMCIsImFjdGlvbnMiOlsicHVsbCJdfV19.UBm9l1XMipmsRXFjR9y0347gqHlkC8DpAocQgaqwjgEVRD-drlPOHnUIY1WHIBidcfpUCr60QKb53hSnZ__mdqb6IFDYiO4xcSeINxtSD9vYaxSAEKL2fRJxhbP1lCN556W03Dav8NxS_8ULJO2pZDzJXY7n4ICDJFWwGInf4VqgrRFz0CAm8wpf_WceAKWZwG_evZKISDRG4hSfZhQMqI2CWoOR6hHeokuK2mIBYKnq0wixbN9Oi7_6Muxh2HvFKlog5OCwyaivLCfCfziZ3jTwpC1J4r-gaizsvq3Je0neXDhuK5kNAKDO_SIPJTcoK6EipltNcr0kVFINkWEOxhq7ejs3Z1qh7elVqyXI2S9FOeuK7RVWvnkgaCt2kDA75itap0JYVjRKMopAEM5ujvStlUL66J_NF5RWuAScbw7kTh2vRAPQ9dA0hKTXzWQgtKmaP4u7UbG29TF2lx2_FAqSD9gSkMXdOX_5cUyRE3cx2glvrGq4jn6I5rUW4-cil_Ik_TGGsrsNFCZuvCFL25ssus0D2w0BjO4fWZtFQxRD7_EyrMb6HWcarCWr7OT1SEc-_WG8jWHYfegesE-erZkt8Uj033lZUmIixJt6v_8RQT5ZRWtlbLT3eTnPUd_lQZOE5rqtWaSXIXDznngaFgV4xc8DMxNkpPA5wTj1U_E\"}","taskID":"2b3b56710939d5ad0186cae0cd14a8bc9b6114e0afff6a4f1b8056a9ec444466","url":"https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:4445ea2ce25d955765d7daeb03314106c52fe845df9bdf41c20a58fede61d7f1"}
{"level":"error","ts":"2024-05-29 08:13:38.363","caller":"job/job.go:278","msg":"preheat(v2) https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:18e7ff17db9d6afa1446adc4cdc56503ab6eead8549322304c33141fbe83de7d recive piece failed: rpc error: code = Unimplemented desc = unknown service dfdaemon.v2.DfdaemonUpload","taskID":"dba2d1ee4566c39eef8bb5346c5c70ca8c8b4213c08c37a982dfcb238b13f936","url":"https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:18e7ff17db9d6afa1446adc4cdc56503ab6eead8549322304c33141fbe83de7d","stacktrace":"d7y.io/dragonfly/v2/scheduler/job.(*job).preheatV2\n\t/go/src/d7y.io/dragonfly/v2/scheduler/job/job.go:278\nd7y.io/dragonfly/v2/scheduler/job.(*job).preheat\n\t/go/src/d7y.io/dragonfly/v2/scheduler/job/job.go:183\nreflect.Value.call\n\t/usr/local/go/src/reflect/value.go:596\nreflect.Value.Call\n\t/usr/local/go/src/reflect/value.go:380\ngithub.com/RichardKnop/machinery/v1/tasks.(*Task).Call\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/tasks/task.go:142\ngithub.com/RichardKnop/machinery/v1.(*Worker).Process\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/worker.go:182\ngithub.com/RichardKnop/machinery/v1/brokers/redis.(*Broker).consumeOne\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/brokers/redis/redis.go:349\ngithub.com/RichardKnop/machinery/v1/brokers/redis.(*Broker).consume.func2\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/brokers/redis/redis.go:312"}
{"level":"error","ts":"2024-05-29 08:13:38.363","caller":"job/job.go:184","msg":"preheat https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:18e7ff17db9d6afa1446adc4cdc56503ab6eead8549322304c33141fbe83de7d failed: rpc error: code = Unimplemented desc = unknown service dfdaemon.v2.DfdaemonUpload","stacktrace":"d7y.io/dragonfly/v2/scheduler/job.(*job).preheat\n\t/go/src/d7y.io/dragonfly/v2/scheduler/job/job.go:184\nreflect.Value.call\n\t/usr/local/go/src/reflect/value.go:596\nreflect.Value.Call\n\t/usr/local/go/src/reflect/value.go:380\ngithub.com/RichardKnop/machinery/v1/tasks.(*Task).Call\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/tasks/task.go:142\ngithub.com/RichardKnop/machinery/v1.(*Worker).Process\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/worker.go:182\ngithub.com/RichardKnop/machinery/v1/brokers/redis.(*Broker).consumeOne\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/brokers/redis/redis.go:349\ngithub.com/RichardKnop/machinery/v1/brokers/redis.(*Broker).consume.func2\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/brokers/redis/redis.go:312"}
{"level":"error","ts":"2024-05-29 08:13:38.363","caller":"job/job.go:278","msg":"preheat(v2) https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:f38403c80edca2edf058a023893e1d649c8538180916aac6aa0842b25dd845ec recive piece failed: rpc error: code = Unimplemented desc = unknown service dfdaemon.v2.DfdaemonUpload","taskID":"a1a77c48a1ba90382d7edae996d03b7d022bac7727fcd1a9d674469d3e85bff6","url":"https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:f38403c80edca2edf058a023893e1d649c8538180916aac6aa0842b25dd845ec","stacktrace":"d7y.io/dragonfly/v2/scheduler/job.(*job).preheatV2\n\t/go/src/d7y.io/dragonfly/v2/scheduler/job/job.go:278\nd7y.io/dragonfly/v2/scheduler/job.(*job).preheat\n\t/go/src/d7y.io/dragonfly/v2/scheduler/job/job.go:183\nreflect.Value.call\n\t/usr/local/go/src/reflect/value.go:596\nreflect.Value.Call\n\t/usr/local/go/src/reflect/value.go:380\ngithub.com/RichardKnop/machinery/v1/tasks.(*Task).Call\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/tasks/task.go:142\ngithub.com/RichardKnop/machinery/v1.(*Worker).Process\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/worker.go:182\ngithub.com/RichardKnop/machinery/v1/brokers/redis.(*Broker).consumeOne\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/brokers/redis/redis.go:349\ngithub.com/RichardKnop/machinery/v1/brokers/redis.(*Broker).consume.func2\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/brokers/redis/redis.go:312"}
{"level":"error","ts":"2024-05-29 08:13:38.363","caller":"job/job.go:278","msg":"preheat(v2) https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:7f76cf5961f2c6bca667702008cb73bd980d11f68cabf61c0f4713e98421b3c6 recive piece failed: rpc error: code = Unimplemented desc = unknown service dfdaemon.v2.DfdaemonUpload","taskID":"76cf590438480c1687db83b3a92d47855fb6e9ff47bd951ad92a2ca8426b54d8","url":"https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:7f76cf5961f2c6bca667702008cb73bd980d11f68cabf61c0f4713e98421b3c6","stacktrace":"d7y.io/dragonfly/v2/scheduler/job.(*job).preheatV2\n\t/go/src/d7y.io/dragonfly/v2/scheduler/job/job.go:278\nd7y.io/dragonfly/v2/scheduler/job.(*job).preheat\n\t/go/src/d7y.io/dragonfly/v2/scheduler/job/job.go:183\nreflect.Value.call\n\t/usr/local/go/src/reflect/value.go:596\nreflect.Value.Call\n\t/usr/local/go/src/reflect/value.go:380\ngithub.com/RichardKnop/machinery/v1/tasks.(*Task).Call\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/tasks/task.go:142\ngithub.com/RichardKnop/machinery/v1.(*Worker).Process\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/worker.go:182\ngithub.com/RichardKnop/machinery/v1/brokers/redis.(*Broker).consumeOne\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/brokers/redis/redis.go:349\ngithub.com/RichardKnop/machinery/v1/brokers/redis.(*Broker).consume.func2\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/brokers/redis/redis.go:312"}
{"level":"info","ts":"2024-05-29 08:13:38.363","caller":"job/job.go:216","msg":"preheat(v1) https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:18e7ff17db9d6afa1446adc4cdc56503ab6eead8549322304c33141fbe83de7d tag: , filtered query params: , digest: , headers: map[string]string{\"Accept\":\"application/vnd.docker.image.rootfs.diff.tar.gzip\", \"Authorization\":\"Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IjdXTUE6S1ZYTzpLRjI1OjM1TkE6R0ozNTpaR0tZOlBHWVQ6STVVVDpUR1dZOlVVSTQ6UFQ3WjpYM0tXIiwidHlwIjoiSldUIn0.eyJhdWQiOiJoYXJib3ItcmVnaXN0cnkiLCJleHAiOjE3MTY5NzIyMTgsImp0aSI6IndCQXJhVEMydjRhd2lFU2siLCJpYXQiOjE3MTY5NzA0MTgsImlzcyI6ImhhcmJvci10b2tlbi1pc3N1ZXIiLCJuYmYiOjE3MTY5NzA0MTgsImFjY2VzcyI6W3sidHlwZSI6InJlcG9zaXRvcnkiLCJuYW1lIjoiaW5pdC1pbWFnZXMvYmlnZGF0YS0xMCIsImFjdGlvbnMiOlsicHVsbCJdfV19.UBm9l1XMipmsRXFjR9y0347gqHlkC8DpAocQgaqwjgEVRD-drlPOHnUIY1WHIBidcfpUCr60QKb53hSnZ__mdqb6IFDYiO4xcSeINxtSD9vYaxSAEKL2fRJxhbP1lCN556W03Dav8NxS_8ULJO2pZDzJXY7n4ICDJFWwGInf4VqgrRFz0CAm8wpf_WceAKWZwG_evZKISDRG4hSfZhQMqI2CWoOR6hHeokuK2mIBYKnq0wixbN9Oi7_6Muxh2HvFKlog5OCwyaivLCfCfziZ3jTwpC1J4r-gaizsvq3Je0neXDhuK5kNAKDO_SIPJTcoK6EipltNcr0kVFINkWEOxhq7ejs3Z1qh7elVqyXI2S9FOeuK7RVWvnkgaCt2kDA75itap0JYVjRKMopAEM5ujvStlUL66J_NF5RWuAScbw7kTh2vRAPQ9dA0hKTXzWQgtKmaP4u7UbG29TF2lx2_FAqSD9gSkMXdOX_5cUyRE3cx2glvrGq4jn6I5rUW4-cil_Ik_TGGsrsNFCZuvCFL25ssus0D2w0BjO4fWZtFQxRD7_EyrMb6HWcarCWr7OT1SEc-_WG8jWHYfegesE-erZkt8Uj033lZUmIixJt6v_8RQT5ZRWtlbLT3eTnPUd_lQZOE5rqtWaSXIXDznngaFgV4xc8DMxNkpPA5wTj1U_E\"}","taskID":"c6ed1f62d8990ac98b27010c3155f29552512a04cf309950330d4ea7747b95b1","url":"https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:18e7ff17db9d6afa1446adc4cdc56503ab6eead8549322304c33141fbe83de7d"}
{"level":"error","ts":"2024-05-29 08:13:38.363","caller":"job/job.go:278","msg":"preheat(v2) https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:5ba57a76386b0fe8402f1ce711b83af6ef093b831cea561015f5d5c2a1531a17 recive piece failed: rpc error: code = Unimplemented desc = unknown service dfdaemon.v2.DfdaemonUpload","taskID":"86ae8d65f5716911ab27bad808f5e963e9a529ddf9dea3edcb9d73b4b9142c2b","url":"https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:5ba57a76386b0fe8402f1ce711b83af6ef093b831cea561015f5d5c2a1531a17","stacktrace":"d7y.io/dragonfly/v2/scheduler/job.(*job).preheatV2\n\t/go/src/d7y.io/dragonfly/v2/scheduler/job/job.go:278\nd7y.io/dragonfly/v2/scheduler/job.(*job).preheat\n\t/go/src/d7y.io/dragonfly/v2/scheduler/job/job.go:183\nreflect.Value.call\n\t/usr/local/go/src/reflect/value.go:596\nreflect.Value.Call\n\t/usr/local/go/src/reflect/value.go:380\ngithub.com/RichardKnop/machinery/v1/tasks.(*Task).Call\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/tasks/task.go:142\ngithub.com/RichardKnop/machinery/v1.(*Worker).Process\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/worker.go:182\ngithub.com/RichardKnop/machinery/v1/brokers/redis.(*Broker).consumeOne\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/brokers/redis/redis.go:349\ngithub.com/RichardKnop/machinery/v1/brokers/redis.(*Broker).consume.func2\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/brokers/redis/redis.go:312"}
{"level":"error","ts":"2024-05-29 08:13:38.363","caller":"job/job.go:278","msg":"preheat(v2) https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:6a3c54bbefc34e610982671dce1f9cc42fc7bce7768ebd88e6b2e9f95a2c10d6 recive piece failed: rpc error: code = Unimplemented desc = unknown service dfdaemon.v2.DfdaemonUpload","taskID":"55aece5aab752209ed36b5bfcf20171c8082aaf850831911e01b4ac8729b0e16","url":"https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:6a3c54bbefc34e610982671dce1f9cc42fc7bce7768ebd88e6b2e9f95a2c10d6","stacktrace":"d7y.io/dragonfly/v2/scheduler/job.(*job).preheatV2\n\t/go/src/d7y.io/dragonfly/v2/scheduler/job/job.go:278\nd7y.io/dragonfly/v2/scheduler/job.(*job).preheat\n\t/go/src/d7y.io/dragonfly/v2/scheduler/job/job.go:183\nreflect.Value.call\n\t/usr/local/go/src/reflect/value.go:596\nreflect.Value.Call\n\t/usr/local/go/src/reflect/value.go:380\ngithub.com/RichardKnop/machinery/v1/tasks.(*Task).Call\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/tasks/task.go:142\ngithub.com/RichardKnop/machinery/v1.(*Worker).Process\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/worker.go:182\ngithub.com/RichardKnop/machinery/v1/brokers/redis.(*Broker).consumeOne\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/brokers/redis/redis.go:349\ngithub.com/RichardKnop/machinery/v1/brokers/redis.(*Broker).consume.func2\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/brokers/redis/redis.go:312"}
{"level":"error","ts":"2024-05-29 08:13:38.363","caller":"job/job.go:184","msg":"preheat https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:5ba57a76386b0fe8402f1ce711b83af6ef093b831cea561015f5d5c2a1531a17 failed: rpc error: code = Unimplemented desc = unknown service dfdaemon.v2.DfdaemonUpload","stacktrace":"d7y.io/dragonfly/v2/scheduler/job.(*job).preheat\n\t/go/src/d7y.io/dragonfly/v2/scheduler/job/job.go:184\nreflect.Value.call\n\t/usr/local/go/src/reflect/value.go:596\nreflect.Value.Call\n\t/usr/local/go/src/reflect/value.go:380\ngithub.com/RichardKnop/machinery/v1/tasks.(*Task).Call\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/tasks/task.go:142\ngithub.com/RichardKnop/machinery/v1.(*Worker).Process\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/worker.go:182\ngithub.com/RichardKnop/machinery/v1/brokers/redis.(*Broker).consumeOne\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/brokers/redis/redis.go:349\ngithub.com/RichardKnop/machinery/v1/brokers/redis.(*Broker).consume.func2\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/brokers/redis/redis.go:312"}
{"level":"error","ts":"2024-05-29 08:13:38.363","caller":"job/job.go:278","msg":"preheat(v2) https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:4445ea2ce25d955765d7daeb03314106c52fe845df9bdf41c20a58fede61d7f1 recive piece failed: rpc error: code = Unimplemented desc = unknown service dfdaemon.v2.DfdaemonUpload","taskID":"2b3b56710939d5ad0186cae0cd14a8bc9b6114e0afff6a4f1b8056a9ec444466","url":"https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:4445ea2ce25d955765d7daeb03314106c52fe845df9bdf41c20a58fede61d7f1","stacktrace":"d7y.io/dragonfly/v2/scheduler/job.(*job).preheatV2\n\t/go/src/d7y.io/dragonfly/v2/scheduler/job/job.go:278\nd7y.io/dragonfly/v2/scheduler/job.(*job).preheat\n\t/go/src/d7y.io/dragonfly/v2/scheduler/job/job.go:183\nreflect.Value.call\n\t/usr/local/go/src/reflect/value.go:596\nreflect.Value.Call\n\t/usr/local/go/src/reflect/value.go:380\ngithub.com/RichardKnop/machinery/v1/tasks.(*Task).Call\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/tasks/task.go:142\ngithub.com/RichardKnop/machinery/v1.(*Worker).Process\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/worker.go:182\ngithub.com/RichardKnop/machinery/v1/brokers/redis.(*Broker).consumeOne\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/brokers/redis/redis.go:349\ngithub.com/RichardKnop/machinery/v1/brokers/redis.(*Broker).consume.func2\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/brokers/redis/redis.go:312"}
{"level":"error","ts":"2024-05-29 08:13:38.363","caller":"job/job.go:278","msg":"preheat(v2) https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:3561442fed515eec59c9770b8891462cc848e92bbe1b6887e448969bbb8caa9e recive piece failed: rpc error: code = Unimplemented desc = unknown service dfdaemon.v2.DfdaemonUpload","taskID":"8df63847acd443d63f6c2eaf92aa80455081346a35f84845f54681aad7aded08","url":"https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:3561442fed515eec59c9770b8891462cc848e92bbe1b6887e448969bbb8caa9e","stacktrace":"d7y.io/dragonfly/v2/scheduler/job.(*job).preheatV2\n\t/go/src/d7y.io/dragonfly/v2/scheduler/job/job.go:278\nd7y.io/dragonfly/v2/scheduler/job.(*job).preheat\n\t/go/src/d7y.io/dragonfly/v2/scheduler/job/job.go:183\nreflect.Value.call\n\t/usr/local/go/src/reflect/value.go:596\nreflect.Value.Call\n\t/usr/local/go/src/reflect/value.go:380\ngithub.com/RichardKnop/machinery/v1/tasks.(*Task).Call\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/tasks/task.go:142\ngithub.com/RichardKnop/machinery/v1.(*Worker).Process\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/worker.go:182\ngithub.com/RichardKnop/machinery/v1/brokers/redis.(*Broker).consumeOne\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/brokers/redis/redis.go:349\ngithub.com/RichardKnop/machinery/v1/brokers/redis.(*Broker).consume.func2\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/brokers/redis/redis.go:312"}
{"level":"info","ts":"2024-05-29 08:13:38.363","caller":"job/job.go:216","msg":"preheat(v1) https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:5ba57a76386b0fe8402f1ce711b83af6ef093b831cea561015f5d5c2a1531a17 tag: , filtered query params: , digest: , headers: map[string]string{\"Accept\":\"application/vnd.docker.image.rootfs.diff.tar.gzip\", \"Authorization\":\"Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IjdXTUE6S1ZYTzpLRjI1OjM1TkE6R0ozNTpaR0tZOlBHWVQ6STVVVDpUR1dZOlVVSTQ6UFQ3WjpYM0tXIiwidHlwIjoiSldUIn0.eyJhdWQiOiJoYXJib3ItcmVnaXN0cnkiLCJleHAiOjE3MTY5NzIyMTgsImp0aSI6IndCQXJhVEMydjRhd2lFU2siLCJpYXQiOjE3MTY5NzA0MTgsImlzcyI6ImhhcmJvci10b2tlbi1pc3N1ZXIiLCJuYmYiOjE3MTY5NzA0MTgsImFjY2VzcyI6W3sidHlwZSI6InJlcG9zaXRvcnkiLCJuYW1lIjoiaW5pdC1pbWFnZXMvYmlnZGF0YS0xMCIsImFjdGlvbnMiOlsicHVsbCJdfV19.UBm9l1XMipmsRXFjR9y0347gqHlkC8DpAocQgaqwjgEVRD-drlPOHnUIY1WHIBidcfpUCr60QKb53hSnZ__mdqb6IFDYiO4xcSeINxtSD9vYaxSAEKL2fRJxhbP1lCN556W03Dav8NxS_8ULJO2pZDzJXY7n4ICDJFWwGInf4VqgrRFz0CAm8wpf_WceAKWZwG_evZKISDRG4hSfZhQMqI2CWoOR6hHeokuK2mIBYKnq0wixbN9Oi7_6Muxh2HvFKlog5OCwyaivLCfCfziZ3jTwpC1J4r-gaizsvq3Je0neXDhuK5kNAKDO_SIPJTcoK6EipltNcr0kVFINkWEOxhq7ejs3Z1qh7elVqyXI2S9FOeuK7RVWvnkgaCt2kDA75itap0JYVjRKMopAEM5ujvStlUL66J_NF5RWuAScbw7kTh2vRAPQ9dA0hKTXzWQgtKmaP4u7UbG29TF2lx2_FAqSD9gSkMXdOX_5cUyRE3cx2glvrGq4jn6I5rUW4-cil_Ik_TGGsrsNFCZuvCFL25ssus0D2w0BjO4fWZtFQxRD7_EyrMb6HWcarCWr7OT1SEc-_WG8jWHYfegesE-erZkt8Uj033lZUmIixJt6v_8RQT5ZRWtlbLT3eTnPUd_lQZOE5rqtWaSXIXDznngaFgV4xc8DMxNkpPA5wTj1U_E\"}","taskID":"a40bc6de3c414d6e82701c62c2df66187ba86d048af8bab03660411d4e431c5a","url":"https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:5ba57a76386b0fe8402f1ce711b83af6ef093b831cea561015f5d5c2a1531a17"}
{"level":"error","ts":"2024-05-29 08:13:38.363","caller":"job/job.go:184","msg":"preheat https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:4445ea2ce25d955765d7daeb03314106c52fe845df9bdf41c20a58fede61d7f1 failed: rpc error: code = Unimplemented desc = unknown service dfdaemon.v2.DfdaemonUpload","stacktrace":"d7y.io/dragonfly/v2/scheduler/job.(*job).preheat\n\t/go/src/d7y.io/dragonfly/v2/scheduler/job/job.go:184\nreflect.Value.call\n\t/usr/local/go/src/reflect/value.go:596\nreflect.Value.Call\n\t/usr/local/go/src/reflect/value.go:380\ngithub.com/RichardKnop/machinery/v1/tasks.(*Task).Call\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/tasks/task.go:142\ngithub.com/RichardKnop/machinery/v1.(*Worker).Process\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/worker.go:182\ngithub.com/RichardKnop/machinery/v1/brokers/redis.(*Broker).consumeOne\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/brokers/redis/redis.go:349\ngithub.com/RichardKnop/machinery/v1/brokers/redis.(*Broker).consume.func2\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/brokers/redis/redis.go:312"}
{"level":"error","ts":"2024-05-29 08:13:38.363","caller":"job/job.go:184","msg":"preheat https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:3561442fed515eec59c9770b8891462cc848e92bbe1b6887e448969bbb8caa9e failed: rpc error: code = Unimplemented desc = unknown service dfdaemon.v2.DfdaemonUpload","stacktrace":"d7y.io/dragonfly/v2/scheduler/job.(*job).preheat\n\t/go/src/d7y.io/dragonfly/v2/scheduler/job/job.go:184\nreflect.Value.call\n\t/usr/local/go/src/reflect/value.go:596\nreflect.Value.Call\n\t/usr/local/go/src/reflect/value.go:380\ngithub.com/RichardKnop/machinery/v1/tasks.(*Task).Call\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/tasks/task.go:142\ngithub.com/RichardKnop/machinery/v1.(*Worker).Process\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/worker.go:182\ngithub.com/RichardKnop/machinery/v1/brokers/redis.(*Broker).consumeOne\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/brokers/redis/redis.go:349\ngithub.com/RichardKnop/machinery/v1/brokers/redis.(*Broker).consume.func2\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/brokers/redis/redis.go:312"}
{"level":"error","ts":"2024-05-29 08:13:38.363","caller":"job/job.go:278","msg":"preheat(v2) https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:ca3cd42a7c9525f6ce3d64c1a70982613a8235f0cc057ec9244052921853ef15 recive piece failed: rpc error: code = Unimplemented desc = unknown service dfdaemon.v2.DfdaemonUpload","taskID":"6835f6e5125bf596f79aa6bb3b5b2059c44f699f3d7c1f0b3f308bdef8bf9a05","url":"https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:ca3cd42a7c9525f6ce3d64c1a70982613a8235f0cc057ec9244052921853ef15","stacktrace":"d7y.io/dragonfly/v2/scheduler/job.(*job).preheatV2\n\t/go/src/d7y.io/dragonfly/v2/scheduler/job/job.go:278\nd7y.io/dragonfly/v2/scheduler/job.(*job).preheat\n\t/go/src/d7y.io/dragonfly/v2/scheduler/job/job.go:183\nreflect.Value.call\n\t/usr/local/go/src/reflect/value.go:596\nreflect.Value.Call\n\t/usr/local/go/src/reflect/value.go:380\ngithub.com/RichardKnop/machinery/v1/tasks.(*Task).Call\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/tasks/task.go:142\ngithub.com/RichardKnop/machinery/v1.(*Worker).Process\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/worker.go:182\ngithub.com/RichardKnop/machinery/v1/brokers/redis.(*Broker).consumeOne\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/brokers/redis/redis.go:349\ngithub.com/RichardKnop/machinery/v1/brokers/redis.(*Broker).consume.func2\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/brokers/redis/redis.go:312"}
{"level":"info","ts":"2024-05-29 08:13:38.363","caller":"job/job.go:216","msg":"preheat(v1) https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:3561442fed515eec59c9770b8891462cc848e92bbe1b6887e448969bbb8caa9e tag: , filtered query params: , digest: , headers: map[string]string{\"Accept\":\"application/vnd.docker.image.rootfs.diff.tar.gzip\", \"Authorization\":\"Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IjdXTUE6S1ZYTzpLRjI1OjM1TkE6R0ozNTpaR0tZOlBHWVQ6STVVVDpUR1dZOlVVSTQ6UFQ3WjpYM0tXIiwidHlwIjoiSldUIn0.eyJhdWQiOiJoYXJib3ItcmVnaXN0cnkiLCJleHAiOjE3MTY5NzIyMTgsImp0aSI6IndCQXJhVEMydjRhd2lFU2siLCJpYXQiOjE3MTY5NzA0MTgsImlzcyI6ImhhcmJvci10b2tlbi1pc3N1ZXIiLCJuYmYiOjE3MTY5NzA0MTgsImFjY2VzcyI6W3sidHlwZSI6InJlcG9zaXRvcnkiLCJuYW1lIjoiaW5pdC1pbWFnZXMvYmlnZGF0YS0xMCIsImFjdGlvbnMiOlsicHVsbCJdfV19.UBm9l1XMipmsRXFjR9y0347gqHlkC8DpAocQgaqwjgEVRD-drlPOHnUIY1WHIBidcfpUCr60QKb53hSnZ__mdqb6IFDYiO4xcSeINxtSD9vYaxSAEKL2fRJxhbP1lCN556W03Dav8NxS_8ULJO2pZDzJXY7n4ICDJFWwGInf4VqgrRFz0CAm8wpf_WceAKWZwG_evZKISDRG4hSfZhQMqI2CWoOR6hHeokuK2mIBYKnq0wixbN9Oi7_6Muxh2HvFKlog5OCwyaivLCfCfziZ3jTwpC1J4r-gaizsvq3Je0neXDhuK5kNAKDO_SIPJTcoK6EipltNcr0kVFINkWEOxhq7ejs3Z1qh7elVqyXI2S9FOeuK7RVWvnkgaCt2kDA75itap0JYVjRKMopAEM5ujvStlUL66J_NF5RWuAScbw7kTh2vRAPQ9dA0hKTXzWQgtKmaP4u7UbG29TF2lx2_FAqSD9gSkMXdOX_5cUyRE3cx2glvrGq4jn6I5rUW4-cil_Ik_TGGsrsNFCZuvCFL25ssus0D2w0BjO4fWZtFQxRD7_EyrMb6HWcarCWr7OT1SEc-_WG8jWHYfegesE-erZkt8Uj033lZUmIixJt6v_8RQT5ZRWtlbLT3eTnPUd_lQZOE5rqtWaSXIXDznngaFgV4xc8DMxNkpPA5wTj1U_E\"}","taskID":"5dec570990b5ae12d1f417af02d25673992f0e0bdd8b281f18893daeb1d2b3b7","url":"https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:3561442fed515eec59c9770b8891462cc848e92bbe1b6887e448969bbb8caa9e"}
{"level":"error","ts":"2024-05-29 08:13:38.363","caller":"job/job.go:184","msg":"preheat https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:ca3cd42a7c9525f6ce3d64c1a70982613a8235f0cc057ec9244052921853ef15 failed: rpc error: code = Unimplemented desc = unknown service dfdaemon.v2.DfdaemonUpload","stacktrace":"d7y.io/dragonfly/v2/scheduler/job.(*job).preheat\n\t/go/src/d7y.io/dragonfly/v2/scheduler/job/job.go:184\nreflect.Value.call\n\t/usr/local/go/src/reflect/value.go:596\nreflect.Value.Call\n\t/usr/local/go/src/reflect/value.go:380\ngithub.com/RichardKnop/machinery/v1/tasks.(*Task).Call\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/tasks/task.go:142\ngithub.com/RichardKnop/machinery/v1.(*Worker).Process\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/worker.go:182\ngithub.com/RichardKnop/machinery/v1/brokers/redis.(*Broker).consumeOne\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/brokers/redis/redis.go:349\ngithub.com/RichardKnop/machinery/v1/brokers/redis.(*Broker).consume.func2\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/brokers/redis/redis.go:312"}
{"level":"error","ts":"2024-05-29 08:13:38.363","caller":"job/job.go:184","msg":"preheat https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:6a3c54bbefc34e610982671dce1f9cc42fc7bce7768ebd88e6b2e9f95a2c10d6 failed: rpc error: code = Unimplemented desc = unknown service dfdaemon.v2.DfdaemonUpload","stacktrace":"d7y.io/dragonfly/v2/scheduler/job.(*job).preheat\n\t/go/src/d7y.io/dragonfly/v2/scheduler/job/job.go:184\nreflect.Value.call\n\t/usr/local/go/src/reflect/value.go:596\nreflect.Value.Call\n\t/usr/local/go/src/reflect/value.go:380\ngithub.com/RichardKnop/machinery/v1/tasks.(*Task).Call\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/tasks/task.go:142\ngithub.com/RichardKnop/machinery/v1.(*Worker).Process\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/worker.go:182\ngithub.com/RichardKnop/machinery/v1/brokers/redis.(*Broker).consumeOne\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/brokers/redis/redis.go:349\ngithub.com/RichardKnop/machinery/v1/brokers/redis.(*Broker).consume.func2\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/brokers/redis/redis.go:312"}
{"level":"error","ts":"2024-05-29 08:13:38.363","caller":"job/job.go:278","msg":"preheat(v2) https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:6254de9101460ea689bd3a171a4f1e5e85b54f38a73f378f59f836c4321674b5 recive piece failed: rpc error: code = Unimplemented desc = unknown service dfdaemon.v2.DfdaemonUpload","taskID":"c235919131bd06e36880aefeec38535bbcf68ddcc1af68f759abb6053de95ce9","url":"https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:6254de9101460ea689bd3a171a4f1e5e85b54f38a73f378f59f836c4321674b5","stacktrace":"d7y.io/dragonfly/v2/scheduler/job.(*job).preheatV2\n\t/go/src/d7y.io/dragonfly/v2/scheduler/job/job.go:278\nd7y.io/dragonfly/v2/scheduler/job.(*job).preheat\n\t/go/src/d7y.io/dragonfly/v2/scheduler/job/job.go:183\nreflect.Value.call\n\t/usr/local/go/src/reflect/value.go:596\nreflect.Value.Call\n\t/usr/local/go/src/reflect/value.go:380\ngithub.com/RichardKnop/machinery/v1/tasks.(*Task).Call\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/tasks/task.go:142\ngithub.com/RichardKnop/machinery/v1.(*Worker).Process\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/worker.go:182\ngithub.com/RichardKnop/machinery/v1/brokers/redis.(*Broker).consumeOne\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/brokers/redis/redis.go:349\ngithub.com/RichardKnop/machinery/v1/brokers/redis.(*Broker).consume.func2\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/brokers/redis/redis.go:312"}
{"level":"error","ts":"2024-05-29 08:13:38.363","caller":"job/job.go:184","msg":"preheat https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:6254de9101460ea689bd3a171a4f1e5e85b54f38a73f378f59f836c4321674b5 failed: rpc error: code = Unimplemented desc = unknown service dfdaemon.v2.DfdaemonUpload","stacktrace":"d7y.io/dragonfly/v2/scheduler/job.(*job).preheat\n\t/go/src/d7y.io/dragonfly/v2/scheduler/job/job.go:184\nreflect.Value.call\n\t/usr/local/go/src/reflect/value.go:596\nreflect.Value.Call\n\t/usr/local/go/src/reflect/value.go:380\ngithub.com/RichardKnop/machinery/v1/tasks.(*Task).Call\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/tasks/task.go:142\ngithub.com/RichardKnop/machinery/v1.(*Worker).Process\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/worker.go:182\ngithub.com/RichardKnop/machinery/v1/brokers/redis.(*Broker).consumeOne\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/brokers/redis/redis.go:349\ngithub.com/RichardKnop/machinery/v1/brokers/redis.(*Broker).consume.func2\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/brokers/redis/redis.go:312"}
{"level":"error","ts":"2024-05-29 08:13:38.363","caller":"job/job.go:184","msg":"preheat https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:7f76cf5961f2c6bca667702008cb73bd980d11f68cabf61c0f4713e98421b3c6 failed: rpc error: code = Unimplemented desc = unknown service dfdaemon.v2.DfdaemonUpload","stacktrace":"d7y.io/dragonfly/v2/scheduler/job.(*job).preheat\n\t/go/src/d7y.io/dragonfly/v2/scheduler/job/job.go:184\nreflect.Value.call\n\t/usr/local/go/src/reflect/value.go:596\nreflect.Value.Call\n\t/usr/local/go/src/reflect/value.go:380\ngithub.com/RichardKnop/machinery/v1/tasks.(*Task).Call\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/tasks/task.go:142\ngithub.com/RichardKnop/machinery/v1.(*Worker).Process\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/worker.go:182\ngithub.com/RichardKnop/machinery/v1/brokers/redis.(*Broker).consumeOne\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/brokers/redis/redis.go:349\ngithub.com/RichardKnop/machinery/v1/brokers/redis.(*Broker).consume.func2\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/brokers/redis/redis.go:312"}
{"level":"info","ts":"2024-05-29 08:13:38.363","caller":"job/job.go:216","msg":"preheat(v1) https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:6254de9101460ea689bd3a171a4f1e5e85b54f38a73f378f59f836c4321674b5 tag: , filtered query params: , digest: , headers: map[string]string{\"Accept\":\"application/vnd.docker.image.rootfs.diff.tar.gzip\", \"Authorization\":\"Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IjdXTUE6S1ZYTzpLRjI1OjM1TkE6R0ozNTpaR0tZOlBHWVQ6STVVVDpUR1dZOlVVSTQ6UFQ3WjpYM0tXIiwidHlwIjoiSldUIn0.eyJhdWQiOiJoYXJib3ItcmVnaXN0cnkiLCJleHAiOjE3MTY5NzIyMTgsImp0aSI6IndCQXJhVEMydjRhd2lFU2siLCJpYXQiOjE3MTY5NzA0MTgsImlzcyI6ImhhcmJvci10b2tlbi1pc3N1ZXIiLCJuYmYiOjE3MTY5NzA0MTgsImFjY2VzcyI6W3sidHlwZSI6InJlcG9zaXRvcnkiLCJuYW1lIjoiaW5pdC1pbWFnZXMvYmlnZGF0YS0xMCIsImFjdGlvbnMiOlsicHVsbCJdfV19.UBm9l1XMipmsRXFjR9y0347gqHlkC8DpAocQgaqwjgEVRD-drlPOHnUIY1WHIBidcfpUCr60QKb53hSnZ__mdqb6IFDYiO4xcSeINxtSD9vYaxSAEKL2fRJxhbP1lCN556W03Dav8NxS_8ULJO2pZDzJXY7n4ICDJFWwGInf4VqgrRFz0CAm8wpf_WceAKWZwG_evZKISDRG4hSfZhQMqI2CWoOR6hHeokuK2mIBYKnq0wixbN9Oi7_6Muxh2HvFKlog5OCwyaivLCfCfziZ3jTwpC1J4r-gaizsvq3Je0neXDhuK5kNAKDO_SIPJTcoK6EipltNcr0kVFINkWEOxhq7ejs3Z1qh7elVqyXI2S9FOeuK7RVWvnkgaCt2kDA75itap0JYVjRKMopAEM5ujvStlUL66J_NF5RWuAScbw7kTh2vRAPQ9dA0hKTXzWQgtKmaP4u7UbG29TF2lx2_FAqSD9gSkMXdOX_5cUyRE3cx2glvrGq4jn6I5rUW4-cil_Ik_TGGsrsNFCZuvCFL25ssus0D2w0BjO4fWZtFQxRD7_EyrMb6HWcarCWr7OT1SEc-_WG8jWHYfegesE-erZkt8Uj033lZUmIixJt6v_8RQT5ZRWtlbLT3eTnPUd_lQZOE5rqtWaSXIXDznngaFgV4xc8DMxNkpPA5wTj1U_E\"}","taskID":"55477514a8c921ee18a841c5cb91be59cb51fdc8a5beac7154301347b6fa8c3d","url":"https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:6254de9101460ea689bd3a171a4f1e5e85b54f38a73f378f59f836c4321674b5"}
{"level":"info","ts":"2024-05-29 08:13:38.363","caller":"job/job.go:216","msg":"preheat(v1) https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:7f76cf5961f2c6bca667702008cb73bd980d11f68cabf61c0f4713e98421b3c6 tag: , filtered query params: , digest: , headers: map[string]string{\"Accept\":\"application/vnd.docker.image.rootfs.diff.tar.gzip\", \"Authorization\":\"Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IjdXTUE6S1ZYTzpLRjI1OjM1TkE6R0ozNTpaR0tZOlBHWVQ6STVVVDpUR1dZOlVVSTQ6UFQ3WjpYM0tXIiwidHlwIjoiSldUIn0.eyJhdWQiOiJoYXJib3ItcmVnaXN0cnkiLCJleHAiOjE3MTY5NzIyMTgsImp0aSI6IndCQXJhVEMydjRhd2lFU2siLCJpYXQiOjE3MTY5NzA0MTgsImlzcyI6ImhhcmJvci10b2tlbi1pc3N1ZXIiLCJuYmYiOjE3MTY5NzA0MTgsImFjY2VzcyI6W3sidHlwZSI6InJlcG9zaXRvcnkiLCJuYW1lIjoiaW5pdC1pbWFnZXMvYmlnZGF0YS0xMCIsImFjdGlvbnMiOlsicHVsbCJdfV19.UBm9l1XMipmsRXFjR9y0347gqHlkC8DpAocQgaqwjgEVRD-drlPOHnUIY1WHIBidcfpUCr60QKb53hSnZ__mdqb6IFDYiO4xcSeINxtSD9vYaxSAEKL2fRJxhbP1lCN556W03Dav8NxS_8ULJO2pZDzJXY7n4ICDJFWwGInf4VqgrRFz0CAm8wpf_WceAKWZwG_evZKISDRG4hSfZhQMqI2CWoOR6hHeokuK2mIBYKnq0wixbN9Oi7_6Muxh2HvFKlog5OCwyaivLCfCfziZ3jTwpC1J4r-gaizsvq3Je0neXDhuK5kNAKDO_SIPJTcoK6EipltNcr0kVFINkWEOxhq7ejs3Z1qh7elVqyXI2S9FOeuK7RVWvnkgaCt2kDA75itap0JYVjRKMopAEM5ujvStlUL66J_NF5RWuAScbw7kTh2vRAPQ9dA0hKTXzWQgtKmaP4u7UbG29TF2lx2_FAqSD9gSkMXdOX_5cUyRE3cx2glvrGq4jn6I5rUW4-cil_Ik_TGGsrsNFCZuvCFL25ssus0D2w0BjO4fWZtFQxRD7_EyrMb6HWcarCWr7OT1SEc-_WG8jWHYfegesE-erZkt8Uj033lZUmIixJt6v_8RQT5ZRWtlbLT3eTnPUd_lQZOE5rqtWaSXIXDznngaFgV4xc8DMxNkpPA5wTj1U_E\"}","taskID":"f8e79490f3ec5fcbdf7b082992dfe303f2cbf16e11058dae47afd94fc2420973","url":"https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:7f76cf5961f2c6bca667702008cb73bd980d11f68cabf61c0f4713e98421b3c6"}
{"level":"info","ts":"2024-05-29 08:13:38.363","caller":"job/job.go:216","msg":"preheat(v1) https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:6a3c54bbefc34e610982671dce1f9cc42fc7bce7768ebd88e6b2e9f95a2c10d6 tag: , filtered query params: , digest: , headers: map[string]string{\"Accept\":\"application/vnd.docker.image.rootfs.diff.tar.gzip\", \"Authorization\":\"Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IjdXTUE6S1ZYTzpLRjI1OjM1TkE6R0ozNTpaR0tZOlBHWVQ6STVVVDpUR1dZOlVVSTQ6UFQ3WjpYM0tXIiwidHlwIjoiSldUIn0.eyJhdWQiOiJoYXJib3ItcmVnaXN0cnkiLCJleHAiOjE3MTY5NzIyMTgsImp0aSI6IndCQXJhVEMydjRhd2lFU2siLCJpYXQiOjE3MTY5NzA0MTgsImlzcyI6ImhhcmJvci10b2tlbi1pc3N1ZXIiLCJuYmYiOjE3MTY5NzA0MTgsImFjY2VzcyI6W3sidHlwZSI6InJlcG9zaXRvcnkiLCJuYW1lIjoiaW5pdC1pbWFnZXMvYmlnZGF0YS0xMCIsImFjdGlvbnMiOlsicHVsbCJdfV19.UBm9l1XMipmsRXFjR9y0347gqHlkC8DpAocQgaqwjgEVRD-drlPOHnUIY1WHIBidcfpUCr60QKb53hSnZ__mdqb6IFDYiO4xcSeINxtSD9vYaxSAEKL2fRJxhbP1lCN556W03Dav8NxS_8ULJO2pZDzJXY7n4ICDJFWwGInf4VqgrRFz0CAm8wpf_WceAKWZwG_evZKISDRG4hSfZhQMqI2CWoOR6hHeokuK2mIBYKnq0wixbN9Oi7_6Muxh2HvFKlog5OCwyaivLCfCfziZ3jTwpC1J4r-gaizsvq3Je0neXDhuK5kNAKDO_SIPJTcoK6EipltNcr0kVFINkWEOxhq7ejs3Z1qh7elVqyXI2S9FOeuK7RVWvnkgaCt2kDA75itap0JYVjRKMopAEM5ujvStlUL66J_NF5RWuAScbw7kTh2vRAPQ9dA0hKTXzWQgtKmaP4u7UbG29TF2lx2_FAqSD9gSkMXdOX_5cUyRE3cx2glvrGq4jn6I5rUW4-cil_Ik_TGGsrsNFCZuvCFL25ssus0D2w0BjO4fWZtFQxRD7_EyrMb6HWcarCWr7OT1SEc-_WG8jWHYfegesE-erZkt8Uj033lZUmIixJt6v_8RQT5ZRWtlbLT3eTnPUd_lQZOE5rqtWaSXIXDznngaFgV4xc8DMxNkpPA5wTj1U_E\"}","taskID":"bfccdc5c4e40ef4d09183fef6b023660135657c330282b3d8ca29470eb6018b5","url":"https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:6a3c54bbefc34e610982671dce1f9cc42fc7bce7768ebd88e6b2e9f95a2c10d6"}
{"level":"info","ts":"2024-05-29 08:13:38.363","caller":"job/job.go:216","msg":"preheat(v1) https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:4445ea2ce25d955765d7daeb03314106c52fe845df9bdf41c20a58fede61d7f1 tag: , filtered query params: , digest: , headers: map[string]string{\"Accept\":\"application/vnd.docker.container.image.v1+json\", \"Authorization\":\"Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IjdXTUE6S1ZYTzpLRjI1OjM1TkE6R0ozNTpaR0tZOlBHWVQ6STVVVDpUR1dZOlVVSTQ6UFQ3WjpYM0tXIiwidHlwIjoiSldUIn0.eyJhdWQiOiJoYXJib3ItcmVnaXN0cnkiLCJleHAiOjE3MTY5NzIyMTgsImp0aSI6IndCQXJhVEMydjRhd2lFU2siLCJpYXQiOjE3MTY5NzA0MTgsImlzcyI6ImhhcmJvci10b2tlbi1pc3N1ZXIiLCJuYmYiOjE3MTY5NzA0MTgsImFjY2VzcyI6W3sidHlwZSI6InJlcG9zaXRvcnkiLCJuYW1lIjoiaW5pdC1pbWFnZXMvYmlnZGF0YS0xMCIsImFjdGlvbnMiOlsicHVsbCJdfV19.UBm9l1XMipmsRXFjR9y0347gqHlkC8DpAocQgaqwjgEVRD-drlPOHnUIY1WHIBidcfpUCr60QKb53hSnZ__mdqb6IFDYiO4xcSeINxtSD9vYaxSAEKL2fRJxhbP1lCN556W03Dav8NxS_8ULJO2pZDzJXY7n4ICDJFWwGInf4VqgrRFz0CAm8wpf_WceAKWZwG_evZKISDRG4hSfZhQMqI2CWoOR6hHeokuK2mIBYKnq0wixbN9Oi7_6Muxh2HvFKlog5OCwyaivLCfCfziZ3jTwpC1J4r-gaizsvq3Je0neXDhuK5kNAKDO_SIPJTcoK6EipltNcr0kVFINkWEOxhq7ejs3Z1qh7elVqyXI2S9FOeuK7RVWvnkgaCt2kDA75itap0JYVjRKMopAEM5ujvStlUL66J_NF5RWuAScbw7kTh2vRAPQ9dA0hKTXzWQgtKmaP4u7UbG29TF2lx2_FAqSD9gSkMXdOX_5cUyRE3cx2glvrGq4jn6I5rUW4-cil_Ik_TGGsrsNFCZuvCFL25ssus0D2w0BjO4fWZtFQxRD7_EyrMb6HWcarCWr7OT1SEc-_WG8jWHYfegesE-erZkt8Uj033lZUmIixJt6v_8RQT5ZRWtlbLT3eTnPUd_lQZOE5rqtWaSXIXDznngaFgV4xc8DMxNkpPA5wTj1U_E\"}","taskID":"e1697ef5bc877913be3673a58f8e6a91ec807039b14790171170a3a1b3078db6","url":"https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:4445ea2ce25d955765d7daeb03314106c52fe845df9bdf41c20a58fede61d7f1"}
{"level":"error","ts":"2024-05-29 08:13:38.363","caller":"job/job.go:278","msg":"preheat(v2) https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:9f0d5f02d7d1c35dc742d202ba49ee4b7fe9f26bb03cd1768043cbe5fc1e817b recive piece failed: rpc error: code = Unimplemented desc = unknown service dfdaemon.v2.DfdaemonUpload","taskID":"5ce8a2ce5106ed821ba880d28138531b2c4247b4bc4749b48999e6d9238f28c8","url":"https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:9f0d5f02d7d1c35dc742d202ba49ee4b7fe9f26bb03cd1768043cbe5fc1e817b","stacktrace":"d7y.io/dragonfly/v2/scheduler/job.(*job).preheatV2\n\t/go/src/d7y.io/dragonfly/v2/scheduler/job/job.go:278\nd7y.io/dragonfly/v2/scheduler/job.(*job).preheat\n\t/go/src/d7y.io/dragonfly/v2/scheduler/job/job.go:183\nreflect.Value.call\n\t/usr/local/go/src/reflect/value.go:596\nreflect.Value.Call\n\t/usr/local/go/src/reflect/value.go:380\ngithub.com/RichardKnop/machinery/v1/tasks.(*Task).Call\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/tasks/task.go:142\ngithub.com/RichardKnop/machinery/v1.(*Worker).Process\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/worker.go:182\ngithub.com/RichardKnop/machinery/v1/brokers/redis.(*Broker).consumeOne\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/brokers/redis/redis.go:349\ngithub.com/RichardKnop/machinery/v1/brokers/redis.(*Broker).consume.func2\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/brokers/redis/redis.go:312"}
{"level":"error","ts":"2024-05-29 08:13:38.364","caller":"job/job.go:184","msg":"preheat https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:9f0d5f02d7d1c35dc742d202ba49ee4b7fe9f26bb03cd1768043cbe5fc1e817b failed: rpc error: code = Unimplemented desc = unknown service dfdaemon.v2.DfdaemonUpload","stacktrace":"d7y.io/dragonfly/v2/scheduler/job.(*job).preheat\n\t/go/src/d7y.io/dragonfly/v2/scheduler/job/job.go:184\nreflect.Value.call\n\t/usr/local/go/src/reflect/value.go:596\nreflect.Value.Call\n\t/usr/local/go/src/reflect/value.go:380\ngithub.com/RichardKnop/machinery/v1/tasks.(*Task).Call\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/tasks/task.go:142\ngithub.com/RichardKnop/machinery/v1.(*Worker).Process\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/worker.go:182\ngithub.com/RichardKnop/machinery/v1/brokers/redis.(*Broker).consumeOne\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/brokers/redis/redis.go:349\ngithub.com/RichardKnop/machinery/v1/brokers/redis.(*Broker).consume.func2\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/brokers/redis/redis.go:312"}
{"level":"error","ts":"2024-05-29 08:13:38.363","caller":"job/job.go:278","msg":"preheat(v2) https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:fec9938e9c9cf860b9dcb7f9cf8885d1341a70e7d89bc5305056a9b1bdf76fcf recive piece failed: rpc error: code = Unimplemented desc = unknown service dfdaemon.v2.DfdaemonUpload","taskID":"f24884411f72f0d4955665b7e8ea13fec25e299a74a87c420b76681a488609f7","url":"https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:fec9938e9c9cf860b9dcb7f9cf8885d1341a70e7d89bc5305056a9b1bdf76fcf","stacktrace":"d7y.io/dragonfly/v2/scheduler/job.(*job).preheatV2\n\t/go/src/d7y.io/dragonfly/v2/scheduler/job/job.go:278\nd7y.io/dragonfly/v2/scheduler/job.(*job).preheat\n\t/go/src/d7y.io/dragonfly/v2/scheduler/job/job.go:183\nreflect.Value.call\n\t/usr/local/go/src/reflect/value.go:596\nreflect.Value.Call\n\t/usr/local/go/src/reflect/value.go:380\ngithub.com/RichardKnop/machinery/v1/tasks.(*Task).Call\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/tasks/task.go:142\ngithub.com/RichardKnop/machinery/v1.(*Worker).Process\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/worker.go:182\ngithub.com/RichardKnop/machinery/v1/brokers/redis.(*Broker).consumeOne\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/brokers/redis/redis.go:349\ngithub.com/RichardKnop/machinery/v1/brokers/redis.(*Broker).consume.func2\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/brokers/redis/redis.go:312"}
{"level":"error","ts":"2024-05-29 08:13:38.364","caller":"job/job.go:184","msg":"preheat https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:fec9938e9c9cf860b9dcb7f9cf8885d1341a70e7d89bc5305056a9b1bdf76fcf failed: rpc error: code = Unimplemented desc = unknown service dfdaemon.v2.DfdaemonUpload","stacktrace":"d7y.io/dragonfly/v2/scheduler/job.(*job).preheat\n\t/go/src/d7y.io/dragonfly/v2/scheduler/job/job.go:184\nreflect.Value.call\n\t/usr/local/go/src/reflect/value.go:596\nreflect.Value.Call\n\t/usr/local/go/src/reflect/value.go:380\ngithub.com/RichardKnop/machinery/v1/tasks.(*Task).Call\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/tasks/task.go:142\ngithub.com/RichardKnop/machinery/v1.(*Worker).Process\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/worker.go:182\ngithub.com/RichardKnop/machinery/v1/brokers/redis.(*Broker).consumeOne\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/brokers/redis/redis.go:349\ngithub.com/RichardKnop/machinery/v1/brokers/redis.(*Broker).consume.func2\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/brokers/redis/redis.go:312"}
{"level":"info","ts":"2024-05-29 08:13:38.364","caller":"job/job.go:216","msg":"preheat(v1) https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:fec9938e9c9cf860b9dcb7f9cf8885d1341a70e7d89bc5305056a9b1bdf76fcf tag: , filtered query params: , digest: , headers: map[string]string{\"Accept\":\"application/vnd.docker.image.rootfs.diff.tar.gzip\", \"Authorization\":\"Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IjdXTUE6S1ZYTzpLRjI1OjM1TkE6R0ozNTpaR0tZOlBHWVQ6STVVVDpUR1dZOlVVSTQ6UFQ3WjpYM0tXIiwidHlwIjoiSldUIn0.eyJhdWQiOiJoYXJib3ItcmVnaXN0cnkiLCJleHAiOjE3MTY5NzIyMTgsImp0aSI6IndCQXJhVEMydjRhd2lFU2siLCJpYXQiOjE3MTY5NzA0MTgsImlzcyI6ImhhcmJvci10b2tlbi1pc3N1ZXIiLCJuYmYiOjE3MTY5NzA0MTgsImFjY2VzcyI6W3sidHlwZSI6InJlcG9zaXRvcnkiLCJuYW1lIjoiaW5pdC1pbWFnZXMvYmlnZGF0YS0xMCIsImFjdGlvbnMiOlsicHVsbCJdfV19.UBm9l1XMipmsRXFjR9y0347gqHlkC8DpAocQgaqwjgEVRD-drlPOHnUIY1WHIBidcfpUCr60QKb53hSnZ__mdqb6IFDYiO4xcSeINxtSD9vYaxSAEKL2fRJxhbP1lCN556W03Dav8NxS_8ULJO2pZDzJXY7n4ICDJFWwGInf4VqgrRFz0CAm8wpf_WceAKWZwG_evZKISDRG4hSfZhQMqI2CWoOR6hHeokuK2mIBYKnq0wixbN9Oi7_6Muxh2HvFKlog5OCwyaivLCfCfziZ3jTwpC1J4r-gaizsvq3Je0neXDhuK5kNAKDO_SIPJTcoK6EipltNcr0kVFINkWEOxhq7ejs3Z1qh7elVqyXI2S9FOeuK7RVWvnkgaCt2kDA75itap0JYVjRKMopAEM5ujvStlUL66J_NF5RWuAScbw7kTh2vRAPQ9dA0hKTXzWQgtKmaP4u7UbG29TF2lx2_FAqSD9gSkMXdOX_5cUyRE3cx2glvrGq4jn6I5rUW4-cil_Ik_TGGsrsNFCZuvCFL25ssus0D2w0BjO4fWZtFQxRD7_EyrMb6HWcarCWr7OT1SEc-_WG8jWHYfegesE-erZkt8Uj033lZUmIixJt6v_8RQT5ZRWtlbLT3eTnPUd_lQZOE5rqtWaSXIXDznngaFgV4xc8DMxNkpPA5wTj1U_E\"}","taskID":"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320","url":"https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:fec9938e9c9cf860b9dcb7f9cf8885d1341a70e7d89bc5305056a9b1bdf76fcf"}
{"level":"error","ts":"2024-05-29 08:13:38.363","caller":"job/job.go:278","msg":"preheat(v2) https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:de48f30650ccde3e8186cc4c7634cab55ab8c031cc108e34a91b20a8f1deec1b recive piece failed: rpc error: code = Unimplemented desc = unknown service dfdaemon.v2.DfdaemonUpload","taskID":"1533c9ee8eb887a9b69470095c3d0547fa60ab10c4071dd17ed00cade829aeec","url":"https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:de48f30650ccde3e8186cc4c7634cab55ab8c031cc108e34a91b20a8f1deec1b","stacktrace":"d7y.io/dragonfly/v2/scheduler/job.(*job).preheatV2\n\t/go/src/d7y.io/dragonfly/v2/scheduler/job/job.go:278\nd7y.io/dragonfly/v2/scheduler/job.(*job).preheat\n\t/go/src/d7y.io/dragonfly/v2/scheduler/job/job.go:183\nreflect.Value.call\n\t/usr/local/go/src/reflect/value.go:596\nreflect.Value.Call\n\t/usr/local/go/src/reflect/value.go:380\ngithub.com/RichardKnop/machinery/v1/tasks.(*Task).Call\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/tasks/task.go:142\ngithub.com/RichardKnop/machinery/v1.(*Worker).Process\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/worker.go:182\ngithub.com/RichardKnop/machinery/v1/brokers/redis.(*Broker).consumeOne\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/brokers/redis/redis.go:349\ngithub.com/RichardKnop/machinery/v1/brokers/redis.(*Broker).consume.func2\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/brokers/redis/redis.go:312"}
{"level":"error","ts":"2024-05-29 08:13:38.364","caller":"job/job.go:184","msg":"preheat https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:de48f30650ccde3e8186cc4c7634cab55ab8c031cc108e34a91b20a8f1deec1b failed: rpc error: code = Unimplemented desc = unknown service dfdaemon.v2.DfdaemonUpload","stacktrace":"d7y.io/dragonfly/v2/scheduler/job.(*job).preheat\n\t/go/src/d7y.io/dragonfly/v2/scheduler/job/job.go:184\nreflect.Value.call\n\t/usr/local/go/src/reflect/value.go:596\nreflect.Value.Call\n\t/usr/local/go/src/reflect/value.go:380\ngithub.com/RichardKnop/machinery/v1/tasks.(*Task).Call\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/tasks/task.go:142\ngithub.com/RichardKnop/machinery/v1.(*Worker).Process\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/worker.go:182\ngithub.com/RichardKnop/machinery/v1/brokers/redis.(*Broker).consumeOne\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/brokers/redis/redis.go:349\ngithub.com/RichardKnop/machinery/v1/brokers/redis.(*Broker).consume.func2\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/brokers/redis/redis.go:312"}
{"level":"error","ts":"2024-05-29 08:13:38.363","caller":"job/job.go:184","msg":"preheat https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:f38403c80edca2edf058a023893e1d649c8538180916aac6aa0842b25dd845ec failed: rpc error: code = Unimplemented desc = unknown service dfdaemon.v2.DfdaemonUpload","stacktrace":"d7y.io/dragonfly/v2/scheduler/job.(*job).preheat\n\t/go/src/d7y.io/dragonfly/v2/scheduler/job/job.go:184\nreflect.Value.call\n\t/usr/local/go/src/reflect/value.go:596\nreflect.Value.Call\n\t/usr/local/go/src/reflect/value.go:380\ngithub.com/RichardKnop/machinery/v1/tasks.(*Task).Call\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/tasks/task.go:142\ngithub.com/RichardKnop/machinery/v1.(*Worker).Process\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/worker.go:182\ngithub.com/RichardKnop/machinery/v1/brokers/redis.(*Broker).consumeOne\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/brokers/redis/redis.go:349\ngithub.com/RichardKnop/machinery/v1/brokers/redis.(*Broker).consume.func2\n\t/go/pkg/mod/github.com/!richard!knop/machinery@v1.10.8/v1/brokers/redis/redis.go:312"}
{"level":"info","ts":"2024-05-29 08:13:38.364","caller":"job/job.go:216","msg":"preheat(v1) https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:de48f30650ccde3e8186cc4c7634cab55ab8c031cc108e34a91b20a8f1deec1b tag: , filtered query params: , digest: , headers: map[string]string{\"Accept\":\"application/vnd.docker.image.rootfs.diff.tar.gzip\", \"Authorization\":\"Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IjdXTUE6S1ZYTzpLRjI1OjM1TkE6R0ozNTpaR0tZOlBHWVQ6STVVVDpUR1dZOlVVSTQ6UFQ3WjpYM0tXIiwidHlwIjoiSldUIn0.eyJhdWQiOiJoYXJib3ItcmVnaXN0cnkiLCJleHAiOjE3MTY5NzIyMTgsImp0aSI6IndCQXJhVEMydjRhd2lFU2siLCJpYXQiOjE3MTY5NzA0MTgsImlzcyI6ImhhcmJvci10b2tlbi1pc3N1ZXIiLCJuYmYiOjE3MTY5NzA0MTgsImFjY2VzcyI6W3sidHlwZSI6InJlcG9zaXRvcnkiLCJuYW1lIjoiaW5pdC1pbWFnZXMvYmlnZGF0YS0xMCIsImFjdGlvbnMiOlsicHVsbCJdfV19.UBm9l1XMipmsRXFjR9y0347gqHlkC8DpAocQgaqwjgEVRD-drlPOHnUIY1WHIBidcfpUCr60QKb53hSnZ__mdqb6IFDYiO4xcSeINxtSD9vYaxSAEKL2fRJxhbP1lCN556W03Dav8NxS_8ULJO2pZDzJXY7n4ICDJFWwGInf4VqgrRFz0CAm8wpf_WceAKWZwG_evZKISDRG4hSfZhQMqI2CWoOR6hHeokuK2mIBYKnq0wixbN9Oi7_6Muxh2HvFKlog5OCwyaivLCfCfziZ3jTwpC1J4r-gaizsvq3Je0neXDhuK5kNAKDO_SIPJTcoK6EipltNcr0kVFINkWEOxhq7ejs3Z1qh7elVqyXI2S9FOeuK7RVWvnkgaCt2kDA75itap0JYVjRKMopAEM5ujvStlUL66J_NF5RWuAScbw7kTh2vRAPQ9dA0hKTXzWQgtKmaP4u7UbG29TF2lx2_FAqSD9gSkMXdOX_5cUyRE3cx2glvrGq4jn6I5rUW4-cil_Ik_TGGsrsNFCZuvCFL25ssus0D2w0BjO4fWZtFQxRD7_EyrMb6HWcarCWr7OT1SEc-_WG8jWHYfegesE-erZkt8Uj033lZUmIixJt6v_8RQT5ZRWtlbLT3eTnPUd_lQZOE5rqtWaSXIXDznngaFgV4xc8DMxNkpPA5wTj1U_E\"}","taskID":"18629e15046b94c410db71976477880ba3aac2fe7b168d8df75f20b3a94c0b96","url":"https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:de48f30650ccde3e8186cc4c7634cab55ab8c031cc108e34a91b20a8f1deec1b"}
{"level":"info","ts":"2024-05-29 08:13:38.364","caller":"job/job.go:216","msg":"preheat(v1) https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:f38403c80edca2edf058a023893e1d649c8538180916aac6aa0842b25dd845ec tag: , filtered query params: , digest: , headers: map[string]string{\"Accept\":\"application/vnd.docker.image.rootfs.diff.tar.gzip\", \"Authorization\":\"Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IjdXTUE6S1ZYTzpLRjI1OjM1TkE6R0ozNTpaR0tZOlBHWVQ6STVVVDpUR1dZOlVVSTQ6UFQ3WjpYM0tXIiwidHlwIjoiSldUIn0.eyJhdWQiOiJoYXJib3ItcmVnaXN0cnkiLCJleHAiOjE3MTY5NzIyMTgsImp0aSI6IndCQXJhVEMydjRhd2lFU2siLCJpYXQiOjE3MTY5NzA0MTgsImlzcyI6ImhhcmJvci10b2tlbi1pc3N1ZXIiLCJuYmYiOjE3MTY5NzA0MTgsImFjY2VzcyI6W3sidHlwZSI6InJlcG9zaXRvcnkiLCJuYW1lIjoiaW5pdC1pbWFnZXMvYmlnZGF0YS0xMCIsImFjdGlvbnMiOlsicHVsbCJdfV19.UBm9l1XMipmsRXFjR9y0347gqHlkC8DpAocQgaqwjgEVRD-drlPOHnUIY1WHIBidcfpUCr60QKb53hSnZ__mdqb6IFDYiO4xcSeINxtSD9vYaxSAEKL2fRJxhbP1lCN556W03Dav8NxS_8ULJO2pZDzJXY7n4ICDJFWwGInf4VqgrRFz0CAm8wpf_WceAKWZwG_evZKISDRG4hSfZhQMqI2CWoOR6hHeokuK2mIBYKnq0wixbN9Oi7_6Muxh2HvFKlog5OCwyaivLCfCfziZ3jTwpC1J4r-gaizsvq3Je0neXDhuK5kNAKDO_SIPJTcoK6EipltNcr0kVFINkWEOxhq7ejs3Z1qh7elVqyXI2S9FOeuK7RVWvnkgaCt2kDA75itap0JYVjRKMopAEM5ujvStlUL66J_NF5RWuAScbw7kTh2vRAPQ9dA0hKTXzWQgtKmaP4u7UbG29TF2lx2_FAqSD9gSkMXdOX_5cUyRE3cx2glvrGq4jn6I5rUW4-cil_Ik_TGGsrsNFCZuvCFL25ssus0D2w0BjO4fWZtFQxRD7_EyrMb6HWcarCWr7OT1SEc-_WG8jWHYfegesE-erZkt8Uj033lZUmIixJt6v_8RQT5ZRWtlbLT3eTnPUd_lQZOE5rqtWaSXIXDznngaFgV4xc8DMxNkpPA5wTj1U_E\"}","taskID":"ab44a04a9132ae0397d390ca8267e0d808e683cabbbbdf97f05ce501ac5bc463","url":"https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:f38403c80edca2edf058a023893e1d649c8538180916aac6aa0842b25dd845ec"}
{"level":"info","ts":"2024-05-29 08:13:38.363","caller":"job/job.go:216","msg":"preheat(v1) https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:ca3cd42a7c9525f6ce3d64c1a70982613a8235f0cc057ec9244052921853ef15 tag: , filtered query params: , digest: , headers: map[string]string{\"Accept\":\"application/vnd.docker.image.rootfs.diff.tar.gzip\", \"Authorization\":\"Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IjdXTUE6S1ZYTzpLRjI1OjM1TkE6R0ozNTpaR0tZOlBHWVQ6STVVVDpUR1dZOlVVSTQ6UFQ3WjpYM0tXIiwidHlwIjoiSldUIn0.eyJhdWQiOiJoYXJib3ItcmVnaXN0cnkiLCJleHAiOjE3MTY5NzIyMTgsImp0aSI6IndCQXJhVEMydjRhd2lFU2siLCJpYXQiOjE3MTY5NzA0MTgsImlzcyI6ImhhcmJvci10b2tlbi1pc3N1ZXIiLCJuYmYiOjE3MTY5NzA0MTgsImFjY2VzcyI6W3sidHlwZSI6InJlcG9zaXRvcnkiLCJuYW1lIjoiaW5pdC1pbWFnZXMvYmlnZGF0YS0xMCIsImFjdGlvbnMiOlsicHVsbCJdfV19.UBm9l1XMipmsRXFjR9y0347gqHlkC8DpAocQgaqwjgEVRD-drlPOHnUIY1WHIBidcfpUCr60QKb53hSnZ__mdqb6IFDYiO4xcSeINxtSD9vYaxSAEKL2fRJxhbP1lCN556W03Dav8NxS_8ULJO2pZDzJXY7n4ICDJFWwGInf4VqgrRFz0CAm8wpf_WceAKWZwG_evZKISDRG4hSfZhQMqI2CWoOR6hHeokuK2mIBYKnq0wixbN9Oi7_6Muxh2HvFKlog5OCwyaivLCfCfziZ3jTwpC1J4r-gaizsvq3Je0neXDhuK5kNAKDO_SIPJTcoK6EipltNcr0kVFINkWEOxhq7ejs3Z1qh7elVqyXI2S9FOeuK7RVWvnkgaCt2kDA75itap0JYVjRKMopAEM5ujvStlUL66J_NF5RWuAScbw7kTh2vRAPQ9dA0hKTXzWQgtKmaP4u7UbG29TF2lx2_FAqSD9gSkMXdOX_5cUyRE3cx2glvrGq4jn6I5rUW4-cil_Ik_TGGsrsNFCZuvCFL25ssus0D2w0BjO4fWZtFQxRD7_EyrMb6HWcarCWr7OT1SEc-_WG8jWHYfegesE-erZkt8Uj033lZUmIixJt6v_8RQT5ZRWtlbLT3eTnPUd_lQZOE5rqtWaSXIXDznngaFgV4xc8DMxNkpPA5wTj1U_E\"}","taskID":"161489e324f62e68361c2ecc76e668195427e796f623dfb4b8cea48111d94fa6","url":"https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:ca3cd42a7c9525f6ce3d64c1a70982613a8235f0cc057ec9244052921853ef15"}
{"level":"info","ts":"2024-05-29 08:13:38.364","caller":"job/job.go:216","msg":"preheat(v1) https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:9f0d5f02d7d1c35dc742d202ba49ee4b7fe9f26bb03cd1768043cbe5fc1e817b tag: , filtered query params: , digest: , headers: map[string]string{\"Accept\":\"application/vnd.docker.image.rootfs.diff.tar.gzip\", \"Authorization\":\"Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IjdXTUE6S1ZYTzpLRjI1OjM1TkE6R0ozNTpaR0tZOlBHWVQ6STVVVDpUR1dZOlVVSTQ6UFQ3WjpYM0tXIiwidHlwIjoiSldUIn0.eyJhdWQiOiJoYXJib3ItcmVnaXN0cnkiLCJleHAiOjE3MTY5NzIyMTgsImp0aSI6IndCQXJhVEMydjRhd2lFU2siLCJpYXQiOjE3MTY5NzA0MTgsImlzcyI6ImhhcmJvci10b2tlbi1pc3N1ZXIiLCJuYmYiOjE3MTY5NzA0MTgsImFjY2VzcyI6W3sidHlwZSI6InJlcG9zaXRvcnkiLCJuYW1lIjoiaW5pdC1pbWFnZXMvYmlnZGF0YS0xMCIsImFjdGlvbnMiOlsicHVsbCJdfV19.UBm9l1XMipmsRXFjR9y0347gqHlkC8DpAocQgaqwjgEVRD-drlPOHnUIY1WHIBidcfpUCr60QKb53hSnZ__mdqb6IFDYiO4xcSeINxtSD9vYaxSAEKL2fRJxhbP1lCN556W03Dav8NxS_8ULJO2pZDzJXY7n4ICDJFWwGInf4VqgrRFz0CAm8wpf_WceAKWZwG_evZKISDRG4hSfZhQMqI2CWoOR6hHeokuK2mIBYKnq0wixbN9Oi7_6Muxh2HvFKlog5OCwyaivLCfCfziZ3jTwpC1J4r-gaizsvq3Je0neXDhuK5kNAKDO_SIPJTcoK6EipltNcr0kVFINkWEOxhq7ejs3Z1qh7elVqyXI2S9FOeuK7RVWvnkgaCt2kDA75itap0JYVjRKMopAEM5ujvStlUL66J_NF5RWuAScbw7kTh2vRAPQ9dA0hKTXzWQgtKmaP4u7UbG29TF2lx2_FAqSD9gSkMXdOX_5cUyRE3cx2glvrGq4jn6I5rUW4-cil_Ik_TGGsrsNFCZuvCFL25ssus0D2w0BjO4fWZtFQxRD7_EyrMb6HWcarCWr7OT1SEc-_WG8jWHYfegesE-erZkt8Uj033lZUmIixJt6v_8RQT5ZRWtlbLT3eTnPUd_lQZOE5rqtWaSXIXDznngaFgV4xc8DMxNkpPA5wTj1U_E\"}","taskID":"0169e9cf1d18142e91bba460de2dd34056401d8c8a50a4c6d0b180a0f8c2a307","url":"https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:9f0d5f02d7d1c35dc742d202ba49ee4b7fe9f26bb03cd1768043cbe5fc1e817b"}
{"level":"info","ts":"2024-05-29 08:13:38.514","caller":"job/job.go:237","msg":"preheat(v1) https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:7f76cf5961f2c6bca667702008cb73bd980d11f68cabf61c0f4713e98421b3c6 succeeded","taskID":"f8e79490f3ec5fcbdf7b082992dfe303f2cbf16e11058dae47afd94fc2420973","url":"https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:7f76cf5961f2c6bca667702008cb73bd980d11f68cabf61c0f4713e98421b3c6"}
{"level":"info","ts":"2024-05-29 08:13:38.520","caller":"job/job.go:237","msg":"preheat(v1) https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:5ba57a76386b0fe8402f1ce711b83af6ef093b831cea561015f5d5c2a1531a17 succeeded","taskID":"a40bc6de3c414d6e82701c62c2df66187ba86d048af8bab03660411d4e431c5a","url":"https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:5ba57a76386b0fe8402f1ce711b83af6ef093b831cea561015f5d5c2a1531a17"}
{"level":"info","ts":"2024-05-29 08:13:38.528","caller":"job/job.go:237","msg":"preheat(v1) https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:4445ea2ce25d955765d7daeb03314106c52fe845df9bdf41c20a58fede61d7f1 succeeded","taskID":"e1697ef5bc877913be3673a58f8e6a91ec807039b14790171170a3a1b3078db6","url":"https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:4445ea2ce25d955765d7daeb03314106c52fe845df9bdf41c20a58fede61d7f1"}
{"level":"info","ts":"2024-05-29 08:13:38.543","caller":"job/job.go:237","msg":"preheat(v1) https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:6a3c54bbefc34e610982671dce1f9cc42fc7bce7768ebd88e6b2e9f95a2c10d6 succeeded","taskID":"bfccdc5c4e40ef4d09183fef6b023660135657c330282b3d8ca29470eb6018b5","url":"https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:6a3c54bbefc34e610982671dce1f9cc42fc7bce7768ebd88e6b2e9f95a2c10d6"}
{"level":"info","ts":"2024-05-29 08:13:38.547","caller":"job/job.go:237","msg":"preheat(v1) https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:3561442fed515eec59c9770b8891462cc848e92bbe1b6887e448969bbb8caa9e succeeded","taskID":"5dec570990b5ae12d1f417af02d25673992f0e0bdd8b281f18893daeb1d2b3b7","url":"https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:3561442fed515eec59c9770b8891462cc848e92bbe1b6887e448969bbb8caa9e"}
{"level":"info","ts":"2024-05-29 08:13:38.547","caller":"job/job.go:237","msg":"preheat(v1) https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:6254de9101460ea689bd3a171a4f1e5e85b54f38a73f378f59f836c4321674b5 succeeded","taskID":"55477514a8c921ee18a841c5cb91be59cb51fdc8a5beac7154301347b6fa8c3d","url":"https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:6254de9101460ea689bd3a171a4f1e5e85b54f38a73f378f59f836c4321674b5"}
{"level":"info","ts":"2024-05-29 08:13:38.552","caller":"job/job.go:237","msg":"preheat(v1) https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:f38403c80edca2edf058a023893e1d649c8538180916aac6aa0842b25dd845ec succeeded","taskID":"ab44a04a9132ae0397d390ca8267e0d808e683cabbbbdf97f05ce501ac5bc463","url":"https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:f38403c80edca2edf058a023893e1d649c8538180916aac6aa0842b25dd845ec"}
{"level":"info","ts":"2024-05-29 08:13:38.552","caller":"job/job.go:237","msg":"preheat(v1) https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:9f0d5f02d7d1c35dc742d202ba49ee4b7fe9f26bb03cd1768043cbe5fc1e817b succeeded","taskID":"0169e9cf1d18142e91bba460de2dd34056401d8c8a50a4c6d0b180a0f8c2a307","url":"https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:9f0d5f02d7d1c35dc742d202ba49ee4b7fe9f26bb03cd1768043cbe5fc1e817b"}
{"level":"info","ts":"2024-05-29 08:13:38.620","caller":"job/job.go:237","msg":"preheat(v1) https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:ca3cd42a7c9525f6ce3d64c1a70982613a8235f0cc057ec9244052921853ef15 succeeded","taskID":"161489e324f62e68361c2ecc76e668195427e796f623dfb4b8cea48111d94fa6","url":"https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:ca3cd42a7c9525f6ce3d64c1a70982613a8235f0cc057ec9244052921853ef15"}
{"level":"info","ts":"2024-05-29 08:13:38.680","caller":"job/job.go:237","msg":"preheat(v1) https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:de48f30650ccde3e8186cc4c7634cab55ab8c031cc108e34a91b20a8f1deec1b succeeded","taskID":"18629e15046b94c410db71976477880ba3aac2fe7b168d8df75f20b3a94c0b96","url":"https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:de48f30650ccde3e8186cc4c7634cab55ab8c031cc108e34a91b20a8f1deec1b"}
{"level":"info","ts":"2024-05-29 08:13:38.739","caller":"job/job.go:237","msg":"preheat(v1) https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:fec9938e9c9cf860b9dcb7f9cf8885d1341a70e7d89bc5305056a9b1bdf76fcf succeeded","taskID":"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320","url":"https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:fec9938e9c9cf860b9dcb7f9cf8885d1341a70e7d89bc5305056a9b1bdf76fcf"}
{"level":"info","ts":"2024-05-29 08:13:38.753","caller":"job/job.go:237","msg":"preheat(v1) https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:18e7ff17db9d6afa1446adc4cdc56503ab6eead8549322304c33141fbe83de7d succeeded","taskID":"c6ed1f62d8990ac98b27010c3155f29552512a04cf309950330d4ea7747b95b1","url":"https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:18e7ff17db9d6afa1446adc4cdc56503ab6eead8549322304c33141fbe83de7d"}

logs: core-seed-peer.log scheduler-core.log

@gaius-qi

gaius-qi commented 1 month ago

@mansoncui Please search the log by task id and make sure the Peer download task is a preheating task from the Seed Peer.

mansoncui commented 1 month ago

@mansoncui Please search the log by and make sure the Peer download task is a preheating task from the Seed Peer.task id

##download node storage info
 # ls /var/lib/dragonfly/ -l
total 24
drwx------    3 root     root          4096 May 29 08:03 11380641533ae269c6c83600885430f0d3913db6d5c4bda965cb0ab08dcbc9be
drwx------    3 root     root          4096 May 29 08:03 74bf488eee38a9c853547f340b5154d46ffc5051e216f1b097296626dc0e2abd
drwx------    3 root     root          4096 May 29 08:16 911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320
drwx------    3 root     root          4096 May 29 08:30 9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b
drwx------    3 root     root          4096 May 29 08:16 e1697ef5bc877913be3673a58f8e6a91ec807039b14790171170a3a1b3078db6
drwx------    3 root     root          4096 May 29 08:30 f5cd5868a3a7f3572307f669c303f49e4e3960bac2b26e473bfd08c16849e58b

peer core.log 信息

/ # grep -rn "911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320" /var/log/dragonfly/daemon/core.log  | head -10
557:{"level":"info","ts":"2024-05-29 08:16:14.395","caller":"transport/transport.go:306","msg":"start download with url: https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:fec9938e9c9cf860b9dcb7f9cf8885d1341a70e7d89bc5305056a9b1bdf76fcf?ns=harbor.test.wifi.com","peer":"10.222.79.55-29440-a54cf14d-275f-4928-9eda-d92eb8197e4e","component":"transport","trace":"ec6cdd1a4151a9def5b5d30dcdaf66ca","task":"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320"}
558:{"level":"debug","ts":"2024-05-29 08:16:14.395","caller":"transport/transport.go:307","msg":"request url: https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:fec9938e9c9cf860b9dcb7f9cf8885d1341a70e7d89bc5305056a9b1bdf76fcf?ns=harbor.test.wifi.com, with header: http.Header{\"Accept\":[]string{\"application/vnd.docker.image.rootfs.diff.tar.gzip, */*\"}, \"Authorization\":[]string{\"Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IjdXTUE6S1ZYTzpLRjI1OjM1TkE6R0ozNTpaR0tZOlBHWVQ6STVVVDpUR1dZOlVVSTQ6UFQ3WjpYM0tXIiwidHlwIjoiSldUIn0.eyJhdWQiOiJoYXJib3ItcmVnaXN0cnkiLCJleHAiOjE3MTY5NzIzNzMsImp0aSI6Ijk2M1RYWXhCRk5jT3J2N2IiLCJpYXQiOjE3MTY5NzA1NzMsImlzcyI6ImhhcmJvci10b2tlbi1pc3N1ZXIiLCJuYmYiOjE3MTY5NzA1NzMsImFjY2VzcyI6W3sidHlwZSI6InJlcG9zaXRvcnkiLCJuYW1lIjoiaW5pdC1pbWFnZXMvYmlnZGF0YS0xMCIsImFjdGlvbnMiOlsicHVsbCJdfV19.qyrx7hrfALfKGeCyrHmj1-scnNAG-YIvVB0eawghGahzcovKSK8NrD4q44s5wq7LSZJLZmdTUcqLkoIs8dQ6jJqZ3JBpNtCd5D97j1gLk4gtKMs4omsJFIlE-zWqXZEfi9ouQXAWVp1_FNR-M0lGRj8-hrRaU85Z6bcAEBR3g0cIKSw4K5rgxp_yQUO1SdyBtw3oWFE3VRy9LtFjBM_h0yO2K_97osfjDJR946eFEyrFG6NHIZj0VDYCckzAHco5FRFxu8tfhjAMCtEKJXj8V7W7NxjyHZzf98HGnUP8DpfKGjqiwCwkI7JqpxcorWE-FyuTFSuZrljSvYmkpC3TIuK6u1B1-oFCnggQ2vgBOH05-PJ6VkHfAOuldwqbcv_xgADIuWetzclq5pCnxmGb67b17tMvGkw23ONO5_igI1U350YZMhVxtcrVBICqGwRSXdFTtDQeMV0TsFDNgklpUMTwDQNgtnMH5m17z-VlgYrEpc6DjFyW4JfFYnE1aoMmGISXKGrxzP5_muE9Tib7MyqyfhJ9uC39AZPzEUZscU-pUNEk_el3BFuh0GwiTK2iMOAAmgbUYZsU1urwvmzhIIC5k-bXFMg5rjAaWcvcHrQ_6UmuE8gZF98FK1Qan4R4h4_BrTOWvn7fzgjyIulh3oDtsEeRYzo8H1ry9atN0Sc\"}}","peer":"10.222.79.55-29440-a54cf14d-275f-4928-9eda-d92eb8197e4e","component":"transport","trace":"ec6cdd1a4151a9def5b5d30dcdaf66ca","task":"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320"}
559:{"level":"debug","ts":"2024-05-29 08:16:14.395","caller":"peer/peertask_manager.go:239","msg":"peer task created: 911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320/10.222.79.55-29440-a54cf14d-275f-4928-9eda-d92eb8197e4e"}
560:{"level":"debug","ts":"2024-05-29 08:16:14.395","caller":"storage/storage_manager.go:430","msg":"init local task storage, peer id: 10.222.79.55-29440-a54cf14d-275f-4928-9eda-d92eb8197e4e, task id: 911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320"}
561:{"level":"debug","ts":"2024-05-29 08:16:14.395","caller":"peer/peertask_conductor.go:256","msg":"request overview, pid: 10.222.79.55-29440-a54cf14d-275f-4928-9eda-d92eb8197e4e, url: https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:fec9938e9c9cf860b9dcb7f9cf8885d1341a70e7d89bc5305056a9b1bdf76fcf?ns=harbor.test.wifi.com, filter: Expires&Signature&ns, tag: , range: , digest: , header: map[string]string{\"Accept\":\"application/vnd.docker.image.rootfs.diff.tar.gzip, */*\", \"Authorization\":\"Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IjdXTUE6S1ZYTzpLRjI1OjM1TkE6R0ozNTpaR0tZOlBHWVQ6STVVVDpUR1dZOlVVSTQ6UFQ3WjpYM0tXIiwidHlwIjoiSldUIn0.eyJhdWQiOiJoYXJib3ItcmVnaXN0cnkiLCJleHAiOjE3MTY5NzIzNzMsImp0aSI6Ijk2M1RYWXhCRk5jT3J2N2IiLCJpYXQiOjE3MTY5NzA1NzMsImlzcyI6ImhhcmJvci10b2tlbi1pc3N1ZXIiLCJuYmYiOjE3MTY5NzA1NzMsImFjY2VzcyI6W3sidHlwZSI6InJlcG9zaXRvcnkiLCJuYW1lIjoiaW5pdC1pbWFnZXMvYmlnZGF0YS0xMCIsImFjdGlvbnMiOlsicHVsbCJdfV19.qyrx7hrfALfKGeCyrHmj1-scnNAG-YIvVB0eawghGahzcovKSK8NrD4q44s5wq7LSZJLZmdTUcqLkoIs8dQ6jJqZ3JBpNtCd5D97j1gLk4gtKMs4omsJFIlE-zWqXZEfi9ouQXAWVp1_FNR-M0lGRj8-hrRaU85Z6bcAEBR3g0cIKSw4K5rgxp_yQUO1SdyBtw3oWFE3VRy9LtFjBM_h0yO2K_97osfjDJR946eFEyrFG6NHIZj0VDYCckzAHco5FRFxu8tfhjAMCtEKJXj8V7W7NxjyHZzf98HGnUP8DpfKGjqiwCwkI7JqpxcorWE-FyuTFSuZrljSvYmkpC3TIuK6u1B1-oFCnggQ2vgBOH05-PJ6VkHfAOuldwqbcv_xgADIuWetzclq5pCnxmGb67b17tMvGkw23ONO5_igI1U350YZMhVxtcrVBICqGwRSXdFTtDQeMV0TsFDNgklpUMTwDQNgtnMH5m17z-VlgYrEpc6DjFyW4JfFYnE1aoMmGISXKGrxzP5_muE9Tib7MyqyfhJ9uC39AZPzEUZscU-pUNEk_el3BFuh0GwiTK2iMOAAmgbUYZsU1urwvmzhIIC5k-bXFMg5rjAaWcvcHrQ_6UmuE8gZF98FK1Qan4R4h4_BrTOWvn7fzgjyIulh3oDtsEeRYzo8H1ry9atN0Sc\"}","peer":"10.222.79.55-29440-a54cf14d-275f-4928-9eda-d92eb8197e4e","task":"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320","component":"PeerTask","trace":"ec6cdd1a4151a9def5b5d30dcdaf66ca"}
562:{"level":"info","ts":"2024-05-29 08:16:14.395","caller":"peer/peertask_conductor.go:270","msg":"step 1: peer 10.222.79.55-29440-a54cf14d-275f-4928-9eda-d92eb8197e4e start to register","peer":"10.222.79.55-29440-a54cf14d-275f-4928-9eda-d92eb8197e4e","task":"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320","component":"PeerTask","trace":"ec6cdd1a4151a9def5b5d30dcdaf66ca"}
563:{"level":"info","ts":"2024-05-29 08:16:14.396","caller":"peer/peertask_conductor.go:296","msg":"register task success, SizeScope: NORMAL","peer":"10.222.79.55-29440-a54cf14d-275f-4928-9eda-d92eb8197e4e","task":"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320","component":"PeerTask","trace":"ec6cdd1a4151a9def5b5d30dcdaf66ca"}
564:{"level":"info","ts":"2024-05-29 08:16:14.396","caller":"peer/peertask_conductor.go:347","msg":"step 2: start report piece result","peer":"10.222.79.55-29440-a54cf14d-275f-4928-9eda-d92eb8197e4e","task":"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320","component":"PeerTask","trace":"ec6cdd1a4151a9def5b5d30dcdaf66ca"}
565:{"level":"debug","ts":"2024-05-29 08:16:14.396","caller":"peer/piece_dispatcher.go:85","msg":"piece dispatcher created","peer":"10.222.79.55-29440-a54cf14d-275f-4928-9eda-d92eb8197e4e","task":"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320","component":"PeerTask","trace":"ec6cdd1a4151a9def5b5d30dcdaf66ca"}
566:{"level":"debug","ts":"2024-05-29 08:16:15.097","caller":"peer/peertask_conductor.go:729","msg":"receive peerPacket task_id:\"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320\" src_pid:\"10.222.79.55-29440-a54cf14d-275f-4928-9eda-d92eb8197e4e\" main_peer:{ip:\"10.222.79.36\" rpc_port:65000 peer_id:\"10.222.79.36-1-108a160c-4be8-45b0-be90-5e14427cc146_Seed\"} code:Success","peer":"10.222.79.55-29440-a54cf14d-275f-4928-9eda-d92eb8197e4e","task":"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320","component":"PeerTask","trace":"ec6cdd1a4151a9def5b5d30dcdaf66ca"}

jarger ui info:

image image image

dfdaemon core.log file: 55.18-core.log

@gaius-qi

gaius-qi commented 1 month ago

@mansoncui Please search the log by and make sure the Peer download task is a preheating task from the Seed Peer.task id


##download node storage info

 # ls /var/lib/dragonfly/ -l

total 24

drwx------    3 root     root          4096 May 29 08:03 11380641533ae269c6c83600885430f0d3913db6d5c4bda965cb0ab08dcbc9be

drwx------    3 root     root          4096 May 29 08:03 74bf488eee38a9c853547f340b5154d46ffc5051e216f1b097296626dc0e2abd

drwx------    3 root     root          4096 May 29 08:16 911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320

drwx------    3 root     root          4096 May 29 08:30 9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b

drwx------    3 root     root          4096 May 29 08:16 e1697ef5bc877913be3673a58f8e6a91ec807039b14790171170a3a1b3078db6

drwx------    3 root     root          4096 May 29 08:30 f5cd5868a3a7f3572307f669c303f49e4e3960bac2b26e473bfd08c16849e58b

peer core.log 信息


/ # grep -rn "911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320" /var/log/dragonfly/daemon/core.log  | head -10

557:{"level":"info","ts":"2024-05-29 08:16:14.395","caller":"transport/transport.go:306","msg":"start download with url: https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:fec9938e9c9cf860b9dcb7f9cf8885d1341a70e7d89bc5305056a9b1bdf76fcf?ns=harbor.test.wifi.com","peer":"10.222.79.55-29440-a54cf14d-275f-4928-9eda-d92eb8197e4e","component":"transport","trace":"ec6cdd1a4151a9def5b5d30dcdaf66ca","task":"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320"}

558:{"level":"debug","ts":"2024-05-29 08:16:14.395","caller":"transport/transport.go:307","msg":"request url: https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:fec9938e9c9cf860b9dcb7f9cf8885d1341a70e7d89bc5305056a9b1bdf76fcf?ns=harbor.test.wifi.com, with header: http.Header{\"Accept\":[]string{\"application/vnd.docker.image.rootfs.diff.tar.gzip, */*\"}, \"Authorization\":[]string{\"Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IjdXTUE6S1ZYTzpLRjI1OjM1TkE6R0ozNTpaR0tZOlBHWVQ6STVVVDpUR1dZOlVVSTQ6UFQ3WjpYM0tXIiwidHlwIjoiSldUIn0.eyJhdWQiOiJoYXJib3ItcmVnaXN0cnkiLCJleHAiOjE3MTY5NzIzNzMsImp0aSI6Ijk2M1RYWXhCRk5jT3J2N2IiLCJpYXQiOjE3MTY5NzA1NzMsImlzcyI6ImhhcmJvci10b2tlbi1pc3N1ZXIiLCJuYmYiOjE3MTY5NzA1NzMsImFjY2VzcyI6W3sidHlwZSI6InJlcG9zaXRvcnkiLCJuYW1lIjoiaW5pdC1pbWFnZXMvYmlnZGF0YS0xMCIsImFjdGlvbnMiOlsicHVsbCJdfV19.qyrx7hrfALfKGeCyrHmj1-scnNAG-YIvVB0eawghGahzcovKSK8NrD4q44s5wq7LSZJLZmdTUcqLkoIs8dQ6jJqZ3JBpNtCd5D97j1gLk4gtKMs4omsJFIlE-zWqXZEfi9ouQXAWVp1_FNR-M0lGRj8-hrRaU85Z6bcAEBR3g0cIKSw4K5rgxp_yQUO1SdyBtw3oWFE3VRy9LtFjBM_h0yO2K_97osfjDJR946eFEyrFG6NHIZj0VDYCckzAHco5FRFxu8tfhjAMCtEKJXj8V7W7NxjyHZzf98HGnUP8DpfKGjqiwCwkI7JqpxcorWE-FyuTFSuZrljSvYmkpC3TIuK6u1B1-oFCnggQ2vgBOH05-PJ6VkHfAOuldwqbcv_xgADIuWetzclq5pCnxmGb67b17tMvGkw23ONO5_igI1U350YZMhVxtcrVBICqGwRSXdFTtDQeMV0TsFDNgklpUMTwDQNgtnMH5m17z-VlgYrEpc6DjFyW4JfFYnE1aoMmGISXKGrxzP5_muE9Tib7MyqyfhJ9uC39AZPzEUZscU-pUNEk_el3BFuh0GwiTK2iMOAAmgbUYZsU1urwvmzhIIC5k-bXFMg5rjAaWcvcHrQ_6UmuE8gZF98FK1Qan4R4h4_BrTOWvn7fzgjyIulh3oDtsEeRYzo8H1ry9atN0Sc\"}}","peer":"10.222.79.55-29440-a54cf14d-275f-4928-9eda-d92eb8197e4e","component":"transport","trace":"ec6cdd1a4151a9def5b5d30dcdaf66ca","task":"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320"}

559:{"level":"debug","ts":"2024-05-29 08:16:14.395","caller":"peer/peertask_manager.go:239","msg":"peer task created: 911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320/10.222.79.55-29440-a54cf14d-275f-4928-9eda-d92eb8197e4e"}

560:{"level":"debug","ts":"2024-05-29 08:16:14.395","caller":"storage/storage_manager.go:430","msg":"init local task storage, peer id: 10.222.79.55-29440-a54cf14d-275f-4928-9eda-d92eb8197e4e, task id: 911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320"}

561:{"level":"debug","ts":"2024-05-29 08:16:14.395","caller":"peer/peertask_conductor.go:256","msg":"request overview, pid: 10.222.79.55-29440-a54cf14d-275f-4928-9eda-d92eb8197e4e, url: https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:fec9938e9c9cf860b9dcb7f9cf8885d1341a70e7d89bc5305056a9b1bdf76fcf?ns=harbor.test.wifi.com, filter: Expires&Signature&ns, tag: , range: , digest: , header: map[string]string{\"Accept\":\"application/vnd.docker.image.rootfs.diff.tar.gzip, */*\", \"Authorization\":\"Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IjdXTUE6S1ZYTzpLRjI1OjM1TkE6R0ozNTpaR0tZOlBHWVQ6STVVVDpUR1dZOlVVSTQ6UFQ3WjpYM0tXIiwidHlwIjoiSldUIn0.eyJhdWQiOiJoYXJib3ItcmVnaXN0cnkiLCJleHAiOjE3MTY5NzIzNzMsImp0aSI6Ijk2M1RYWXhCRk5jT3J2N2IiLCJpYXQiOjE3MTY5NzA1NzMsImlzcyI6ImhhcmJvci10b2tlbi1pc3N1ZXIiLCJuYmYiOjE3MTY5NzA1NzMsImFjY2VzcyI6W3sidHlwZSI6InJlcG9zaXRvcnkiLCJuYW1lIjoiaW5pdC1pbWFnZXMvYmlnZGF0YS0xMCIsImFjdGlvbnMiOlsicHVsbCJdfV19.qyrx7hrfALfKGeCyrHmj1-scnNAG-YIvVB0eawghGahzcovKSK8NrD4q44s5wq7LSZJLZmdTUcqLkoIs8dQ6jJqZ3JBpNtCd5D97j1gLk4gtKMs4omsJFIlE-zWqXZEfi9ouQXAWVp1_FNR-M0lGRj8-hrRaU85Z6bcAEBR3g0cIKSw4K5rgxp_yQUO1SdyBtw3oWFE3VRy9LtFjBM_h0yO2K_97osfjDJR946eFEyrFG6NHIZj0VDYCckzAHco5FRFxu8tfhjAMCtEKJXj8V7W7NxjyHZzf98HGnUP8DpfKGjqiwCwkI7JqpxcorWE-FyuTFSuZrljSvYmkpC3TIuK6u1B1-oFCnggQ2vgBOH05-PJ6VkHfAOuldwqbcv_xgADIuWetzclq5pCnxmGb67b17tMvGkw23ONO5_igI1U350YZMhVxtcrVBICqGwRSXdFTtDQeMV0TsFDNgklpUMTwDQNgtnMH5m17z-VlgYrEpc6DjFyW4JfFYnE1aoMmGISXKGrxzP5_muE9Tib7MyqyfhJ9uC39AZPzEUZscU-pUNEk_el3BFuh0GwiTK2iMOAAmgbUYZsU1urwvmzhIIC5k-bXFMg5rjAaWcvcHrQ_6UmuE8gZF98FK1Qan4R4h4_BrTOWvn7fzgjyIulh3oDtsEeRYzo8H1ry9atN0Sc\"}","peer":"10.222.79.55-29440-a54cf14d-275f-4928-9eda-d92eb8197e4e","task":"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320","component":"PeerTask","trace":"ec6cdd1a4151a9def5b5d30dcdaf66ca"}

562:{"level":"info","ts":"2024-05-29 08:16:14.395","caller":"peer/peertask_conductor.go:270","msg":"step 1: peer 10.222.79.55-29440-a54cf14d-275f-4928-9eda-d92eb8197e4e start to register","peer":"10.222.79.55-29440-a54cf14d-275f-4928-9eda-d92eb8197e4e","task":"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320","component":"PeerTask","trace":"ec6cdd1a4151a9def5b5d30dcdaf66ca"}

563:{"level":"info","ts":"2024-05-29 08:16:14.396","caller":"peer/peertask_conductor.go:296","msg":"register task success, SizeScope: NORMAL","peer":"10.222.79.55-29440-a54cf14d-275f-4928-9eda-d92eb8197e4e","task":"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320","component":"PeerTask","trace":"ec6cdd1a4151a9def5b5d30dcdaf66ca"}

564:{"level":"info","ts":"2024-05-29 08:16:14.396","caller":"peer/peertask_conductor.go:347","msg":"step 2: start report piece result","peer":"10.222.79.55-29440-a54cf14d-275f-4928-9eda-d92eb8197e4e","task":"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320","component":"PeerTask","trace":"ec6cdd1a4151a9def5b5d30dcdaf66ca"}

565:{"level":"debug","ts":"2024-05-29 08:16:14.396","caller":"peer/piece_dispatcher.go:85","msg":"piece dispatcher created","peer":"10.222.79.55-29440-a54cf14d-275f-4928-9eda-d92eb8197e4e","task":"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320","component":"PeerTask","trace":"ec6cdd1a4151a9def5b5d30dcdaf66ca"}

566:{"level":"debug","ts":"2024-05-29 08:16:15.097","caller":"peer/peertask_conductor.go:729","msg":"receive peerPacket task_id:\"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320\" src_pid:\"10.222.79.55-29440-a54cf14d-275f-4928-9eda-d92eb8197e4e\" main_peer:{ip:\"10.222.79.36\" rpc_port:65000 peer_id:\"10.222.79.36-1-108a160c-4be8-45b0-be90-5e14427cc146_Seed\"} code:Success","peer":"10.222.79.55-29440-a54cf14d-275f-4928-9eda-d92eb8197e4e","task":"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320","component":"PeerTask","trace":"ec6cdd1a4151a9def5b5d30dcdaf66ca"}

jarger ui info:

image image image

dfdaemon core.log file:

55.18-core.log

@gaius-qi

Can you make sure preheat task has the same task id with download task?

mansoncui commented 1 month ago

@mansoncui Please search the log by and make sure the Peer download task is a preheating task from the Seed Peer.task id


##download node storage info

 # ls /var/lib/dragonfly/ -l

total 24

drwx------    3 root     root          4096 May 29 08:03 11380641533ae269c6c83600885430f0d3913db6d5c4bda965cb0ab08dcbc9be

drwx------    3 root     root          4096 May 29 08:03 74bf488eee38a9c853547f340b5154d46ffc5051e216f1b097296626dc0e2abd

drwx------    3 root     root          4096 May 29 08:16 911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320

drwx------    3 root     root          4096 May 29 08:30 9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b

drwx------    3 root     root          4096 May 29 08:16 e1697ef5bc877913be3673a58f8e6a91ec807039b14790171170a3a1b3078db6

drwx------    3 root     root          4096 May 29 08:30 f5cd5868a3a7f3572307f669c303f49e4e3960bac2b26e473bfd08c16849e58b

peer core.log 信息


/ # grep -rn "911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320" /var/log/dragonfly/daemon/core.log  | head -10

557:{"level":"info","ts":"2024-05-29 08:16:14.395","caller":"transport/transport.go:306","msg":"start download with url: https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:fec9938e9c9cf860b9dcb7f9cf8885d1341a70e7d89bc5305056a9b1bdf76fcf?ns=harbor.test.wifi.com","peer":"10.222.79.55-29440-a54cf14d-275f-4928-9eda-d92eb8197e4e","component":"transport","trace":"ec6cdd1a4151a9def5b5d30dcdaf66ca","task":"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320"}

558:{"level":"debug","ts":"2024-05-29 08:16:14.395","caller":"transport/transport.go:307","msg":"request url: https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:fec9938e9c9cf860b9dcb7f9cf8885d1341a70e7d89bc5305056a9b1bdf76fcf?ns=harbor.test.wifi.com, with header: http.Header{\"Accept\":[]string{\"application/vnd.docker.image.rootfs.diff.tar.gzip, */*\"}, \"Authorization\":[]string{\"Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IjdXTUE6S1ZYTzpLRjI1OjM1TkE6R0ozNTpaR0tZOlBHWVQ6STVVVDpUR1dZOlVVSTQ6UFQ3WjpYM0tXIiwidHlwIjoiSldUIn0.eyJhdWQiOiJoYXJib3ItcmVnaXN0cnkiLCJleHAiOjE3MTY5NzIzNzMsImp0aSI6Ijk2M1RYWXhCRk5jT3J2N2IiLCJpYXQiOjE3MTY5NzA1NzMsImlzcyI6ImhhcmJvci10b2tlbi1pc3N1ZXIiLCJuYmYiOjE3MTY5NzA1NzMsImFjY2VzcyI6W3sidHlwZSI6InJlcG9zaXRvcnkiLCJuYW1lIjoiaW5pdC1pbWFnZXMvYmlnZGF0YS0xMCIsImFjdGlvbnMiOlsicHVsbCJdfV19.qyrx7hrfALfKGeCyrHmj1-scnNAG-YIvVB0eawghGahzcovKSK8NrD4q44s5wq7LSZJLZmdTUcqLkoIs8dQ6jJqZ3JBpNtCd5D97j1gLk4gtKMs4omsJFIlE-zWqXZEfi9ouQXAWVp1_FNR-M0lGRj8-hrRaU85Z6bcAEBR3g0cIKSw4K5rgxp_yQUO1SdyBtw3oWFE3VRy9LtFjBM_h0yO2K_97osfjDJR946eFEyrFG6NHIZj0VDYCckzAHco5FRFxu8tfhjAMCtEKJXj8V7W7NxjyHZzf98HGnUP8DpfKGjqiwCwkI7JqpxcorWE-FyuTFSuZrljSvYmkpC3TIuK6u1B1-oFCnggQ2vgBOH05-PJ6VkHfAOuldwqbcv_xgADIuWetzclq5pCnxmGb67b17tMvGkw23ONO5_igI1U350YZMhVxtcrVBICqGwRSXdFTtDQeMV0TsFDNgklpUMTwDQNgtnMH5m17z-VlgYrEpc6DjFyW4JfFYnE1aoMmGISXKGrxzP5_muE9Tib7MyqyfhJ9uC39AZPzEUZscU-pUNEk_el3BFuh0GwiTK2iMOAAmgbUYZsU1urwvmzhIIC5k-bXFMg5rjAaWcvcHrQ_6UmuE8gZF98FK1Qan4R4h4_BrTOWvn7fzgjyIulh3oDtsEeRYzo8H1ry9atN0Sc\"}}","peer":"10.222.79.55-29440-a54cf14d-275f-4928-9eda-d92eb8197e4e","component":"transport","trace":"ec6cdd1a4151a9def5b5d30dcdaf66ca","task":"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320"}

559:{"level":"debug","ts":"2024-05-29 08:16:14.395","caller":"peer/peertask_manager.go:239","msg":"peer task created: 911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320/10.222.79.55-29440-a54cf14d-275f-4928-9eda-d92eb8197e4e"}

560:{"level":"debug","ts":"2024-05-29 08:16:14.395","caller":"storage/storage_manager.go:430","msg":"init local task storage, peer id: 10.222.79.55-29440-a54cf14d-275f-4928-9eda-d92eb8197e4e, task id: 911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320"}

561:{"level":"debug","ts":"2024-05-29 08:16:14.395","caller":"peer/peertask_conductor.go:256","msg":"request overview, pid: 10.222.79.55-29440-a54cf14d-275f-4928-9eda-d92eb8197e4e, url: https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:fec9938e9c9cf860b9dcb7f9cf8885d1341a70e7d89bc5305056a9b1bdf76fcf?ns=harbor.test.wifi.com, filter: Expires&Signature&ns, tag: , range: , digest: , header: map[string]string{\"Accept\":\"application/vnd.docker.image.rootfs.diff.tar.gzip, */*\", \"Authorization\":\"Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IjdXTUE6S1ZYTzpLRjI1OjM1TkE6R0ozNTpaR0tZOlBHWVQ6STVVVDpUR1dZOlVVSTQ6UFQ3WjpYM0tXIiwidHlwIjoiSldUIn0.eyJhdWQiOiJoYXJib3ItcmVnaXN0cnkiLCJleHAiOjE3MTY5NzIzNzMsImp0aSI6Ijk2M1RYWXhCRk5jT3J2N2IiLCJpYXQiOjE3MTY5NzA1NzMsImlzcyI6ImhhcmJvci10b2tlbi1pc3N1ZXIiLCJuYmYiOjE3MTY5NzA1NzMsImFjY2VzcyI6W3sidHlwZSI6InJlcG9zaXRvcnkiLCJuYW1lIjoiaW5pdC1pbWFnZXMvYmlnZGF0YS0xMCIsImFjdGlvbnMiOlsicHVsbCJdfV19.qyrx7hrfALfKGeCyrHmj1-scnNAG-YIvVB0eawghGahzcovKSK8NrD4q44s5wq7LSZJLZmdTUcqLkoIs8dQ6jJqZ3JBpNtCd5D97j1gLk4gtKMs4omsJFIlE-zWqXZEfi9ouQXAWVp1_FNR-M0lGRj8-hrRaU85Z6bcAEBR3g0cIKSw4K5rgxp_yQUO1SdyBtw3oWFE3VRy9LtFjBM_h0yO2K_97osfjDJR946eFEyrFG6NHIZj0VDYCckzAHco5FRFxu8tfhjAMCtEKJXj8V7W7NxjyHZzf98HGnUP8DpfKGjqiwCwkI7JqpxcorWE-FyuTFSuZrljSvYmkpC3TIuK6u1B1-oFCnggQ2vgBOH05-PJ6VkHfAOuldwqbcv_xgADIuWetzclq5pCnxmGb67b17tMvGkw23ONO5_igI1U350YZMhVxtcrVBICqGwRSXdFTtDQeMV0TsFDNgklpUMTwDQNgtnMH5m17z-VlgYrEpc6DjFyW4JfFYnE1aoMmGISXKGrxzP5_muE9Tib7MyqyfhJ9uC39AZPzEUZscU-pUNEk_el3BFuh0GwiTK2iMOAAmgbUYZsU1urwvmzhIIC5k-bXFMg5rjAaWcvcHrQ_6UmuE8gZF98FK1Qan4R4h4_BrTOWvn7fzgjyIulh3oDtsEeRYzo8H1ry9atN0Sc\"}","peer":"10.222.79.55-29440-a54cf14d-275f-4928-9eda-d92eb8197e4e","task":"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320","component":"PeerTask","trace":"ec6cdd1a4151a9def5b5d30dcdaf66ca"}

562:{"level":"info","ts":"2024-05-29 08:16:14.395","caller":"peer/peertask_conductor.go:270","msg":"step 1: peer 10.222.79.55-29440-a54cf14d-275f-4928-9eda-d92eb8197e4e start to register","peer":"10.222.79.55-29440-a54cf14d-275f-4928-9eda-d92eb8197e4e","task":"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320","component":"PeerTask","trace":"ec6cdd1a4151a9def5b5d30dcdaf66ca"}

563:{"level":"info","ts":"2024-05-29 08:16:14.396","caller":"peer/peertask_conductor.go:296","msg":"register task success, SizeScope: NORMAL","peer":"10.222.79.55-29440-a54cf14d-275f-4928-9eda-d92eb8197e4e","task":"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320","component":"PeerTask","trace":"ec6cdd1a4151a9def5b5d30dcdaf66ca"}

564:{"level":"info","ts":"2024-05-29 08:16:14.396","caller":"peer/peertask_conductor.go:347","msg":"step 2: start report piece result","peer":"10.222.79.55-29440-a54cf14d-275f-4928-9eda-d92eb8197e4e","task":"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320","component":"PeerTask","trace":"ec6cdd1a4151a9def5b5d30dcdaf66ca"}

565:{"level":"debug","ts":"2024-05-29 08:16:14.396","caller":"peer/piece_dispatcher.go:85","msg":"piece dispatcher created","peer":"10.222.79.55-29440-a54cf14d-275f-4928-9eda-d92eb8197e4e","task":"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320","component":"PeerTask","trace":"ec6cdd1a4151a9def5b5d30dcdaf66ca"}

566:{"level":"debug","ts":"2024-05-29 08:16:15.097","caller":"peer/peertask_conductor.go:729","msg":"receive peerPacket task_id:\"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320\" src_pid:\"10.222.79.55-29440-a54cf14d-275f-4928-9eda-d92eb8197e4e\" main_peer:{ip:\"10.222.79.36\" rpc_port:65000 peer_id:\"10.222.79.36-1-108a160c-4be8-45b0-be90-5e14427cc146_Seed\"} code:Success","peer":"10.222.79.55-29440-a54cf14d-275f-4928-9eda-d92eb8197e4e","task":"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320","component":"PeerTask","trace":"ec6cdd1a4151a9def5b5d30dcdaf66ca"}

jarger ui info:

image image image

dfdaemon core.log file: 55.18-core.log @gaius-qi

Can you make sure preheat task has the same task id with download task?

911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320 The task id is associated with the seed peer and dfdaemon, including persisting data to the local disk /var/lib/dragonfly @gaius-qi

mansoncui commented 1 month ago

Download image can confirm that dfdaemon is downloaded from the seed peer

nginx pod yaml config:

apiVersion: apps/v1
kind: Deployment
metadata :
  name: nginx
  labels:
    app: nginx
spec:
  replicas: 1
  selector:
    matchLabels:
      app: nginx
  minReadySeconds: 5
  strategy:
    type: Recreate
  template:
    metadata:
      annotations:
        cni.projectcalico.org/ipv4pools: '["ipam-out-pool"]'
      labels:
        app: nginx
    spec:
      containers:
      - name: nginx
        image: harbor.test.wifi.com/init-images/bigdata-1:latest
        resources:
          requests:
            memory: "100Mi"
          limits:
            memory: "150Mi"
        ports:
        - containerPort: 18080
          name: web-18080
        - containerPort: 80
          name: web

dfdaemon core.log taskid: 9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b

# grep "2024-05-30 07:12:52" /var/log/dragonfly/daemon/core.log 
{"level":"debug","ts":"2024-05-30 07:12:52.044","caller":"transport/transport.go:214","msg":"round trip directly, method: GET, url: https://harbor.test.wifi.com/v2/init-images/bigdata-1/manifests/sha256:c82398be5c1dbb44af983ce4726e0985a4f82ca0aa2c683571743378a5e55790?ns=harbor.test.wifi.com"}
{"level":"debug","ts":"2024-05-30 07:12:52.118","caller":"transport/transport.go:214","msg":"round trip directly, method: GET, url: https://harbor.test.wifi.com/v2/init-images/bigdata-1/manifests/sha256:c82398be5c1dbb44af983ce4726e0985a4f82ca0aa2c683571743378a5e55790?ns=harbor.test.wifi.com"}
{"level":"debug","ts":"2024-05-30 07:12:52.279","caller":"transport/transport.go:210","msg":"round trip with dragonfly: https://harbor.test.wifi.com/v2/init-images/bigdata-1/blobs/sha256:66c53c87a77e97d31723542c6839ab78318c3e45cd1b49f59274691af5858f97?ns=harbor.test.wifi.com"}
{"level":"info","ts":"2024-05-30 07:12:52.279","caller":"transport/transport.go:306","msg":"start download with url: https://harbor.test.wifi.com/v2/init-images/bigdata-1/blobs/sha256:66c53c87a77e97d31723542c6839ab78318c3e45cd1b49f59274691af5858f97?ns=harbor.test.wifi.com","peer":"10.222.79.7-19101-5ba35686-5e5e-4eab-81b4-615bfad4ac53","component":"transport","trace":"af4c36a91258047d6d4d3b9a8b48e58e","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b"}
{"level":"debug","ts":"2024-05-30 07:12:52.279","caller":"transport/transport.go:307","msg":"request url: https://harbor.test.wifi.com/v2/init-images/bigdata-1/blobs/sha256:66c53c87a77e97d31723542c6839ab78318c3e45cd1b49f59274691af5858f97?ns=harbor.test.wifi.com, with header: http.Header{\"Accept\":[]string{\"application/vnd.docker.container.image.v1+json, */*\"}, \"Authorization\":[]string{\"Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IjdXTUE6S1ZYTzpLRjI1OjM1TkE6R0ozNTpaR0tZOlBHWVQ6STVVVDpUR1dZOlVVSTQ6UFQ3WjpYM0tXIiwidHlwIjoiSldUIn0.eyJhdWQiOiJoYXJib3ItcmVnaXN0cnkiLCJleHAiOjE3MTcwNTQ5NzIsImp0aSI6Ik5yRDZuNklnYkRYWUdjeXUiLCJpYXQiOjE3MTcwNTMxNzIsImlzcyI6ImhhcmJvci10b2tlbi1pc3N1ZXIiLCJuYmYiOjE3MTcwNTMxNzIsImFjY2VzcyI6W3sidHlwZSI6InJlcG9zaXRvcnkiLCJuYW1lIjoiaW5pdC1pbWFnZXMvYmlnZGF0YS0xIiwiYWN0aW9ucyI6WyJwdWxsIl19XX0.I4P4AfBPQBCizA9mwNvzWtrAnJx7hqs3icQMPRJX5JDkFPSQZEACQr2vPil7hjDNjJCtSX_ub-ElzzKAgHXu1K0w01DHGI8v3_HuCapRZIZMBadn5iCFehDiE-qZqwayGs2R0TIc7NlJXrKPO_WnI2QedWmgUT3HAA1hq7dIBhah7RmsQyxmpNQgfEnHUnvKnOmLfTb8y0jW_BO11F4cxL1-oqjfNBHC5kw20Nk_grS32W2YAFhf0ZTLRLTSStz3ZSoGAq9c-kAx1-SWz4hFRhhAU1K70fESRrIDyyn5IcTVWYmqxApl9j6VV632siR_Lx8pZyQE5IzTad6GAzmkdGDLn5c8ikv97V7RiIg7LNk5ci3q3j3lM7cW_jst6xIEVu0uEjnhIPVCcmwMTsVnLEAyy5kFwgvj8M26n6zAAVhqDlGtBopaXStH9AIyKts5Sj5mPSCbNsqHSruKCkCTisFxMgxRhGhLo-nU2HeZNsmONsB1FfVxFnk2xGDljYgatTO76A4_zrstWcWnlJMeZBMo58oP6x-u1T9aEUUlTryc2IyVREyRxfn8ugDyFMiUQdu5mvMOW4cAyxpqqw6kanM1whN8BQTkdY7CKVyB6fW7lW7pVzVMrzbZljnj5VoyoIhtkgbgapu_77Dl91_qLGALwJDxwjX1OarncBxcSZc\"}}","peer":"10.222.79.7-19101-5ba35686-5e5e-4eab-81b4-615bfad4ac53","component":"transport","trace":"af4c36a91258047d6d4d3b9a8b48e58e","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b"}
{"level":"debug","ts":"2024-05-30 07:12:52.280","caller":"peer/peertask_manager.go:239","msg":"peer task created: 9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b/10.222.79.7-19101-5ba35686-5e5e-4eab-81b4-615bfad4ac53"}
{"level":"debug","ts":"2024-05-30 07:12:52.280","caller":"storage/storage_manager.go:430","msg":"init local task storage, peer id: 10.222.79.7-19101-5ba35686-5e5e-4eab-81b4-615bfad4ac53, task id: 9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b"}
{"level":"debug","ts":"2024-05-30 07:12:52.280","caller":"peer/peertask_conductor.go:256","msg":"request overview, pid: 10.222.79.7-19101-5ba35686-5e5e-4eab-81b4-615bfad4ac53, url: https://harbor.test.wifi.com/v2/init-images/bigdata-1/blobs/sha256:66c53c87a77e97d31723542c6839ab78318c3e45cd1b49f59274691af5858f97?ns=harbor.test.wifi.com, filter: Expires&Signature&ns, tag: , range: , digest: , header: map[string]string{\"Accept\":\"application/vnd.docker.container.image.v1+json, */*\", \"Authorization\":\"Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IjdXTUE6S1ZYTzpLRjI1OjM1TkE6R0ozNTpaR0tZOlBHWVQ6STVVVDpUR1dZOlVVSTQ6UFQ3WjpYM0tXIiwidHlwIjoiSldUIn0.eyJhdWQiOiJoYXJib3ItcmVnaXN0cnkiLCJleHAiOjE3MTcwNTQ5NzIsImp0aSI6Ik5yRDZuNklnYkRYWUdjeXUiLCJpYXQiOjE3MTcwNTMxNzIsImlzcyI6ImhhcmJvci10b2tlbi1pc3N1ZXIiLCJuYmYiOjE3MTcwNTMxNzIsImFjY2VzcyI6W3sidHlwZSI6InJlcG9zaXRvcnkiLCJuYW1lIjoiaW5pdC1pbWFnZXMvYmlnZGF0YS0xIiwiYWN0aW9ucyI6WyJwdWxsIl19XX0.I4P4AfBPQBCizA9mwNvzWtrAnJx7hqs3icQMPRJX5JDkFPSQZEACQr2vPil7hjDNjJCtSX_ub-ElzzKAgHXu1K0w01DHGI8v3_HuCapRZIZMBadn5iCFehDiE-qZqwayGs2R0TIc7NlJXrKPO_WnI2QedWmgUT3HAA1hq7dIBhah7RmsQyxmpNQgfEnHUnvKnOmLfTb8y0jW_BO11F4cxL1-oqjfNBHC5kw20Nk_grS32W2YAFhf0ZTLRLTSStz3ZSoGAq9c-kAx1-SWz4hFRhhAU1K70fESRrIDyyn5IcTVWYmqxApl9j6VV632siR_Lx8pZyQE5IzTad6GAzmkdGDLn5c8ikv97V7RiIg7LNk5ci3q3j3lM7cW_jst6xIEVu0uEjnhIPVCcmwMTsVnLEAyy5kFwgvj8M26n6zAAVhqDlGtBopaXStH9AIyKts5Sj5mPSCbNsqHSruKCkCTisFxMgxRhGhLo-nU2HeZNsmONsB1FfVxFnk2xGDljYgatTO76A4_zrstWcWnlJMeZBMo58oP6x-u1T9aEUUlTryc2IyVREyRxfn8ugDyFMiUQdu5mvMOW4cAyxpqqw6kanM1whN8BQTkdY7CKVyB6fW7lW7pVzVMrzbZljnj5VoyoIhtkgbgapu_77Dl91_qLGALwJDxwjX1OarncBxcSZc\"}","peer":"10.222.79.7-19101-5ba35686-5e5e-4eab-81b4-615bfad4ac53","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","component":"PeerTask","trace":"af4c36a91258047d6d4d3b9a8b48e58e"}
{"level":"info","ts":"2024-05-30 07:12:52.280","caller":"peer/peertask_conductor.go:270","msg":"step 1: peer 10.222.79.7-19101-5ba35686-5e5e-4eab-81b4-615bfad4ac53 start to register","peer":"10.222.79.7-19101-5ba35686-5e5e-4eab-81b4-615bfad4ac53","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","component":"PeerTask","trace":"af4c36a91258047d6d4d3b9a8b48e58e"}
{"level":"info","ts":"2024-05-30 07:12:52.282","caller":"peer/peertask_conductor.go:296","msg":"register task success, SizeScope: NORMAL","peer":"10.222.79.7-19101-5ba35686-5e5e-4eab-81b4-615bfad4ac53","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","component":"PeerTask","trace":"af4c36a91258047d6d4d3b9a8b48e58e"}
{"level":"info","ts":"2024-05-30 07:12:52.282","caller":"peer/peertask_conductor.go:347","msg":"step 2: start report piece result","peer":"10.222.79.7-19101-5ba35686-5e5e-4eab-81b4-615bfad4ac53","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","component":"PeerTask","trace":"af4c36a91258047d6d4d3b9a8b48e58e"}
{"level":"debug","ts":"2024-05-30 07:12:52.282","caller":"peer/piece_dispatcher.go:85","msg":"piece dispatcher created","peer":"10.222.79.7-19101-5ba35686-5e5e-4eab-81b4-615bfad4ac53","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","component":"PeerTask","trace":"af4c36a91258047d6d4d3b9a8b48e58e"}
{"level":"debug","ts":"2024-05-30 07:12:52.983","caller":"peer/peertask_conductor.go:729","msg":"receive peerPacket task_id:\"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b\" src_pid:\"10.222.79.7-19101-5ba35686-5e5e-4eab-81b4-615bfad4ac53\" main_peer:{ip:\"10.222.79.36\" rpc_port:65000 peer_id:\"10.222.79.36-1-bc77a653-1d9a-4b21-b2f8-42d6aad3b96b_Seed\"} code:Success","peer":"10.222.79.7-19101-5ba35686-5e5e-4eab-81b4-615bfad4ac53","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","component":"PeerTask","trace":"af4c36a91258047d6d4d3b9a8b48e58e"}
{"level":"info","ts":"2024-05-30 07:12:52.984","caller":"peer/peertask_conductor.go:762","msg":"receive new peer packet, main peer: 10.222.79.36-1-bc77a653-1d9a-4b21-b2f8-42d6aad3b96b_Seed","peer":"10.222.79.7-19101-5ba35686-5e5e-4eab-81b4-615bfad4ac53","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","component":"PeerTask","trace":"af4c36a91258047d6d4d3b9a8b48e58e"}
{"level":"info","ts":"2024-05-30 07:12:52.984","caller":"peer/peertask_piecetask_synchronizer.go:188","msg":"start new watchdog","peer":"10.222.79.7-19101-5ba35686-5e5e-4eab-81b4-615bfad4ac53","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","component":"PeerTask","trace":"af4c36a91258047d6d4d3b9a8b48e58e"}
{"level":"debug","ts":"2024-05-30 07:12:52.984","caller":"peer/peertask_conductor.go:1024","msg":"first peer packet received","peer":"10.222.79.7-19101-5ba35686-5e5e-4eab-81b4-615bfad4ac53","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","component":"PeerTask","trace":"af4c36a91258047d6d4d3b9a8b48e58e"}
{"level":"debug","ts":"2024-05-30 07:12:52.985","caller":"peer/peertask_conductor.go:968","msg":"update total piece count: 1, dst peer 10.222.79.36-1-bc77a653-1d9a-4b21-b2f8-42d6aad3b96b_Seed","peer":"10.222.79.7-19101-5ba35686-5e5e-4eab-81b4-615bfad4ac53","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","component":"PeerTask","trace":"af4c36a91258047d6d4d3b9a8b48e58e"}
{"level":"debug","ts":"2024-05-30 07:12:52.985","caller":"peer/peertask_conductor.go:975","msg":"update digest: 57e55b5a3b9c6d4f327b570bd2e84c750c42e590f1b848e73a38c4338a049f13, dst peer 10.222.79.36-1-bc77a653-1d9a-4b21-b2f8-42d6aad3b96b_Seed","peer":"10.222.79.7-19101-5ba35686-5e5e-4eab-81b4-615bfad4ac53","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","component":"PeerTask","trace":"af4c36a91258047d6d4d3b9a8b48e58e"}
{"level":"debug","ts":"2024-05-30 07:12:52.985","caller":"peer/peertask_conductor.go:983","msg":"update content length: 9728, dst peer 10.222.79.36-1-bc77a653-1d9a-4b21-b2f8-42d6aad3b96b_Seed","peer":"10.222.79.7-19101-5ba35686-5e5e-4eab-81b4-615bfad4ac53","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","component":"PeerTask","trace":"af4c36a91258047d6d4d3b9a8b48e58e"}
{"level":"debug","ts":"2024-05-30 07:12:52.985","caller":"peer/peertask_conductor.go:996","msg":"update response header: map[string]string{\"Content-Type\":\"application/octet-stream\", \"Etag\":\"\\\"sha256:66c53c87a77e97d31723542c6839ab78318c3e45cd1b49f59274691af5858f97\\\"\"}, dst peer 10.222.79.36-1-bc77a653-1d9a-4b21-b2f8-42d6aad3b96b_Seed","peer":"10.222.79.7-19101-5ba35686-5e5e-4eab-81b4-615bfad4ac53","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","component":"PeerTask","trace":"af4c36a91258047d6d4d3b9a8b48e58e"}
{"level":"debug","ts":"2024-05-30 07:12:52.985","caller":"storage/local_storage.go:225","msg":"update content length: 9728","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","peer":"10.222.79.7-19101-5ba35686-5e5e-4eab-81b4-615bfad4ac53","component":"localTaskStore"}
{"level":"debug","ts":"2024-05-30 07:12:52.985","caller":"storage/local_storage.go:234","msg":"update total pieces: 1","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","peer":"10.222.79.7-19101-5ba35686-5e5e-4eab-81b4-615bfad4ac53","component":"localTaskStore"}
{"level":"debug","ts":"2024-05-30 07:12:52.985","caller":"storage/local_storage.go:238","msg":"update piece md5 sign: 57e55b5a3b9c6d4f327b570bd2e84c750c42e590f1b848e73a38c4338a049f13","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","peer":"10.222.79.7-19101-5ba35686-5e5e-4eab-81b4-615bfad4ac53","component":"localTaskStore"}
{"level":"debug","ts":"2024-05-30 07:12:52.985","caller":"storage/local_storage.go:242","msg":"update header: &source.Header{\"Content-Type\":[]string{\"application/octet-stream\"}, \"Etag\":[]string{\"\\\"sha256:66c53c87a77e97d31723542c6839ab78318c3e45cd1b49f59274691af5858f97\\\"\"}}","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","peer":"10.222.79.7-19101-5ba35686-5e5e-4eab-81b4-615bfad4ac53","component":"localTaskStore"}
{"level":"debug","ts":"2024-05-30 07:12:52.986","caller":"peer/peertask_piecetask_synchronizer.go:347","msg":"dispatch piece request, piece count: 1, dest peer: 10.222.79.36-1-bc77a653-1d9a-4b21-b2f8-42d6aad3b96b_Seed","targetPeerID":"10.222.79.36-1-bc77a653-1d9a-4b21-b2f8-42d6aad3b96b_Seed","peer":"10.222.79.7-19101-5ba35686-5e5e-4eab-81b4-615bfad4ac53","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","component":"PeerTask","trace":"af4c36a91258047d6d4d3b9a8b48e58e"}
{"level":"info","ts":"2024-05-30 07:12:52.986","caller":"peer/peertask_piecetask_synchronizer.go:357","msg":"got piece 0 from 10.222.79.36:65002/10.222.79.36-1-bc77a653-1d9a-4b21-b2f8-42d6aad3b96b_Seed, digest: ec8ed431497bd0c44c9677949cab945d, start: 0, size: 9728","targetPeerID":"10.222.79.36-1-bc77a653-1d9a-4b21-b2f8-42d6aad3b96b_Seed","peer":"10.222.79.7-19101-5ba35686-5e5e-4eab-81b4-615bfad4ac53","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","component":"PeerTask","trace":"af4c36a91258047d6d4d3b9a8b48e58e"}
{"level":"debug","ts":"2024-05-30 07:12:52.986","caller":"peer/peertask_conductor.go:1106","msg":"peer download worker #3 receive piece task, dest peer id: 10.222.79.36-1-bc77a653-1d9a-4b21-b2f8-42d6aad3b96b_Seed, piece num: 0, range start: 0, range size: 9728","peer":"10.222.79.7-19101-5ba35686-5e5e-4eab-81b4-615bfad4ac53","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","component":"PeerTask","trace":"af4c36a91258047d6d4d3b9a8b48e58e"}
{"level":"debug","ts":"2024-05-30 07:12:52.986","caller":"peer/piece_downloader.go:216","msg":"built request url: http://10.222.79.36:65002/download/9a7/9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b?peerId=10.222.79.36-1-bc77a653-1d9a-4b21-b2f8-42d6aad3b96b_Seed"}
{"level":"debug","ts":"2024-05-30 07:12:52.988","caller":"peer/piece_downloader.go:193","msg":"calculate digest for piece 0, digest: ec8ed431497bd0c44c9677949cab945d","peer":"10.222.79.7-19101-5ba35686-5e5e-4eab-81b4-615bfad4ac53","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","component":"PeerTask","trace":"af4c36a91258047d6d4d3b9a8b48e58e"}
{"level":"debug","ts":"2024-05-30 07:12:52.988","caller":"digest/digest_reader.go:113","msg":"digest encoded match: ec8ed431497bd0c44c9677949cab945d","peer":"10.222.79.7-19101-5ba35686-5e5e-4eab-81b4-615bfad4ac53","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","component":"PeerTask","trace":"af4c36a91258047d6d4d3b9a8b48e58e"}
{"level":"debug","ts":"2024-05-30 07:12:52.988","caller":"storage/local_storage.go:182","msg":"wrote 9728 bytes to file /var/lib/dragonfly/9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b/10.222.79.7-19101-5ba35686-5e5e-4eab-81b4-615bfad4ac53/data, piece 0, start 0, length: 9728","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","peer":"10.222.79.7-19101-5ba35686-5e5e-4eab-81b4-615bfad4ac53","component":"localTaskStore"}
{"level":"info","ts":"2024-05-30 07:12:52.988","caller":"peer/peertask_conductor.go:1173","msg":"completed content length: 9728","peer":"10.222.79.7-19101-5ba35686-5e5e-4eab-81b4-615bfad4ac53","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","component":"PeerTask","trace":"af4c36a91258047d6d4d3b9a8b48e58e"}
{"level":"info","ts":"2024-05-30 07:12:52.988","caller":"peer/peertask_conductor.go:1383","msg":"peer task done, cost: 708ms","peer":"10.222.79.7-19101-5ba35686-5e5e-4eab-81b4-615bfad4ac53","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","component":"PeerTask","trace":"af4c36a91258047d6d4d3b9a8b48e58e"}
{"level":"debug","ts":"2024-05-30 07:12:52.988","caller":"storage/local_storage.go:234","msg":"update total pieces: 1","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","peer":"10.222.79.7-19101-5ba35686-5e5e-4eab-81b4-615bfad4ac53","component":"localTaskStore"}
{"level":"debug","ts":"2024-05-30 07:12:52.988","caller":"peer/peertask_conductor.go:1601","msg":"validate digest ok","peer":"10.222.79.7-19101-5ba35686-5e5e-4eab-81b4-615bfad4ac53","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","component":"PeerTask","trace":"af4c36a91258047d6d4d3b9a8b48e58e"}
{"level":"debug","ts":"2024-05-30 07:12:52.988","caller":"peer/peertask_manager.go:465","msg":"delete done task 9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b in running tasks"}
{"level":"debug","ts":"2024-05-30 07:12:52.988","caller":"peer/peertask_piecetask_synchronizer.go:477","msg":"peer task success, watchdog exit","peer":"10.222.79.7-19101-5ba35686-5e5e-4eab-81b4-615bfad4ac53","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","component":"PeerTask","trace":"af4c36a91258047d6d4d3b9a8b48e58e"}
{"level":"debug","ts":"2024-05-30 07:12:52.988","caller":"peer/peertask_conductor.go:1432","msg":"peer task finished, end piece result sent result: <nil>","peer":"10.222.79.7-19101-5ba35686-5e5e-4eab-81b4-615bfad4ac53","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","component":"PeerTask","trace":"af4c36a91258047d6d4d3b9a8b48e58e"}
{"level":"debug","ts":"2024-05-30 07:12:52.988","caller":"peer/peertask_conductor.go:1435","msg":"close stream result: <nil>","peer":"10.222.79.7-19101-5ba35686-5e5e-4eab-81b4-615bfad4ac53","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","component":"PeerTask","trace":"af4c36a91258047d6d4d3b9a8b48e58e"}
{"level":"info","ts":"2024-05-30 07:12:52.988","caller":"transport/transport.go:365","msg":"download stream attribute: map[Content-Length:[9728] Content-Type:[application/octet-stream] Etag:[\"sha256:66c53c87a77e97d31723542c6839ab78318c3e45cd1b49f59274691af5858f97\"] X-Dragonfly-Peer:[10.222.79.7-19101-5ba35686-5e5e-4eab-81b4-615bfad4ac53] X-Dragonfly-Task:[9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b]]","peer":"10.222.79.7-19101-5ba35686-5e5e-4eab-81b4-615bfad4ac53","component":"transport","trace":"af4c36a91258047d6d4d3b9a8b48e58e","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b"}
{"level":"debug","ts":"2024-05-30 07:12:52.989","caller":"peer/peertask_conductor.go:713","msg":"peerPacketStream closed","peer":"10.222.79.7-19101-5ba35686-5e5e-4eab-81b4-615bfad4ac53","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","component":"PeerTask","trace":"af4c36a91258047d6d4d3b9a8b48e58e"}
{"level":"info","ts":"2024-05-30 07:12:52.989","caller":"peer/peertask_conductor.go:1456","msg":"step 3: report successful peer result ok","peer":"10.222.79.7-19101-5ba35686-5e5e-4eab-81b4-615bfad4ac53","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","component":"PeerTask","trace":"af4c36a91258047d6d4d3b9a8b48e58e"}
{"level":"debug","ts":"2024-05-30 07:12:52.989","caller":"peer/piece_dispatcher.go:172","msg":"piece dispatcher closed","component":"pieceDispatcher","peer":"10.222.79.7-19101-5ba35686-5e5e-4eab-81b4-615bfad4ac53","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","component":"PeerTask","trace":"af4c36a91258047d6d4d3b9a8b48e58e"}
{"level":"info","ts":"2024-05-30 07:12:52.989","caller":"peer/peertask_conductor.go:1048","msg":"piece download queue cancelled, peer download worker #0 exit, err: piece dispatcher already closed","peer":"10.222.79.7-19101-5ba35686-5e5e-4eab-81b4-615bfad4ac53","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","component":"PeerTask","trace":"af4c36a91258047d6d4d3b9a8b48e58e"}
{"level":"info","ts":"2024-05-30 07:12:52.989","caller":"peer/peertask_conductor.go:1048","msg":"piece download queue cancelled, peer download worker #2 exit, err: piece dispatcher already closed","peer":"10.222.79.7-19101-5ba35686-5e5e-4eab-81b4-615bfad4ac53","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","component":"PeerTask","trace":"af4c36a91258047d6d4d3b9a8b48e58e"}
{"level":"info","ts":"2024-05-30 07:12:52.989","caller":"peer/peertask_conductor.go:1048","msg":"piece download queue cancelled, peer download worker #1 exit, err: piece dispatcher already closed","peer":"10.222.79.7-19101-5ba35686-5e5e-4eab-81b4-615bfad4ac53","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","component":"PeerTask","trace":"af4c36a91258047d6d4d3b9a8b48e58e"}
{"level":"debug","ts":"2024-05-30 07:12:52.989","caller":"peer/peertask_piecetask_synchronizer.go:458","msg":"grpc canceled, dst peer: 10.222.79.36-1-bc77a653-1d9a-4b21-b2f8-42d6aad3b96b_Seed","targetPeerID":"10.222.79.36-1-bc77a653-1d9a-4b21-b2f8-42d6aad3b96b_Seed","peer":"10.222.79.7-19101-5ba35686-5e5e-4eab-81b4-615bfad4ac53","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","component":"PeerTask","trace":"af4c36a91258047d6d4d3b9a8b48e58e"}
{"level":"debug","ts":"2024-05-30 07:12:52.989","caller":"peer/peertask_piecetask_synchronizer.go:404","msg":"synchronizer receives canceled","targetPeerID":"10.222.79.36-1-bc77a653-1d9a-4b21-b2f8-42d6aad3b96b_Seed","peer":"10.222.79.7-19101-5ba35686-5e5e-4eab-81b4-615bfad4ac53","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","component":"PeerTask","trace":"af4c36a91258047d6d4d3b9a8b48e58e"}
{"level":"info","ts":"2024-05-30 07:12:52.989","caller":"peer/peertask_piecetask_synchronizer.go:304","msg":"pieceTaskSynchronizer grpc closed","targetPeerID":"10.222.79.36-1-bc77a653-1d9a-4b21-b2f8-42d6aad3b96b_Seed","peer":"10.222.79.7-19101-5ba35686-5e5e-4eab-81b4-615bfad4ac53","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","component":"PeerTask","trace":"af4c36a91258047d6d4d3b9a8b48e58e"}
{"level":"info","ts":"2024-05-30 07:12:52.989","caller":"peer/peertask_conductor.go:1064","msg":"piece download cancelled, peer download worker #3 exit","peer":"10.222.79.7-19101-5ba35686-5e5e-4eab-81b4-615bfad4ac53","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","component":"PeerTask","trace":"af4c36a91258047d6d4d3b9a8b48e58e"}
{"level":"debug","ts":"2024-05-30 07:12:52.996","caller":"transport/transport.go:210","msg":"round trip with dragonfly: https://harbor.test.wifi.com/v2/init-images/bigdata-1/blobs/sha256:c730de9911cb39a76dd5aa85895f524f9b37267ee5b3b38818227dc610d994c6?ns=harbor.test.wifi.com"}
{"level":"info","ts":"2024-05-30 07:12:52.996","caller":"transport/transport.go:306","msg":"start download with url: https://harbor.test.wifi.com/v2/init-images/bigdata-1/blobs/sha256:c730de9911cb39a76dd5aa85895f524f9b37267ee5b3b38818227dc610d994c6?ns=harbor.test.wifi.com","peer":"10.222.79.7-19101-23eac6dd-d179-4c27-9979-58b71f0c7cc7","component":"transport","trace":"3858f806fe504e1903ca39624b97f565","task":"f5cd5868a3a7f3572307f669c303f49e4e3960bac2b26e473bfd08c16849e58b"}
{"level":"debug","ts":"2024-05-30 07:12:52.996","caller":"transport/transport.go:307","msg":"request url: https://harbor.test.wifi.com/v2/init-images/bigdata-1/blobs/sha256:c730de9911cb39a76dd5aa85895f524f9b37267ee5b3b38818227dc610d994c6?ns=harbor.test.wifi.com, with header: http.Header{\"Accept\":[]string{\"application/vnd.docker.image.rootfs.diff.tar.gzip, */*\"}, \"Authorization\":[]string{\"Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IjdXTUE6S1ZYTzpLRjI1OjM1TkE6R0ozNTpaR0tZOlBHWVQ6STVVVDpUR1dZOlVVSTQ6UFQ3WjpYM0tXIiwidHlwIjoiSldUIn0.eyJhdWQiOiJoYXJib3ItcmVnaXN0cnkiLCJleHAiOjE3MTcwNTQ5NzIsImp0aSI6Ik5yRDZuNklnYkRYWUdjeXUiLCJpYXQiOjE3MTcwNTMxNzIsImlzcyI6ImhhcmJvci10b2tlbi1pc3N1ZXIiLCJuYmYiOjE3MTcwNTMxNzIsImFjY2VzcyI6W3sidHlwZSI6InJlcG9zaXRvcnkiLCJuYW1lIjoiaW5pdC1pbWFnZXMvYmlnZGF0YS0xIiwiYWN0aW9ucyI6WyJwdWxsIl19XX0.I4P4AfBPQBCizA9mwNvzWtrAnJx7hqs3icQMPRJX5JDkFPSQZEACQr2vPil7hjDNjJCtSX_ub-ElzzKAgHXu1K0w01DHGI8v3_HuCapRZIZMBadn5iCFehDiE-qZqwayGs2R0TIc7NlJXrKPO_WnI2QedWmgUT3HAA1hq7dIBhah7RmsQyxmpNQgfEnHUnvKnOmLfTb8y0jW_BO11F4cxL1-oqjfNBHC5kw20Nk_grS32W2YAFhf0ZTLRLTSStz3ZSoGAq9c-kAx1-SWz4hFRhhAU1K70fESRrIDyyn5IcTVWYmqxApl9j6VV632siR_Lx8pZyQE5IzTad6GAzmkdGDLn5c8ikv97V7RiIg7LNk5ci3q3j3lM7cW_jst6xIEVu0uEjnhIPVCcmwMTsVnLEAyy5kFwgvj8M26n6zAAVhqDlGtBopaXStH9AIyKts5Sj5mPSCbNsqHSruKCkCTisFxMgxRhGhLo-nU2HeZNsmONsB1FfVxFnk2xGDljYgatTO76A4_zrstWcWnlJMeZBMo58oP6x-u1T9aEUUlTryc2IyVREyRxfn8ugDyFMiUQdu5mvMOW4cAyxpqqw6kanM1whN8BQTkdY7CKVyB6fW7lW7pVzVMrzbZljnj5VoyoIhtkgbgapu_77Dl91_qLGALwJDxwjX1OarncBxcSZc\"}}","peer":"10.222.79.7-19101-23eac6dd-d179-4c27-9979-58b71f0c7cc7","component":"transport","trace":"3858f806fe504e1903ca39624b97f565","task":"f5cd5868a3a7f3572307f669c303f49e4e3960bac2b26e473bfd08c16849e58b"}
{"level":"debug","ts":"2024-05-30 07:12:52.996","caller":"peer/peertask_manager.go:239","msg":"peer task created: f5cd5868a3a7f3572307f669c303f49e4e3960bac2b26e473bfd08c16849e58b/10.222.79.7-19101-23eac6dd-d179-4c27-9979-58b71f0c7cc7"}
{"level":"debug","ts":"2024-05-30 07:12:52.996","caller":"storage/storage_manager.go:430","msg":"init local task storage, peer id: 10.222.79.7-19101-23eac6dd-d179-4c27-9979-58b71f0c7cc7, task id: f5cd5868a3a7f3572307f669c303f49e4e3960bac2b26e473bfd08c16849e58b"}
{"level":"debug","ts":"2024-05-30 07:12:52.996","caller":"peer/peertask_conductor.go:256","msg":"request overview, pid: 10.222.79.7-19101-23eac6dd-d179-4c27-9979-58b71f0c7cc7, url: https://harbor.test.wifi.com/v2/init-images/bigdata-1/blobs/sha256:c730de9911cb39a76dd5aa85895f524f9b37267ee5b3b38818227dc610d994c6?ns=harbor.test.wifi.com, filter: Expires&Signature&ns, tag: , range: , digest: , header: map[string]string{\"Accept\":\"application/vnd.docker.image.rootfs.diff.tar.gzip, */*\", \"Authorization\":\"Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IjdXTUE6S1ZYTzpLRjI1OjM1TkE6R0ozNTpaR0tZOlBHWVQ6STVVVDpUR1dZOlVVSTQ6UFQ3WjpYM0tXIiwidHlwIjoiSldUIn0.eyJhdWQiOiJoYXJib3ItcmVnaXN0cnkiLCJleHAiOjE3MTcwNTQ5NzIsImp0aSI6Ik5yRDZuNklnYkRYWUdjeXUiLCJpYXQiOjE3MTcwNTMxNzIsImlzcyI6ImhhcmJvci10b2tlbi1pc3N1ZXIiLCJuYmYiOjE3MTcwNTMxNzIsImFjY2VzcyI6W3sidHlwZSI6InJlcG9zaXRvcnkiLCJuYW1lIjoiaW5pdC1pbWFnZXMvYmlnZGF0YS0xIiwiYWN0aW9ucyI6WyJwdWxsIl19XX0.I4P4AfBPQBCizA9mwNvzWtrAnJx7hqs3icQMPRJX5JDkFPSQZEACQr2vPil7hjDNjJCtSX_ub-ElzzKAgHXu1K0w01DHGI8v3_HuCapRZIZMBadn5iCFehDiE-qZqwayGs2R0TIc7NlJXrKPO_WnI2QedWmgUT3HAA1hq7dIBhah7RmsQyxmpNQgfEnHUnvKnOmLfTb8y0jW_BO11F4cxL1-oqjfNBHC5kw20Nk_grS32W2YAFhf0ZTLRLTSStz3ZSoGAq9c-kAx1-SWz4hFRhhAU1K70fESRrIDyyn5IcTVWYmqxApl9j6VV632siR_Lx8pZyQE5IzTad6GAzmkdGDLn5c8ikv97V7RiIg7LNk5ci3q3j3lM7cW_jst6xIEVu0uEjnhIPVCcmwMTsVnLEAyy5kFwgvj8M26n6zAAVhqDlGtBopaXStH9AIyKts5Sj5mPSCbNsqHSruKCkCTisFxMgxRhGhLo-nU2HeZNsmONsB1FfVxFnk2xGDljYgatTO76A4_zrstWcWnlJMeZBMo58oP6x-u1T9aEUUlTryc2IyVREyRxfn8ugDyFMiUQdu5mvMOW4cAyxpqqw6kanM1whN8BQTkdY7CKVyB6fW7lW7pVzVMrzbZljnj5VoyoIhtkgbgapu_77Dl91_qLGALwJDxwjX1OarncBxcSZc\"}","peer":"10.222.79.7-19101-23eac6dd-d179-4c27-9979-58b71f0c7cc7","task":"f5cd5868a3a7f3572307f669c303f49e4e3960bac2b26e473bfd08c16849e58b","component":"PeerTask","trace":"3858f806fe504e1903ca39624b97f565"}
{"level":"info","ts":"2024-05-30 07:12:52.996","caller":"peer/peertask_conductor.go:270","msg":"step 1: peer 10.222.79.7-19101-23eac6dd-d179-4c27-9979-58b71f0c7cc7 start to register","peer":"10.222.79.7-19101-23eac6dd-d179-4c27-9979-58b71f0c7cc7","task":"f5cd5868a3a7f3572307f669c303f49e4e3960bac2b26e473bfd08c16849e58b","component":"PeerTask","trace":"3858f806fe504e1903ca39624b97f565"}
{"level":"info","ts":"2024-05-30 07:12:52.997","caller":"peer/peertask_conductor.go:296","msg":"register task success, SizeScope: NORMAL","peer":"10.222.79.7-19101-23eac6dd-d179-4c27-9979-58b71f0c7cc7","task":"f5cd5868a3a7f3572307f669c303f49e4e3960bac2b26e473bfd08c16849e58b","component":"PeerTask","trace":"3858f806fe504e1903ca39624b97f565"}
{"level":"info","ts":"2024-05-30 07:12:52.997","caller":"peer/peertask_conductor.go:347","msg":"step 2: start report piece result","peer":"10.222.79.7-19101-23eac6dd-d179-4c27-9979-58b71f0c7cc7","task":"f5cd5868a3a7f3572307f669c303f49e4e3960bac2b26e473bfd08c16849e58b","component":"PeerTask","trace":"3858f806fe504e1903ca39624b97f565"}
{"level":"debug","ts":"2024-05-30 07:12:52.997","caller":"peer/piece_dispatcher.go:85","msg":"piece dispatcher created","peer":"10.222.79.7-19101-23eac6dd-d179-4c27-9979-58b71f0c7cc7","task":"f5cd5868a3a7f3572307f669c303f49e4e3960bac2b26e473bfd08c16849e58b","component":"PeerTask","trace":"3858f806fe504e1903ca39624b97f565"}
{"level":"debug","ts":"2024-05-30 07:13:22.750","caller":"storage/local_storage.go:519","msg":"reclaim check, last access: 2024-05-30 07:12:52.988828778 +0000 UTC, reclaim: false","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","peer":"10.222.79.7-19101-5ba35686-5e5e-4eab-81b4-615bfad4ac53","component":"localTaskStore"}
{"level":"debug","ts":"2024-05-30 07:14:22.751","caller":"storage/local_storage.go:519","msg":"reclaim check, last access: 2024-05-30 07:12:52.988828778 +0000 UTC, reclaim: false","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","peer":"10.222.79.7-19101-5ba35686-5e5e-4eab-81b4-615bfad4ac53","component":"localTaskStore"}
{"level":"debug","ts":"2024-05-30 07:15:22.750","caller":"storage/local_storage.go:519","msg":"reclaim check, last access: 2024-05-30 07:12:52.988828778 +0000 UTC, reclaim: false","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","peer":"10.222.79.7-19101-5ba35686-5e5e-4eab-81b4-615bfad4ac53","component":"localTaskStore"}
{"level":"debug","ts":"2024-05-30 07:16:22.750","caller":"storage/local_storage.go:519","msg":"reclaim check, last access: 2024-05-30 07:12:52.988828778 +0000 UTC, reclaim: false","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","peer":"10.222.79.7-19101-5ba35686-5e5e-4eab-81b4-615bfad4ac53","component":"localTaskStore"}
{"level":"debug","ts":"2024-05-30 07:17:22.751","caller":"storage/local_storage.go:519","msg":"reclaim check, last access: 2024-05-30 07:12:52.988828778 +0000 UTC, reclaim: false","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","peer":"10.222.79.7-19101-5ba35686-5e5e-4eab-81b4-615bfad4ac53","component":"localTaskStore"}
{"level":"debug","ts":"2024-05-30 07:18:22.750","caller":"storage/local_storage.go:519","msg":"reclaim check, last access: 2024-05-30 07:12:52.988828778 +0000 UTC, reclaim: false","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","peer":"10.222.79.7-19101-5ba35686-5e5e-4eab-81b4-615bfad4ac53","component":"localTaskStore"}
{"level":"debug","ts":"2024-05-30 07:19:22.750","caller":"storage/local_storage.go:519","msg":"reclaim check, last access: 2024-05-30 07:12:52.988828778 +0000 UTC, reclaim: false","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","peer":"10.222.79.7-19101-5ba35686-5e5e-4eab-81b4-615bfad4ac53","component":"localTaskStore"}
{"level":"debug","ts":"2024-05-30 07:20:22.751","caller":"storage/local_storage.go:519","msg":"reclaim check, last access: 2024-05-30 07:12:52.988828778 +0000 UTC, reclaim: false","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","peer":"10.222.79.7-19101-5ba35686-5e5e-4eab-81b4-615bfad4ac53","component":"localTaskStore"}
{"level":"debug","ts":"2024-05-30 07:21:22.750","caller":"storage/local_storage.go:519","msg":"reclaim check, last access: 2024-05-30 07:12:52.988828778 +0000 UTC, reclaim: false","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","peer":"10.222.79.7-19101-5ba35686-5e5e-4eab-81b4-615bfad4ac53","component":"localTaskStore"}
{"level":"debug","ts":"2024-05-30 07:22:22.750","caller":"storage/local_storage.go:519","msg":"reclaim check, last access: 2024-05-30 07:12:52.988828778 +0000 UTC, reclaim: false","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","peer":"10.222.79.7-19101-5ba35686-5e5e-4eab-81b4-615bfad4ac53","component":"localTaskStore"}
{"level":"debug","ts":"2024-05-30 07:23:22.751","caller":"storage/local_storage.go:519","msg":"reclaim check, last access: 2024-05-30 07:12:52.988828778 +0000 UTC, reclaim: false","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","peer":"10.222.79.7-19101-5ba35686-5e5e-4eab-81b4-615bfad4ac53","component":"localTaskStore"}
{"level":"debug","ts":"2024-05-30 07:24:22.750","caller":"storage/local_storage.go:519","msg":"reclaim check, last access: 2024-05-30 07:12:52.988828778 +0000 UTC, reclaim: false","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","peer":"10.222.79.7-19101-5ba35686-5e5e-4eab-81b4-615bfad4ac53","component":"localTaskStore"}
{"level":"debug","ts":"2024-05-30 07:25:22.750","caller":"storage/local_storage.go:519","msg":"reclaim check, last access: 2024-05-30 07:12:52.988828778 +0000 UTC, reclaim: false","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","peer":"10.222.79.7-19101-5ba35686-5e5e-4eab-81b4-615bfad4ac53","component":"localTaskStore"}
{"level":"debug","ts":"2024-05-30 07:26:22.750","caller":"storage/local_storage.go:519","msg":"reclaim check, last access: 2024-05-30 07:12:52.988828778 +0000 UTC, reclaim: false","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","peer":"10.222.79.7-19101-5ba35686-5e5e-4eab-81b4-615bfad4ac53","component":"localTaskStore"}
{"level":"debug","ts":"2024-05-30 07:27:22.751","caller":"storage/local_storage.go:519","msg":"reclaim check, last access: 2024-05-30 07:12:52.988828778 +0000 UTC, reclaim: false","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","peer":"10.222.79.7-19101-5ba35686-5e5e-4eab-81b4-615bfad4ac53","component":"localTaskStore"}
{"level":"debug","ts":"2024-05-30 07:28:22.750","caller":"storage/local_storage.go:519","msg":"reclaim check, last access: 2024-05-30 07:12:52.988828778 +0000 UTC, reclaim: false","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","peer":"10.222.79.7-19101-5ba35686-5e5e-4eab-81b4-615bfad4ac53","component":"localTaskStore"}
{"level":"debug","ts":"2024-05-30 07:29:22.751","caller":"storage/local_storage.go:519","msg":"reclaim check, last access: 2024-05-30 07:12:52.988828778 +0000 UTC, reclaim: false","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","peer":"10.222.79.7-19101-5ba35686-5e5e-4eab-81b4-615bfad4ac53","component":"localTaskStore"}
{"level":"debug","ts":"2024-05-30 07:30:22.750","caller":"storage/local_storage.go:519","msg":"reclaim check, last access: 2024-05-30 07:12:52.988828778 +0000 UTC, reclaim: false","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","peer":"10.222.79.7-19101-5ba35686-5e5e-4eab-81b4-615bfad4ac53","component":"localTaskStore"}
{"level":"debug","ts":"2024-05-30 07:31:22.750","caller":"storage/local_storage.go:519","msg":"reclaim check, last access: 2024-05-30 07:12:52.988828778 +0000 UTC, reclaim: false","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","peer":"10.222.79.7-19101-5ba35686-5e5e-4eab-81b4-615bfad4ac53","component":"localTaskStore"}
{"level":"debug","ts":"2024-05-30 07:32:22.750","caller":"storage/local_storage.go:519","msg":"reclaim check, last access: 2024-05-30 07:12:52.988828778 +0000 UTC, reclaim: false","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","peer":"10.222.79.7-19101-5ba35686-5e5e-4eab-81b4-615bfad4ac53","component":"localTaskStore"}
{"level":"debug","ts":"2024-05-30 07:33:22.751","caller":"storage/local_storage.go:519","msg":"reclaim check, last access: 2024-05-30 07:12:52.988828778 +0000 UTC, reclaim: false","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","peer":"10.222.79.7-19101-5ba35686-5e5e-4eab-81b4-615bfad4ac53","component":"localTaskStore"}
{"level":"debug","ts":"2024-05-30 07:34:22.751","caller":"storage/local_storage.go:519","msg":"reclaim check, last access: 2024-05-30 07:12:52.988828778 +0000 UTC, reclaim: false","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","peer":"10.222.79.7-19101-5ba35686-5e5e-4eab-81b4-615bfad4ac53","component":"localTaskStore"}

seed peer core.log core.log

{"level":"debug","ts":"2024-05-30 07:12:52.282","caller":"peer/peertask_manager.go:239","msg":"peer task created: 9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b/10.222.79.36-1-bc77a653-1d9a-4b21-b2f8-42d6aad3b96b_Seed"}
{"level":"debug","ts":"2024-05-30 07:12:52.282","caller":"storage/storage_manager.go:430","msg":"init local task storage, peer id: 10.222.79.36-1-bc77a653-1d9a-4b21-b2f8-42d6aad3b96b_Seed, task id: 9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b"}
{"level":"info","ts":"2024-05-30 07:12:52.284","caller":"rpcserver/seeder.go:116","msg":"start seed task","peer":"10.222.79.36-1-bc77a653-1d9a-4b21-b2f8-42d6aad3b96b_Seed","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","component":"seedService"}
{"level":"info","ts":"2024-05-30 07:12:52.284","caller":"peer/piece_manager.go:318","msg":"start to download from source","peer":"10.222.79.36-1-bc77a653-1d9a-4b21-b2f8-42d6aad3b96b_Seed","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","component":"PeerTask","trace":"0c997b1f6ebe00903f957ce5e10ac2f4"}
{"level":"debug","ts":"2024-05-30 07:12:52.284","caller":"source/source_client.go:236","msg":"current clients: map[string]source.ResourceClient{\"d7ylist\":(*source.clientWrapper)(0xc000b28900), \"hdfs\":(*source.clientWrapper)(0xc000a70180), \"http\":(*source.clientWrapper)(0xc000a70cf0), \"https\":(*source.clientWrapper)(0xc000a70e10), \"oras\":(*source.clientWrapper)(0xc000a70f00), \"oss\":(*source.clientWrapper)(0xc000a70f30), \"s3\":(*source.clientWrapper)(0xc000a701b0)}"}
{"level":"debug","ts":"2024-05-30 07:12:52.284","caller":"httpprotocol/http_source_client.go:268","msg":"request GET https://harbor.test.wifi.com/v2/init-images/bigdata-1/blobs/sha256:66c53c87a77e97d31723542c6839ab78318c3e45cd1b49f59274691af5858f97?ns=harbor.test.wifi.com header: http.Header{\"Accept\":[]string{\"application/vnd.docker.container.image.v1+json, */*\"}, \"Authorization\":[]string{\"Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IjdXTUE6S1ZYTzpLRjI1OjM1TkE6R0ozNTpaR0tZOlBHWVQ6STVVVDpUR1dZOlVVSTQ6UFQ3WjpYM0tXIiwidHlwIjoiSldUIn0.eyJhdWQiOiJoYXJib3ItcmVnaXN0cnkiLCJleHAiOjE3MTcwNTQ5NzIsImp0aSI6Ik5yRDZuNklnYkRYWUdjeXUiLCJpYXQiOjE3MTcwNTMxNzIsImlzcyI6ImhhcmJvci10b2tlbi1pc3N1ZXIiLCJuYmYiOjE3MTcwNTMxNzIsImFjY2VzcyI6W3sidHlwZSI6InJlcG9zaXRvcnkiLCJuYW1lIjoiaW5pdC1pbWFnZXMvYmlnZGF0YS0xIiwiYWN0aW9ucyI6WyJwdWxsIl19XX0.I4P4AfBPQBCizA9mwNvzWtrAnJx7hqs3icQMPRJX5JDkFPSQZEACQr2vPil7hjDNjJCtSX_ub-ElzzKAgHXu1K0w01DHGI8v3_HuCapRZIZMBadn5iCFehDiE-qZqwayGs2R0TIc7NlJXrKPO_WnI2QedWmgUT3HAA1hq7dIBhah7RmsQyxmpNQgfEnHUnvKnOmLfTb8y0jW_BO11F4cxL1-oqjfNBHC5kw20Nk_grS32W2YAFhf0ZTLRLTSStz3ZSoGAq9c-kAx1-SWz4hFRhhAU1K70fESRrIDyyn5IcTVWYmqxApl9j6VV632siR_Lx8pZyQE5IzTad6GAzmkdGDLn5c8ikv97V7RiIg7LNk5ci3q3j3lM7cW_jst6xIEVu0uEjnhIPVCcmwMTsVnLEAyy5kFwgvj8M26n6zAAVhqDlGtBopaXStH9AIyKts5Sj5mPSCbNsqHSruKCkCTisFxMgxRhGhLo-nU2HeZNsmONsB1FfVxFnk2xGDljYgatTO76A4_zrstWcWnlJMeZBMo58oP6x-u1T9aEUUlTryc2IyVREyRxfn8ugDyFMiUQdu5mvMOW4cAyxpqqw6kanM1whN8BQTkdY7CKVyB6fW7lW7pVzVMrzbZljnj5VoyoIhtkgbgapu_77Dl91_qLGALwJDxwjX1OarncBxcSZc\"}}"}
{"level":"debug","ts":"2024-05-30 07:12:52.420","caller":"peer/piece_manager.go:422","msg":"back source content length: 9728","peer":"10.222.79.36-1-bc77a653-1d9a-4b21-b2f8-42d6aad3b96b_Seed","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","component":"PeerTask","trace":"0c997b1f6ebe00903f957ce5e10ac2f4"}
{"level":"debug","ts":"2024-05-30 07:12:52.421","caller":"storage/local_storage.go:225","msg":"update content length: 9728","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","peer":"10.222.79.36-1-bc77a653-1d9a-4b21-b2f8-42d6aad3b96b_Seed","component":"localTaskStore"}
{"level":"debug","ts":"2024-05-30 07:12:52.421","caller":"storage/local_storage.go:234","msg":"update total pieces: 1","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","peer":"10.222.79.36-1-bc77a653-1d9a-4b21-b2f8-42d6aad3b96b_Seed","component":"localTaskStore"}
{"level":"debug","ts":"2024-05-30 07:12:52.421","caller":"storage/local_storage.go:242","msg":"update header: &source.Header{\"Content-Type\":[]string{\"application/octet-stream\"}, \"Etag\":[]string{\"\\\"sha256:66c53c87a77e97d31723542c6839ab78318c3e45cd1b49f59274691af5858f97\\\"\"}}","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","peer":"10.222.79.36-1-bc77a653-1d9a-4b21-b2f8-42d6aad3b96b_Seed","component":"localTaskStore"}
{"level":"debug","ts":"2024-05-30 07:12:52.421","caller":"peer/piece_manager.go:491","msg":"download piece 0","peer":"10.222.79.36-1-bc77a653-1d9a-4b21-b2f8-42d6aad3b96b_Seed","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","component":"PeerTask","trace":"0c997b1f6ebe00903f957ce5e10ac2f4"}
{"level":"debug","ts":"2024-05-30 07:12:52.421","caller":"peer/piece_manager.go:263","msg":"piece 0 calculate digest","peer":"10.222.79.36-1-bc77a653-1d9a-4b21-b2f8-42d6aad3b96b_Seed","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","component":"PeerTask","trace":"0c997b1f6ebe00903f957ce5e10ac2f4"}
{"level":"debug","ts":"2024-05-30 07:12:52.421","caller":"storage/local_storage.go:173","msg":"piece 0 md5 not found in metadata, read from reader","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","peer":"10.222.79.36-1-bc77a653-1d9a-4b21-b2f8-42d6aad3b96b_Seed","component":"localTaskStore"}
{"level":"info","ts":"2024-05-30 07:12:52.421","caller":"storage/local_storage.go:176","msg":"read piece 0 md5 from reader, value: ec8ed431497bd0c44c9677949cab945d","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","peer":"10.222.79.36-1-bc77a653-1d9a-4b21-b2f8-42d6aad3b96b_Seed","component":"localTaskStore"}
{"level":"debug","ts":"2024-05-30 07:12:52.421","caller":"storage/local_storage.go:182","msg":"wrote 9728 bytes to file /var/lib/dragonfly/9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b/10.222.79.36-1-bc77a653-1d9a-4b21-b2f8-42d6aad3b96b_Seed/data, piece 0, start 0, length: 9728","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","peer":"10.222.79.36-1-bc77a653-1d9a-4b21-b2f8-42d6aad3b96b_Seed","component":"localTaskStore"}
{"level":"info","ts":"2024-05-30 07:12:52.421","caller":"storage/local_storage.go:216","msg":"generated digest: 57e55b5a3b9c6d4f327b570bd2e84c750c42e590f1b848e73a38c4338a049f13, total pieces: 1, content length: 9728","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","peer":"10.222.79.36-1-bc77a653-1d9a-4b21-b2f8-42d6aad3b96b_Seed","component":"localTaskStore"}
{"level":"info","ts":"2024-05-30 07:12:52.422","caller":"peer/peertask_conductor.go:1173","msg":"completed content length: 9728","peer":"10.222.79.36-1-bc77a653-1d9a-4b21-b2f8-42d6aad3b96b_Seed","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","component":"PeerTask","trace":"0c997b1f6ebe00903f957ce5e10ac2f4"}
{"level":"info","ts":"2024-05-30 07:12:52.422","caller":"peer/peertask_conductor.go:1383","msg":"peer task done, cost: 140ms","peer":"10.222.79.36-1-bc77a653-1d9a-4b21-b2f8-42d6aad3b96b_Seed","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","component":"PeerTask","trace":"0c997b1f6ebe00903f957ce5e10ac2f4"}
{"level":"debug","ts":"2024-05-30 07:12:52.422","caller":"storage/local_storage.go:234","msg":"update total pieces: 1","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","peer":"10.222.79.36-1-bc77a653-1d9a-4b21-b2f8-42d6aad3b96b_Seed","component":"localTaskStore"}
{"level":"debug","ts":"2024-05-30 07:12:52.423","caller":"peer/peertask_conductor.go:1601","msg":"validate digest ok","peer":"10.222.79.36-1-bc77a653-1d9a-4b21-b2f8-42d6aad3b96b_Seed","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","component":"PeerTask","trace":"0c997b1f6ebe00903f957ce5e10ac2f4"}
{"level":"debug","ts":"2024-05-30 07:12:52.423","caller":"peer/peertask_manager.go:465","msg":"delete done task 9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b in running tasks"}
{"level":"debug","ts":"2024-05-30 07:12:52.423","caller":"peer/peertask_conductor.go:1432","msg":"peer task finished, end piece result sent result: <nil>","peer":"10.222.79.36-1-bc77a653-1d9a-4b21-b2f8-42d6aad3b96b_Seed","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","component":"PeerTask","trace":"0c997b1f6ebe00903f957ce5e10ac2f4"}
{"level":"debug","ts":"2024-05-30 07:12:52.423","caller":"peer/peertask_conductor.go:1435","msg":"close stream result: <nil>","peer":"10.222.79.36-1-bc77a653-1d9a-4b21-b2f8-42d6aad3b96b_Seed","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","component":"PeerTask","trace":"0c997b1f6ebe00903f957ce5e10ac2f4"}
{"level":"info","ts":"2024-05-30 07:12:52.423","caller":"peer/peertask_conductor.go:1456","msg":"step 3: report successful peer result ok","peer":"10.222.79.36-1-bc77a653-1d9a-4b21-b2f8-42d6aad3b96b_Seed","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","component":"PeerTask","trace":"0c997b1f6ebe00903f957ce5e10ac2f4"}
{"level":"info","ts":"2024-05-30 07:12:52.423","caller":"peer/piece_manager.go:533","msg":"download from source ok","peer":"10.222.79.36-1-bc77a653-1d9a-4b21-b2f8-42d6aad3b96b_Seed","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","component":"PeerTask","trace":"0c997b1f6ebe00903f957ce5e10ac2f4"}
{"level":"info","ts":"2024-05-30 07:12:52.423","caller":"peer/peertask_conductor.go:525","msg":"download from source ok","peer":"10.222.79.36-1-bc77a653-1d9a-4b21-b2f8-42d6aad3b96b_Seed","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","component":"PeerTask","trace":"0c997b1f6ebe00903f957ce5e10ac2f4"}
{"level":"info","ts":"2024-05-30 07:12:52.423","caller":"rpcserver/seeder.go:175","msg":"seed task success, send reminding piece seeds","peer":"10.222.79.36-1-bc77a653-1d9a-4b21-b2f8-42d6aad3b96b_Seed","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","component":"seedService"}
{"level":"info","ts":"2024-05-30 07:12:52.423","caller":"rpcserver/seeder.go:254","msg":"seed tasks start time: 1717053172284207634, end time: 1717053172423586003, cost: 139ms, piece number: 0","peer":"10.222.79.36-1-bc77a653-1d9a-4b21-b2f8-42d6aad3b96b_Seed","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","component":"seedService"}
{"level":"debug","ts":"2024-05-30 07:12:52.423","caller":"rpcserver/seeder.go:268","msg":"send reminding piece seeds ok","peer":"10.222.79.36-1-bc77a653-1d9a-4b21-b2f8-42d6aad3b96b_Seed","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","component":"seedService"}
{"level":"debug","ts":"2024-05-30 07:12:52.985","caller":"rpcserver/rpcserver.go:227","msg":"receive get piece tasks request, task id: 9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b, src peer: 10.222.79.7-19101-5ba35686-5e5e-4eab-81b4-615bfad4ac53, dst peer: 10.222.79.36-1-bc77a653-1d9a-4b21-b2f8-42d6aad3b96b_Seed, piece start num: 0, limit: 16, count: 1, total piece: %!s(int32=1), total content length: 9728"}
{"level":"info","ts":"2024-05-30 07:12:52.985","caller":"rpcserver/subscriber.go:95","msg":"send ready piece 0","taskID":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","localPeerID":"10.222.79.36-1-bc77a653-1d9a-4b21-b2f8-42d6aad3b96b_Seed","remotePeerID":"10.222.79.7-19101-5ba35686-5e5e-4eab-81b4-615bfad4ac53"}
{"level":"info","ts":"2024-05-30 07:12:52.985","caller":"rpcserver/subscriber.go:99","msg":"sent 1 pieces, total: 1","taskID":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","localPeerID":"10.222.79.36-1-bc77a653-1d9a-4b21-b2f8-42d6aad3b96b_Seed","remotePeerID":"10.222.79.7-19101-5ba35686-5e5e-4eab-81b4-615bfad4ac53"}
{"level":"info","ts":"2024-05-30 07:12:52.985","caller":"rpcserver/rpcserver.go:342","msg":"all piece tasks sent, receive new piece tasks requests only","taskID":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","localPeerID":"10.222.79.36-1-bc77a653-1d9a-4b21-b2f8-42d6aad3b96b_Seed","remotePeerID":"10.222.79.7-19101-5ba35686-5e5e-4eab-81b4-615bfad4ac53"}
{"level":"debug","ts":"2024-05-30 07:12:52.986","caller":"upload/upload_manager.go:213","msg":"upload piece for task 9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b/10.222.79.36-1-bc77a653-1d9a-4b21-b2f8-42d6aad3b96b_Seed to 10.222.79.7:33882, request header: http.Header{\"Range\":[]string{\"bytes=0-9727\"}, \"Traceparent\":[]string{\"00-af4c36a91258047d6d4d3b9a8b48e58e-19e9ee252ff01e9b-01\"}, \"User-Agent\":[]string{\"Go-http-client/1.1\"}}","component":"uploadManager","taskID":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","peerID":"10.222.79.36-1-bc77a653-1d9a-4b21-b2f8-42d6aad3b96b_Seed"}
{"level":"error","ts":"2024-05-30 07:12:52.989","caller":"rpcserver/rpcserver.go:329","msg":"receive reminding piece tasks request error: rpc error: code = Canceled desc = context canceled","stacktrace":"d7y.io/dragonfly/v2/client/daemon/rpcserver.(*server).SyncPieceTasks.func2\n\t/go/src/d7y.io/dragonfly/v2/client/daemon/rpcserver/rpcserver.go:329\nd7y.io/dragonfly/v2/client/daemon/rpcserver.(*server).SyncPieceTasks\n\t/go/src/d7y.io/dragonfly/v2/client/daemon/rpcserver/rpcserver.go:343\nd7y.io/api/v2/pkg/apis/dfdaemon/v1._Daemon_SyncPieceTasks_Handler\n\t/go/pkg/mod/d7y.io/api/v2@v2.0.110/pkg/apis/dfdaemon/v1/dfdaemon_grpc.pb.go:344\ngithub.com/grpc-ecosystem/go-grpc-middleware/recovery.StreamServerInterceptor.func1\n\t/go/pkg/mod/github.com/grpc-ecosystem/go-grpc-middleware@v1.4.0/recovery/interceptors.go:51\nd7y.io/dragonfly/v2/pkg/rpc/dfdaemon/server.New.ChainStreamServer.func9.1\n\t/go/pkg/mod/github.com/grpc-ecosystem/go-grpc-middleware@v1.4.0/chain.go:83\nd7y.io/dragonfly/v2/pkg/rpc/dfdaemon/server.New.StreamServerInterceptor.func7\n\t/go/pkg/mod/github.com/grpc-ecosystem/go-grpc-middleware@v1.4.0/validator/validator.go:72\nd7y.io/dragonfly/v2/pkg/rpc/dfdaemon/server.New.ChainStreamServer.func9.1\n\t/go/pkg/mod/github.com/grpc-ecosystem/go-grpc-middleware@v1.4.0/chain.go:83\ngithub.com/grpc-ecosystem/go-grpc-middleware/logging/zap.StreamServerInterceptor.func1\n\t/go/pkg/mod/github.com/grpc-ecosystem/go-grpc-middleware@v1.4.0/logging/zap/server_interceptors.go:53\nd7y.io/dragonfly/v2/pkg/rpc/dfdaemon/server.New.ChainStreamServer.func9.1\n\t/go/pkg/mod/github.com/grpc-ecosystem/go-grpc-middleware@v1.4.0/chain.go:83\ngithub.com/grpc-ecosystem/go-grpc-prometheus.init.(*ServerMetrics).StreamServerInterceptor.func4\n\t/go/pkg/mod/github.com/grpc-ecosystem/go-grpc-prometheus@v1.2.0/server_metrics.go:121\nd7y.io/dragonfly/v2/pkg/rpc/dfdaemon/server.New.ChainStreamServer.func9.1\n\t/go/pkg/mod/github.com/grpc-ecosystem/go-grpc-middleware@v1.4.0/chain.go:83\nd7y.io/dragonfly/v2/pkg/rpc.ConvertErrorStreamServerInterceptor\n\t/go/src/d7y.io/dragonfly/v2/pkg/rpc/interceptor.go:103\nd7y.io/dragonfly/v2/pkg/rpc/dfdaemon/server.New.ChainStreamServer.func9.1\n\t/go/pkg/mod/github.com/grpc-ecosystem/go-grpc-middleware@v1.4.0/chain.go:83\nd7y.io/dragonfly/v2/pkg/rpc/dfdaemon/server.New.StreamServerInterceptor.func6\n\t/go/pkg/mod/github.com/grpc-ecosystem/go-grpc-middleware@v1.4.0/ratelimit/ratelimit.go:34\nd7y.io/dragonfly/v2/pkg/rpc/dfdaemon/server.New.ChainStreamServer.func9\n\t/go/pkg/mod/github.com/grpc-ecosystem/go-grpc-middleware@v1.4.0/chain.go:86\ngoogle.golang.org/grpc.(*Server).processStreamingRPC\n\t/go/pkg/mod/google.golang.org/grpc@v1.63.2/server.go:1670\ngoogle.golang.org/grpc.(*Server).handleStream\n\t/go/pkg/mod/google.golang.org/grpc@v1.63.2/server.go:1784\ngoogle.golang.org/grpc.(*Server).serveStreams.func2.1\n\t/go/pkg/mod/google.golang.org/grpc@v1.63.2/server.go:1019"}
{"level":"debug","ts":"2024-05-30 07:12:52.997","caller":"peer/peertask_manager.go:239","msg":"peer task created: f5cd5868a3a7f3572307f669c303f49e4e3960bac2b26e473bfd08c16849e58b/10.222.79.36-1-487490e1-50be-4407-8b64-3bd356a716b1_Seed"}
{"level":"debug","ts":"2024-05-30 07:12:52.997","caller":"storage/storage_manager.go:430","msg":"init local task storage, peer id: 10.222.79.36-1-487490e1-50be-4407-8b64-3bd356a716b1_Seed, task id: f5cd5868a3a7f3572307f669c303f49e4e3960bac2b26e473bfd08c16849e58b"}
{"level":"info","ts":"2024-05-30 07:12:52.999","caller":"peer/piece_manager.go:318","msg":"start to download from source","peer":"10.222.79.36-1-487490e1-50be-4407-8b64-3bd356a716b1_Seed","task":"f5cd5868a3a7f3572307f669c303f49e4e3960bac2b26e473bfd08c16849e58b","component":"PeerTask","trace":"6b00973b54958ea85a48c7a3146581d1"}
{"level":"info","ts":"2024-05-30 07:12:52.999","caller":"rpcserver/seeder.go:116","msg":"start seed task","peer":"10.222.79.36-1-487490e1-50be-4407-8b64-3bd356a716b1_Seed","task":"f5cd5868a3a7f3572307f669c303f49e4e3960bac2b26e473bfd08c16849e58b","component":"seedService"}
{"level":"debug","ts":"2024-05-30 07:12:52.999","caller":"source/source_client.go:236","msg":"current clients: map[string]source.ResourceClient{\"d7ylist\":(*source.clientWrapper)(0xc000b28900), \"hdfs\":(*source.clientWrapper)(0xc000a70180), \"http\":(*source.clientWrapper)(0xc000a70cf0), \"https\":(*source.clientWrapper)(0xc000a70e10), \"oras\":(*source.clientWrapper)(0xc000a70f00), \"oss\":(*source.clientWrapper)(0xc000a70f30), \"s3\":(*source.clientWrapper)(0xc000a701b0)}"}
{"level":"debug","ts":"2024-05-30 07:12:52.999","caller":"httpprotocol/http_source_client.go:268","msg":"request GET https://harbor.test.wifi.com/v2/init-images/bigdata-1/blobs/sha256:c730de9911cb39a76dd5aa85895f524f9b37267ee5b3b38818227dc610d994c6?ns=harbor.test.wifi.com header: http.Header{\"Accept\":[]string{\"application/vnd.docker.image.rootfs.diff.tar.gzip, */*\"}, \"Authorization\":[]string{\"Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IjdXTUE6S1ZYTzpLRjI1OjM1TkE6R0ozNTpaR0tZOlBHWVQ6STVVVDpUR1dZOlVVSTQ6UFQ3WjpYM0tXIiwidHlwIjoiSldUIn0.eyJhdWQiOiJoYXJib3ItcmVnaXN0cnkiLCJleHAiOjE3MTcwNTQ5NzIsImp0aSI6Ik5yRDZuNklnYkRYWUdjeXUiLCJpYXQiOjE3MTcwNTMxNzIsImlzcyI6ImhhcmJvci10b2tlbi1pc3N1ZXIiLCJuYmYiOjE3MTcwNTMxNzIsImFjY2VzcyI6W3sidHlwZSI6InJlcG9zaXRvcnkiLCJuYW1lIjoiaW5pdC1pbWFnZXMvYmlnZGF0YS0xIiwiYWN0aW9ucyI6WyJwdWxsIl19XX0.I4P4AfBPQBCizA9mwNvzWtrAnJx7hqs3icQMPRJX5JDkFPSQZEACQr2vPil7hjDNjJCtSX_ub-ElzzKAgHXu1K0w01DHGI8v3_HuCapRZIZMBadn5iCFehDiE-qZqwayGs2R0TIc7NlJXrKPO_WnI2QedWmgUT3HAA1hq7dIBhah7RmsQyxmpNQgfEnHUnvKnOmLfTb8y0jW_BO11F4cxL1-oqjfNBHC5kw20Nk_grS32W2YAFhf0ZTLRLTSStz3ZSoGAq9c-kAx1-SWz4hFRhhAU1K70fESRrIDyyn5IcTVWYmqxApl9j6VV632siR_Lx8pZyQE5IzTad6GAzmkdGDLn5c8ikv97V7RiIg7LNk5ci3q3j3lM7cW_jst6xIEVu0uEjnhIPVCcmwMTsVnLEAyy5kFwgvj8M26n6zAAVhqDlGtBopaXStH9AIyKts5Sj5mPSCbNsqHSruKCkCTisFxMgxRhGhLo-nU2HeZNsmONsB1FfVxFnk2xGDljYgatTO76A4_zrstWcWnlJMeZBMo58oP6x-u1T9aEUUlTryc2IyVREyRxfn8ugDyFMiUQdu5mvMOW4cAyxpqqw6kanM1whN8BQTkdY7CKVyB6fW7lW7pVzVMrzbZljnj5VoyoIhtkgbgapu_77Dl91_qLGALwJDxwjX1OarncBxcSZc\"}}"}
{"level":"debug","ts":"2024-05-30 07:12:59.071","caller":"storage/local_storage.go:519","msg":"reclaim check, last access: 2024-05-30 07:12:52.986602762 +0000 UTC, reclaim: false","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","peer":"10.222.79.36-1-bc77a653-1d9a-4b21-b2f8-42d6aad3b96b_Seed","component":"localTaskStore"}
{"level":"debug","ts":"2024-05-30 07:13:59.071","caller":"storage/local_storage.go:519","msg":"reclaim check, last access: 2024-05-30 07:12:52.986602762 +0000 UTC, reclaim: false","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","peer":"10.222.79.36-1-bc77a653-1d9a-4b21-b2f8-42d6aad3b96b_Seed","component":"localTaskStore"}
{"level":"debug","ts":"2024-05-30 07:14:59.070","caller":"storage/local_storage.go:519","msg":"reclaim check, last access: 2024-05-30 07:12:52.986602762 +0000 UTC, reclaim: false","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","peer":"10.222.79.36-1-bc77a653-1d9a-4b21-b2f8-42d6aad3b96b_Seed","component":"localTaskStore"}
{"level":"debug","ts":"2024-05-30 07:15:59.070","caller":"storage/local_storage.go:519","msg":"reclaim check, last access: 2024-05-30 07:12:52.986602762 +0000 UTC, reclaim: false","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","peer":"10.222.79.36-1-bc77a653-1d9a-4b21-b2f8-42d6aad3b96b_Seed","component":"localTaskStore"}
{"level":"debug","ts":"2024-05-30 07:16:59.070","caller":"storage/local_storage.go:519","msg":"reclaim check, last access: 2024-05-30 07:12:52.986602762 +0000 UTC, reclaim: false","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","peer":"10.222.79.36-1-bc77a653-1d9a-4b21-b2f8-42d6aad3b96b_Seed","component":"localTaskStore"}
{"level":"debug","ts":"2024-05-30 07:17:59.071","caller":"storage/local_storage.go:519","msg":"reclaim check, last access: 2024-05-30 07:12:52.986602762 +0000 UTC, reclaim: false","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","peer":"10.222.79.36-1-bc77a653-1d9a-4b21-b2f8-42d6aad3b96b_Seed","component":"localTaskStore"}
{"level":"debug","ts":"2024-05-30 07:18:59.071","caller":"storage/local_storage.go:519","msg":"reclaim check, last access: 2024-05-30 07:12:52.986602762 +0000 UTC, reclaim: false","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","peer":"10.222.79.36-1-bc77a653-1d9a-4b21-b2f8-42d6aad3b96b_Seed","component":"localTaskStore"}
{"level":"debug","ts":"2024-05-30 07:19:59.070","caller":"storage/local_storage.go:519","msg":"reclaim check, last access: 2024-05-30 07:12:52.986602762 +0000 UTC, reclaim: false","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","peer":"10.222.79.36-1-bc77a653-1d9a-4b21-b2f8-42d6aad3b96b_Seed","component":"localTaskStore"}
{"level":"debug","ts":"2024-05-30 07:20:59.071","caller":"storage/local_storage.go:519","msg":"reclaim check, last access: 2024-05-30 07:12:52.986602762 +0000 UTC, reclaim: false","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","peer":"10.222.79.36-1-bc77a653-1d9a-4b21-b2f8-42d6aad3b96b_Seed","component":"localTaskStore"}
{"level":"debug","ts":"2024-05-30 07:21:59.071","caller":"storage/local_storage.go:519","msg":"reclaim check, last access: 2024-05-30 07:12:52.986602762 +0000 UTC, reclaim: false","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","peer":"10.222.79.36-1-bc77a653-1d9a-4b21-b2f8-42d6aad3b96b_Seed","component":"localTaskStore"}
{"level":"debug","ts":"2024-05-30 07:22:59.071","caller":"storage/local_storage.go:519","msg":"reclaim check, last access: 2024-05-30 07:12:52.986602762 +0000 UTC, reclaim: false","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","peer":"10.222.79.36-1-bc77a653-1d9a-4b21-b2f8-42d6aad3b96b_Seed","component":"localTaskStore"}
{"level":"debug","ts":"2024-05-30 07:23:59.070","caller":"storage/local_storage.go:519","msg":"reclaim check, last access: 2024-05-30 07:12:52.986602762 +0000 UTC, reclaim: false","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","peer":"10.222.79.36-1-bc77a653-1d9a-4b21-b2f8-42d6aad3b96b_Seed","component":"localTaskStore"}
{"level":"debug","ts":"2024-05-30 07:24:59.071","caller":"storage/local_storage.go:519","msg":"reclaim check, last access: 2024-05-30 07:12:52.986602762 +0000 UTC, reclaim: false","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","peer":"10.222.79.36-1-bc77a653-1d9a-4b21-b2f8-42d6aad3b96b_Seed","component":"localTaskStore"}
{"level":"debug","ts":"2024-05-30 07:25:59.071","caller":"storage/local_storage.go:519","msg":"reclaim check, last access: 2024-05-30 07:12:52.986602762 +0000 UTC, reclaim: false","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","peer":"10.222.79.36-1-bc77a653-1d9a-4b21-b2f8-42d6aad3b96b_Seed","component":"localTaskStore"}
{"level":"debug","ts":"2024-05-30 07:26:59.071","caller":"storage/local_storage.go:519","msg":"reclaim check, last access: 2024-05-30 07:12:52.986602762 +0000 UTC, reclaim: false","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","peer":"10.222.79.36-1-bc77a653-1d9a-4b21-b2f8-42d6aad3b96b_Seed","component":"localTaskStore"}
{"level":"debug","ts":"2024-05-30 07:27:59.071","caller":"storage/local_storage.go:519","msg":"reclaim check, last access: 2024-05-30 07:12:52.986602762 +0000 UTC, reclaim: false","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","peer":"10.222.79.36-1-bc77a653-1d9a-4b21-b2f8-42d6aad3b96b_Seed","component":"localTaskStore"}
{"level":"debug","ts":"2024-05-30 07:28:59.070","caller":"storage/local_storage.go:519","msg":"reclaim check, last access: 2024-05-30 07:12:52.986602762 +0000 UTC, reclaim: false","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","peer":"10.222.79.36-1-bc77a653-1d9a-4b21-b2f8-42d6aad3b96b_Seed","component":"localTaskStore"}
{"level":"debug","ts":"2024-05-30 07:29:59.070","caller":"storage/local_storage.go:519","msg":"reclaim check, last access: 2024-05-30 07:12:52.986602762 +0000 UTC, reclaim: false","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","peer":"10.222.79.36-1-bc77a653-1d9a-4b21-b2f8-42d6aad3b96b_Seed","component":"localTaskStore"}
{"level":"debug","ts":"2024-05-30 07:30:59.070","caller":"storage/local_storage.go:519","msg":"reclaim check, last access: 2024-05-30 07:12:52.986602762 +0000 UTC, reclaim: false","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","peer":"10.222.79.36-1-bc77a653-1d9a-4b21-b2f8-42d6aad3b96b_Seed","component":"localTaskStore"}
{"level":"debug","ts":"2024-05-30 07:31:59.070","caller":"storage/local_storage.go:519","msg":"reclaim check, last access: 2024-05-30 07:12:52.986602762 +0000 UTC, reclaim: false","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","peer":"10.222.79.36-1-bc77a653-1d9a-4b21-b2f8-42d6aad3b96b_Seed","component":"localTaskStore"}
{"level":"debug","ts":"2024-05-30 07:32:59.071","caller":"storage/local_storage.go:519","msg":"reclaim check, last access: 2024-05-30 07:12:52.986602762 +0000 UTC, reclaim: false","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","peer":"10.222.79.36-1-bc77a653-1d9a-4b21-b2f8-42d6aad3b96b_Seed","component":"localTaskStore"}

node crictl rmi image and kubectl delete -f /opt/yaml/nginx.yaml ,Execute again kubectl apply -f /opt/yaml/nginx.yaml

dfdaemon core.log and seed peer core.log not log output

{"level":"debug","ts":"2024-05-30 07:38:55.832","caller":"transport/transport.go:214","msg":"round trip directly, method: HEAD, url: https://harbor.test.wifi.com/v2/init-images/bigdata-1/manifests/latest?ns=harbor.test.wifi.com"}
{"level":"debug","ts":"2024-05-30 07:38:57.150","caller":"transport/transport.go:214","msg":"round trip directly, method: HEAD, url: https://harbor.test.wifi.com/v2/init-images/bigdata-1/manifests/latest?ns=harbor.test.wifi.com"}
{"level":"debug","ts":"2024-05-30 07:38:57.384","caller":"transport/transport.go:214","msg":"round trip directly, method: GET, url: https://harbor.test.wifi.com/v2/init-images/bigdata-1/manifests/sha256:c82398be5c1dbb44af983ce4726e0985a4f82ca0aa2c683571743378a5e55790?ns=harbor.test.wifi.com"}
{"level":"debug","ts":"2024-05-30 07:38:57.454","caller":"transport/transport.go:214","msg":"round trip directly, method: GET, url: https://harbor.test.wifi.com/v2/init-images/bigdata-1/manifests/sha256:c82398be5c1dbb44af983ce4726e0985a4f82ca0aa2c683571743378a5e55790?ns=harbor.test.wifi.com"}
{"level":"debug","ts":"2024-05-30 07:38:57.590","caller":"transport/transport.go:210","msg":"round trip with dragonfly: https://harbor.test.wifi.com/v2/init-images/bigdata-1/blobs/sha256:66c53c87a77e97d31723542c6839ab78318c3e45cd1b49f59274691af5858f97?ns=harbor.test.wifi.com"}
{"level":"info","ts":"2024-05-30 07:38:57.590","caller":"transport/transport.go:306","msg":"start download with url: https://harbor.test.wifi.com/v2/init-images/bigdata-1/blobs/sha256:66c53c87a77e97d31723542c6839ab78318c3e45cd1b49f59274691af5858f97?ns=harbor.test.wifi.com","peer":"10.222.79.7-19101-8c6eac6e-15a8-4775-ace4-50c1e87cce25","component":"transport","trace":"1b96a847dd6a6c364b2d81a515759e86","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b"}
{"level":"debug","ts":"2024-05-30 07:38:57.590","caller":"transport/transport.go:307","msg":"request url: https://harbor.test.wifi.com/v2/init-images/bigdata-1/blobs/sha256:66c53c87a77e97d31723542c6839ab78318c3e45cd1b49f59274691af5858f97?ns=harbor.test.wifi.com, with header: http.Header{\"Accept\":[]string{\"application/vnd.docker.container.image.v1+json, */*\"}, \"Authorization\":[]string{\"Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IjdXTUE6S1ZYTzpLRjI1OjM1TkE6R0ozNTpaR0tZOlBHWVQ6STVVVDpUR1dZOlVVSTQ6UFQ3WjpYM0tXIiwidHlwIjoiSldUIn0.eyJhdWQiOiJoYXJib3ItcmVnaXN0cnkiLCJleHAiOjE3MTcwNTY1MzcsImp0aSI6IjZ4dTNnVTF3alFmOWhKMWwiLCJpYXQiOjE3MTcwNTQ3MzcsImlzcyI6ImhhcmJvci10b2tlbi1pc3N1ZXIiLCJuYmYiOjE3MTcwNTQ3MzcsImFjY2VzcyI6W3sidHlwZSI6InJlcG9zaXRvcnkiLCJuYW1lIjoiaW5pdC1pbWFnZXMvYmlnZGF0YS0xIiwiYWN0aW9ucyI6WyJwdWxsIl19XX0.tyeBtbrDxiLB0S8_XIWd0y6ev8540tBWJh5gtvk4TuuzxClNTv7_oQBefkpWX_qBI5A0EVHn881NxwV1yt_gUMNpuE40sOPF8hnLUiC4CH5mJ50kHbu0sonkPmV7T66tgpNKfSwSo4Ct9OMudsGFlRdBjtpNr4E__ZaasOSrJsXZ8GmKjq2l8TCGORqcj7UKKQe1XkBclnVanOooHSKS2uIJW-BnjHzz0chSvWoxEqsCjP9MqeK2-ws9z_8GjL_UL4Nw8WAj39FtvKGvKNAeysBCIF6pl5duMIVXN4RNeSs8kD4PIIBMpUteOAUe8bXCtey2XlwZdEfAUV_SBMsqSjIwEy0grwkP5ssodj8DULgO0Y2AebXW9ov6h4QmnxCC7-FNg-XmiANLtBd_n28kY1fz4NhHc0MjTvMxWQeUCh3-_NKs21xMVyzXBGANRAFNSvepwy9ESBt8qgE9p6KSpOxfK_sRsAviphELLiKJ2EhnUVnGR9Y0SggZksMM35wmaJMTtrPWaif3Dl6rCuPFLcY4gIMoB58cMfOO2cGihdtxf1UNCIqMa1tpvq_OJLKBB5QqU0Z-0Vj-qq58HmEx8tx3AJebV1UaqlWG-ripA29hRl5z_HD3xWZuzmmQUHJazP-lSvln4P0P_kSayPEalkS1qqFCcnbfwM6i8JoxVtA\"}}","peer":"10.222.79.7-19101-8c6eac6e-15a8-4775-ace4-50c1e87cce25","component":"transport","trace":"1b96a847dd6a6c364b2d81a515759e86","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b"}
{"level":"info","ts":"2024-05-30 07:38:57.590","caller":"peer/peertask_reuse.go:268","msg":"reuse from peer task: 10.222.79.7-19101-5ba35686-5e5e-4eab-81b4-615bfad4ac53, total size: 9728","peer":"10.222.79.7-19101-8c6eac6e-15a8-4775-ace4-50c1e87cce25","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b","trace":"1b96a847dd6a6c364b2d81a515759e86","component":"reuseStreamPeerTask"}
{"level":"info","ts":"2024-05-30 07:38:57.590","caller":"transport/transport.go:365","msg":"download stream attribute: map[Content-Length:[9728] Content-Type:[application/octet-stream] Etag:[\"sha256:66c53c87a77e97d31723542c6839ab78318c3e45cd1b49f59274691af5858f97\"] X-Dragonfly-Peer:[10.222.79.7-19101-8c6eac6e-15a8-4775-ace4-50c1e87cce25] X-Dragonfly-Task:[9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b]]","peer":"10.222.79.7-19101-8c6eac6e-15a8-4775-ace4-50c1e87cce25","component":"transport","trace":"1b96a847dd6a6c364b2d81a515759e86","task":"9a71b97fdf0edd33d3a396d529a843f3e5af16af0d047ba4b6b91bd91bb4632b"}
{"level":"debug","ts":"2024-05-30 07:38:57.596","caller":"transport/transport.go:210","msg":"round trip with dragonfly: https://harbor.test.wifi.com/v2/init-images/bigdata-1/blobs/sha256:c730de9911cb39a76dd5aa85895f524f9b37267ee5b3b38818227dc610d994c6?ns=harbor.test.wifi.com"}
{"level":"info","ts":"2024-05-30 07:38:57.596","caller":"transport/transport.go:306","msg":"start download with url: https://harbor.test.wifi.com/v2/init-images/bigdata-1/blobs/sha256:c730de9911cb39a76dd5aa85895f524f9b37267ee5b3b38818227dc610d994c6?ns=harbor.test.wifi.com","peer":"10.222.79.7-19101-f4753d68-4aef-474a-9120-b35551885f7c","component":"transport","trace":"0e996aa3767cd93d9e386493c6b93891","task":"f5cd5868a3a7f3572307f669c303f49e4e3960bac2b26e473bfd08c16849e58b"}
{"level":"debug","ts":"2024-05-30 07:38:57.596","caller":"transport/transport.go:307","msg":"request url: https://harbor.test.wifi.com/v2/init-images/bigdata-1/blobs/sha256:c730de9911cb39a76dd5aa85895f524f9b37267ee5b3b38818227dc610d994c6?ns=harbor.test.wifi.com, with header: http.Header{\"Accept\":[]string{\"application/vnd.docker.image.rootfs.diff.tar.gzip, */*\"}, \"Authorization\":[]string{\"Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IjdXTUE6S1ZYTzpLRjI1OjM1TkE6R0ozNTpaR0tZOlBHWVQ6STVVVDpUR1dZOlVVSTQ6UFQ3WjpYM0tXIiwidHlwIjoiSldUIn0.eyJhdWQiOiJoYXJib3ItcmVnaXN0cnkiLCJleHAiOjE3MTcwNTY1MzcsImp0aSI6IjZ4dTNnVTF3alFmOWhKMWwiLCJpYXQiOjE3MTcwNTQ3MzcsImlzcyI6ImhhcmJvci10b2tlbi1pc3N1ZXIiLCJuYmYiOjE3MTcwNTQ3MzcsImFjY2VzcyI6W3sidHlwZSI6InJlcG9zaXRvcnkiLCJuYW1lIjoiaW5pdC1pbWFnZXMvYmlnZGF0YS0xIiwiYWN0aW9ucyI6WyJwdWxsIl19XX0.tyeBtbrDxiLB0S8_XIWd0y6ev8540tBWJh5gtvk4TuuzxClNTv7_oQBefkpWX_qBI5A0EVHn881NxwV1yt_gUMNpuE40sOPF8hnLUiC4CH5mJ50kHbu0sonkPmV7T66tgpNKfSwSo4Ct9OMudsGFlRdBjtpNr4E__ZaasOSrJsXZ8GmKjq2l8TCGORqcj7UKKQe1XkBclnVanOooHSKS2uIJW-BnjHzz0chSvWoxEqsCjP9MqeK2-ws9z_8GjL_UL4Nw8WAj39FtvKGvKNAeysBCIF6pl5duMIVXN4RNeSs8kD4PIIBMpUteOAUe8bXCtey2XlwZdEfAUV_SBMsqSjIwEy0grwkP5ssodj8DULgO0Y2AebXW9ov6h4QmnxCC7-FNg-XmiANLtBd_n28kY1fz4NhHc0MjTvMxWQeUCh3-_NKs21xMVyzXBGANRAFNSvepwy9ESBt8qgE9p6KSpOxfK_sRsAviphELLiKJ2EhnUVnGR9Y0SggZksMM35wmaJMTtrPWaif3Dl6rCuPFLcY4gIMoB58cMfOO2cGihdtxf1UNCIqMa1tpvq_OJLKBB5QqU0Z-0Vj-qq58HmEx8tx3AJebV1UaqlWG-ripA29hRl5z_HD3xWZuzmmQUHJazP-lSvln4P0P_kSayPEalkS1qqFCcnbfwM6i8JoxVtA\"}}","peer":"10.222.79.7-19101-f4753d68-4aef-474a-9120-b35551885f7c","component":"transport","trace":"0e996aa3767cd93d9e386493c6b93891","task":"f5cd5868a3a7f3572307f669c303f49e4e3960bac2b26e473bfd08c16849e58b"}
{"level":"info","ts":"2024-05-30 07:38:57.596","caller":"peer/peertask_reuse.go:268","msg":"reuse from peer task: 10.222.79.7-19101-23eac6dd-d179-4c27-9979-58b71f0c7cc7, total size: 1019271","peer":"10.222.79.7-19101-f4753d68-4aef-474a-9120-b35551885f7c","task":"f5cd5868a3a7f3572307f669c303f49e4e3960bac2b26e473bfd08c16849e58b","trace":"0e996aa3767cd93d9e386493c6b93891","component":"reuseStreamPeerTask"}
{"level":"info","ts":"2024-05-30 07:38:57.596","caller":"transport/transport.go:365","msg":"download stream attribute: map[Content-Length:[1019271] Content-Type:[application/octet-stream] Etag:[\"sha256:c730de9911cb39a76dd5aa85895f524f9b37267ee5b3b38818227dc610d994c6\"] X-Dragonfly-Peer:[10.222.79.7-19101-f4753d68-4aef-474a-9120-b35551885f7c] X-Dragonfly-Task:[f5cd5868a3a7f3572307f669c303f49e4e3960bac2b26e473bfd08c16849e58b]]","peer":"10.222.79.7-19101-f4753d68-4aef-474a-9120-b35551885f7c","component":"transport","trace":"0e996aa3767cd93d9e386493c6b93891","task":"f5cd5868a3a7f3572307f669c303f49e4e3960bac2b26e473bfd08c16849e58b"}

@gaius-qi

daijiezou commented 1 month ago

it hit dfdaemon local cache,you can set dfdaemon “multiplex=false” to forbid reuse underlying storage for same task id

mansoncui commented 1 month ago

it hit dfdaemon local cache,you can set dfdaemon “multiplex=false” to forbid reuse underlying storage for same task id

After I modified "multiplex=false", there is still little difference in the time it takes to pull the image to preheat or not. The disk IO increases as the image becomes larger.

The test plan is:

Starting the same pod on the same node takes the same time with or without preheating
apiVersion: apps/v1
kind: Deployment
metadata :
  name: nginx
  labels:
    app: nginx
spec:
  replicas: 1
  selector:
    matchLabels:
      app: nginx
  minReadySeconds: 5
  strategy:
    type: Recreate
  template:
    metadata:
      annotations:
        cni.projectcalico.org/ipv4pools: '["ipam-out-pool"]'
      labels:
        app: nginx
    spec:
      containers:
      - name: nginx
        image: harbor.test.wifi.com/init-images/bigdata-1:latest
        resources:
          requests:
            memory: "100Mi"
          limits:
            memory: "150Mi"
        ports:
        - containerPort: 18080
          name: web-18080
        - containerPort: 80
          name: web

kubectl apply -f nginx.yaml Kubectl describe pod nginx-xxxxx see pull image time

image

seed peer core.log error info:

{"level":"error","ts":"2024-05-30 11:17:02.612","caller":"rpcserver/rpcserver.go:329","msg":"receive reminding piece tasks request error: rpc error: code = Canceled desc = context canceled","stacktrace":"d7y.io/dragonfly/v2/client/daemon/rpcserver.(*server).SyncPieceTasks.func2\n\t/go/src/d7y.io/dragonfly/v2/client/daemon/rpcserver/rpcserver.go:329\nd7y.io/dragonfly/v2/client/daemon/rpcserver.(*server).SyncPieceTasks\n\t/go/src/d7y.io/dragonfly/v2/client/daemon/rpcserver/rpcserver.go:343\nd7y.io/api/v2/pkg/apis/dfdaemon/v1._Daemon_SyncPieceTasks_Handler\n\t/go/pkg/mod/d7y.io/api/v2@v2.0.110/pkg/apis/dfdaemon/v1/dfdaemon_grpc.pb.go:344\ngithub.com/grpc-ecosystem/go-grpc-middleware/recovery.StreamServerInterceptor.func1\n\t/go/pkg/mod/github.com/grpc-ecosystem/go-grpc-middleware@v1.4.0/recovery/interceptors.go:51\nd7y.io/dragonfly/v2/pkg/rpc/dfdaemon/server.New.ChainStreamServer.func9.1\n\t/go/pkg/mod/github.com/grpc-ecosystem/go-grpc-middleware@v1.4.0/chain.go:83\nd7y.io/dragonfly/v2/pkg/rpc/dfdaemon/server.New.StreamServerInterceptor.func7\n\t/go/pkg/mod/github.com/grpc-ecosystem/go-grpc-middleware@v1.4.0/validator/validator.go:72\nd7y.io/dragonfly/v2/pkg/rpc/dfdaemon/server.New.ChainStreamServer.func9.1\n\t/go/pkg/mod/github.com/grpc-ecosystem/go-grpc-middleware@v1.4.0/chain.go:83\ngithub.com/grpc-ecosystem/go-grpc-middleware/logging/zap.StreamServerInterceptor.func1\n\t/go/pkg/mod/github.com/grpc-ecosystem/go-grpc-middleware@v1.4.0/logging/zap/server_interceptors.go:53\nd7y.io/dragonfly/v2/pkg/rpc/dfdaemon/server.New.ChainStreamServer.func9.1\n\t/go/pkg/mod/github.com/grpc-ecosystem/go-grpc-middleware@v1.4.0/chain.go:83\ngithub.com/grpc-ecosystem/go-grpc-prometheus.init.(*ServerMetrics).StreamServerInterceptor.func4\n\t/go/pkg/mod/github.com/grpc-ecosystem/go-grpc-prometheus@v1.2.0/server_metrics.go:121\nd7y.io/dragonfly/v2/pkg/rpc/dfdaemon/server.New.ChainStreamServer.func9.1\n\t/go/pkg/mod/github.com/grpc-ecosystem/go-grpc-middleware@v1.4.0/chain.go:83\nd7y.io/dragonfly/v2/pkg/rpc.ConvertErrorStreamServerInterceptor\n\t/go/src/d7y.io/dragonfly/v2/pkg/rpc/interceptor.go:103\nd7y.io/dragonfly/v2/pkg/rpc/dfdaemon/server.New.ChainStreamServer.func9.1\n\t/go/pkg/mod/github.com/grpc-ecosystem/go-grpc-middleware@v1.4.0/chain.go:83\nd7y.io/dragonfly/v2/pkg/rpc/dfdaemon/server.New.StreamServerInterceptor.func6\n\t/go/pkg/mod/github.com/grpc-ecosystem/go-grpc-middleware@v1.4.0/ratelimit/ratelimit.go:34\nd7y.io/dragonfly/v2/pkg/rpc/dfdaemon/server.New.ChainStreamServer.func9\n\t/go/pkg/mod/github.com/grpc-ecosystem/go-grpc-middleware@v1.4.0/chain.go:86\ngoogle.golang.org/grpc.(*Server).processStreamingRPC\n\t/go/pkg/mod/google.golang.org/grpc@v1.63.2/server.go:1670\ngoogle.golang.org/grpc.(*Server).handleStream\n\t/go/pkg/mod/google.golang.org/grpc@v1.63.2/server.go:1784\ngoogle.golang.org/grpc.(*Server).serveStreams.func2.1\n\t/go/pkg/mod/google.golang.org/grpc@v1.63.2/server.go:1019"}

Then crictl rmi image and then start the pod on the node node, and then check the pod startup time crictl rmi image and kubectl delete -f nginx.yaml ,pod run same node

kubectl apply -f nginx.yaml Kubectl describe pod nginx-xxxxx see pull image time

image

@gaius-qi @daijiezou

mansoncui commented 1 month ago
image

disk io becomes high

daijiezou commented 1 month ago

According to the author, when the load on the source node is not high, there is little difference between the download speed of the image back to source

mansoncui commented 1 month ago

According to the author, when the load on the source node is not high, there is little difference between the download speed of the image back to source

Looking at the logs, only two nodes trigger piece peer download. How to enable multiple nodes? Are there any parameters that can be configured?

dragonfly-scheduler core.log info:

{"level":"info","ts":"2024-05-31 02:08:18.685","caller":"service/service_v1.go:97","msg":"register peer task request: &scheduler.PeerTaskRequest{state:impl.MessageState{NoUnkeyedLiterals:pragma.NoUnkeyedLiterals{}, DoNotCompare:pragma.DoNotCompare{}, DoNotCopy:pragma.DoNotCopy{}, atomicMessageInfo:(*impl.MessageInfo)(0xc000c0c500)}, sizeCache:0, unknownFields:[]uint8(nil), Url:\"https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:4445ea2ce25d955765d7daeb03314106c52fe845df9bdf41c20a58fede61d7f1?ns=harbor.test.wifi.com\", UrlMeta:(*common.UrlMeta)(0xc000fd0990), PeerId:\"10.222.79.9-16589-47b913d2-f2c7-4e64-8403-65e4f2e5ca34\", PeerHost:(*scheduler.PeerHost)(0xc000dbc600), Prefetch:false, IsMigrating:false, TaskId:\"e1697ef5bc877913be3673a58f8e6a91ec807039b14790171170a3a1b3078db6\"}","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"e1697ef5bc877913be3673a58f8e6a91ec807039b14790171170a3a1b3078db6","peerID":"10.222.79.9-16589-47b913d2-f2c7-4e64-8403-65e4f2e5ca34"}
{"level":"info","ts":"2024-05-31 02:08:18.685","caller":"service/service_v1.go:941","msg":"task already exists","taskID":"e1697ef5bc877913be3673a58f8e6a91ec807039b14790171170a3a1b3078db6","url":"https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:4445ea2ce25d955765d7daeb03314106c52fe845df9bdf41c20a58fede61d7f1?ns=harbor.test.wifi.com"}
{"level":"info","ts":"2024-05-31 02:08:18.685","caller":"service/service_v1.go:973","msg":"host already exists","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","hostname":"dragonfly-dfdaemon-w9kjj","ip":"10.222.79.9"}
{"level":"info","ts":"2024-05-31 02:08:18.686","caller":"service/service_v1.go:996","msg":"create new peer","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"e1697ef5bc877913be3673a58f8e6a91ec807039b14790171170a3a1b3078db6","peerID":"10.222.79.9-16589-47b913d2-f2c7-4e64-8403-65e4f2e5ca34"}
{"level":"info","ts":"2024-05-31 02:08:18.686","caller":"service/service_v1.go:831","msg":"peer does not need to trigger","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"e1697ef5bc877913be3673a58f8e6a91ec807039b14790171170a3a1b3078db6","peerID":"10.222.79.9-16589-47b913d2-f2c7-4e64-8403-65e4f2e5ca34"}
{"level":"info","ts":"2024-05-31 02:08:18.686","caller":"service/service_v1.go:137","msg":"task size scope is SMALL","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"e1697ef5bc877913be3673a58f8e6a91ec807039b14790171170a3a1b3078db6","peerID":"10.222.79.9-16589-47b913d2-f2c7-4e64-8403-65e4f2e5ca34"}
{"level":"info","ts":"2024-05-31 02:08:18.686","caller":"scheduling/scheduling.go:431","msg":"peer state is Pending, can not schedule parent","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"e1697ef5bc877913be3673a58f8e6a91ec807039b14790171170a3a1b3078db6","peerID":"10.222.79.9-16589-47b913d2-f2c7-4e64-8403-65e4f2e5ca34"}
{"level":"warn","ts":"2024-05-31 02:08:18.686","caller":"service/service_v1.go:168","msg":"candidate parent not found","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"e1697ef5bc877913be3673a58f8e6a91ec807039b14790171170a3a1b3078db6","peerID":"10.222.79.9-16589-47b913d2-f2c7-4e64-8403-65e4f2e5ca34","stacktrace":"d7y.io/dragonfly/v2/scheduler/service.(*V1).RegisterPeerTask\n\t/go/src/d7y.io/dragonfly/v2/scheduler/service/service_v1.go:168\nd7y.io/dragonfly/v2/scheduler/rpcserver.(*schedulerServerV1).RegisterPeerTask\n\t/go/src/d7y.io/dragonfly/v2/scheduler/rpcserver/scheduler_server_v1.go:70\nd7y.io/api/v2/pkg/apis/scheduler/v1._Scheduler_RegisterPeerTask_Handler.func1\n\t/go/pkg/mod/d7y.io/api/v2@v2.0.110/pkg/apis/scheduler/v1/scheduler_grpc.pb.go:259\ngithub.com/grpc-ecosystem/go-grpc-middleware/recovery.UnaryServerInterceptor.func1\n\t/go/pkg/mod/github.com/grpc-ecosystem/go-grpc-middleware@v1.4.0/recovery/interceptors.go:33\nd7y.io/dragonfly/v2/pkg/rpc/scheduler/server.New.ChainUnaryServer.func5.1\n\t/go/pkg/mod/github.com/grpc-ecosystem/go-grpc-middleware@v1.4.0/chain.go:48\nd7y.io/dragonfly/v2/pkg/rpc/scheduler/server.New.UnaryServerInterceptor.func3\n\t/go/pkg/mod/github.com/grpc-ecosystem/go-grpc-middleware@v1.4.0/validator/validator.go:47\nd7y.io/dragonfly/v2/pkg/rpc/scheduler/server.New.ChainUnaryServer.func5.1\n\t/go/pkg/mod/github.com/grpc-ecosystem/go-grpc-middleware@v1.4.0/chain.go:48\ngithub.com/grpc-ecosystem/go-grpc-middleware/logging/zap.UnaryServerInterceptor.func1\n\t/go/pkg/mod/github.com/grpc-ecosystem/go-grpc-middleware@v1.4.0/logging/zap/server_interceptors.go:31\nd7y.io/dragonfly/v2/pkg/rpc/scheduler/server.New.ChainUnaryServer.func5.1\n\t/go/pkg/mod/github.com/grpc-ecosystem/go-grpc-middleware@v1.4.0/chain.go:48\ngithub.com/grpc-ecosystem/go-grpc-prometheus.init.(*ServerMetrics).UnaryServerInterceptor.func3\n\t/go/pkg/mod/github.com/grpc-ecosystem/go-grpc-prometheus@v1.2.0/server_metrics.go:107\nd7y.io/dragonfly/v2/pkg/rpc/scheduler/server.New.ChainUnaryServer.func5.1\n\t/go/pkg/mod/github.com/grpc-ecosystem/go-grpc-middleware@v1.4.0/chain.go:48\nd7y.io/dragonfly/v2/pkg/rpc.ConvertErrorUnaryServerInterceptor\n\t/go/src/d7y.io/dragonfly/v2/pkg/rpc/interceptor.go:93\nd7y.io/dragonfly/v2/pkg/rpc/scheduler/server.New.ChainUnaryServer.func5.1\n\t/go/pkg/mod/github.com/grpc-ecosystem/go-grpc-middleware@v1.4.0/chain.go:48\nd7y.io/dragonfly/v2/pkg/rpc/scheduler/server.New.UnaryServerInterceptor.func2\n\t/go/pkg/mod/github.com/grpc-ecosystem/go-grpc-middleware@v1.4.0/ratelimit/ratelimit.go:24\nd7y.io/dragonfly/v2/pkg/rpc/scheduler/server.New.ChainUnaryServer.func5\n\t/go/pkg/mod/github.com/grpc-ecosystem/go-grpc-middleware@v1.4.0/chain.go:53\nd7y.io/api/v2/pkg/apis/scheduler/v1._Scheduler_RegisterPeerTask_Handler\n\t/go/pkg/mod/d7y.io/api/v2@v2.0.110/pkg/apis/scheduler/v1/scheduler_grpc.pb.go:261\ngoogle.golang.org/grpc.(*Server).processUnaryRPC\n\t/go/pkg/mod/google.golang.org/grpc@v1.63.2/server.go:1369\ngoogle.golang.org/grpc.(*Server).handleStream\n\t/go/pkg/mod/google.golang.org/grpc@v1.63.2/server.go:1780\ngoogle.golang.org/grpc.(*Server).serveStreams.func2.1\n\t/go/pkg/mod/google.golang.org/grpc@v1.63.2/server.go:1019"}
{"level":"info","ts":"2024-05-31 02:08:18.686","caller":"resource/peer.go:264","msg":"peer state is ReceivedNormal","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"e1697ef5bc877913be3673a58f8e6a91ec807039b14790171170a3a1b3078db6","peerID":"10.222.79.9-16589-47b913d2-f2c7-4e64-8403-65e4f2e5ca34"}
{"level":"info","ts":"2024-05-31 02:08:18.686","caller":"service/service_v1.go:182","msg":"register as normal task","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"e1697ef5bc877913be3673a58f8e6a91ec807039b14790171170a3a1b3078db6","peerID":"10.222.79.9-16589-47b913d2-f2c7-4e64-8403-65e4f2e5ca34"}
{"level":"info","ts":"2024-05-31 02:08:18.686","caller":"service/service_v1.go:235","msg":"receive begin of piece: &scheduler.PieceResult{state:impl.MessageState{NoUnkeyedLiterals:pragma.NoUnkeyedLiterals{}, DoNotCompare:pragma.DoNotCompare{}, DoNotCopy:pragma.DoNotCopy{}, atomicMessageInfo:(*impl.MessageInfo)(0xc000c0ca20)}, sizeCache:0, unknownFields:[]uint8(nil), TaskId:\"e1697ef5bc877913be3673a58f8e6a91ec807039b14790171170a3a1b3078db6\", SrcPid:\"10.222.79.9-16589-47b913d2-f2c7-4e64-8403-65e4f2e5ca34\", DstPid:\"\", PieceInfo:(*common.PieceInfo)(0xc0007510a0), BeginTime:0x0, EndTime:0x0, Success:false, Code:0, FinishedCount:0, ExtendAttribute:(*common.ExtendAttribute)(nil)} &common.PieceInfo{state:impl.MessageState{NoUnkeyedLiterals:pragma.NoUnkeyedLiterals{}, DoNotCompare:pragma.DoNotCompare{}, DoNotCopy:pragma.DoNotCopy{}, atomicMessageInfo:(*impl.MessageInfo)(nil)}, sizeCache:0, unknownFields:[]uint8(nil), PieceNum:-1, RangeStart:0x0, RangeSize:0x0, PieceMd5:\"\", PieceOffset:0x0, PieceStyle:0, DownloadCost:0x0}","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"e1697ef5bc877913be3673a58f8e6a91ec807039b14790171170a3a1b3078db6","peerID":"10.222.79.9-16589-47b913d2-f2c7-4e64-8403-65e4f2e5ca34"}
{"level":"info","ts":"2024-05-31 02:08:18.686","caller":"service/service_v1.go:1124","msg":"peer state is ReceivedNormal","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"e1697ef5bc877913be3673a58f8e6a91ec807039b14790171170a3a1b3078db6","peerID":"10.222.79.9-16589-47b913d2-f2c7-4e64-8403-65e4f2e5ca34"}
{"level":"info","ts":"2024-05-31 02:08:18.686","caller":"resource/peer.go:268","msg":"peer state is Running","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"e1697ef5bc877913be3673a58f8e6a91ec807039b14790171170a3a1b3078db6","peerID":"10.222.79.9-16589-47b913d2-f2c7-4e64-8403-65e4f2e5ca34"}
{"level":"debug","ts":"2024-05-31 02:08:18.686","caller":"evaluator/evaluator.go:106","msg":"peer 10.222.30.40-19280-883d8f9a-ab2c-4380-981a-a2ce83577c57 has not finished downloading enough piece, it can't be bad node"}
{"level":"debug","ts":"2024-05-31 02:08:18.686","caller":"evaluator/evaluator.go:106","msg":"peer 10.222.87.184-27447-78b03fae-6fb1-4a79-8a34-d7b3fbba3574 has not finished downloading enough piece, it can't be bad node"}
{"level":"debug","ts":"2024-05-31 02:08:18.686","caller":"scheduling/scheduling.go:523","msg":"parent 10.222.79.9-16589-0e2c077e-e50e-4b5c-a4e0-808926f16964 host 890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41 is the same as peer host","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"e1697ef5bc877913be3673a58f8e6a91ec807039b14790171170a3a1b3078db6","peerID":"10.222.79.9-16589-47b913d2-f2c7-4e64-8403-65e4f2e5ca34"}
{"level":"debug","ts":"2024-05-31 02:08:18.686","caller":"scheduling/scheduling.go:523","msg":"parent 10.222.79.9-16589-c7d97964-29b5-4802-abb1-550ff186f7fd host 890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41 is the same as peer host","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"e1697ef5bc877913be3673a58f8e6a91ec807039b14790171170a3a1b3078db6","peerID":"10.222.79.9-16589-47b913d2-f2c7-4e64-8403-65e4f2e5ca34"}
{"level":"debug","ts":"2024-05-31 02:08:18.686","caller":"scheduling/scheduling.go:523","msg":"parent 10.222.79.9-16589-47b913d2-f2c7-4e64-8403-65e4f2e5ca34 host 890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41 is the same as peer host","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"e1697ef5bc877913be3673a58f8e6a91ec807039b14790171170a3a1b3078db6","peerID":"10.222.79.9-16589-47b913d2-f2c7-4e64-8403-65e4f2e5ca34"}
{"level":"info","ts":"2024-05-31 02:08:18.687","caller":"scheduling/scheduling.go:569","msg":"filter candidate parents is []string{\"10.222.30.40-19280-883d8f9a-ab2c-4380-981a-a2ce83577c57\", \"10.222.87.184-27447-78b03fae-6fb1-4a79-8a34-d7b3fbba3574\"}","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"e1697ef5bc877913be3673a58f8e6a91ec807039b14790171170a3a1b3078db6","peerID":"10.222.79.9-16589-47b913d2-f2c7-4e64-8403-65e4f2e5ca34"}
{"level":"info","ts":"2024-05-31 02:08:18.687","caller":"scheduling/scheduling.go:421","msg":"scheduling candidate parents is []string{\"10.222.30.40-19280-883d8f9a-ab2c-4380-981a-a2ce83577c57\", \"10.222.87.184-27447-78b03fae-6fb1-4a79-8a34-d7b3fbba3574\"}","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"e1697ef5bc877913be3673a58f8e6a91ec807039b14790171170a3a1b3078db6","peerID":"10.222.79.9-16589-47b913d2-f2c7-4e64-8403-65e4f2e5ca34"}
{"level":"info","ts":"2024-05-31 02:08:18.687","caller":"scheduling/scheduling.go:357","msg":"send PeerPacket to peer","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"e1697ef5bc877913be3673a58f8e6a91ec807039b14790171170a3a1b3078db6","peerID":"10.222.79.9-16589-47b913d2-f2c7-4e64-8403-65e4f2e5ca34"}
{"level":"info","ts":"2024-05-31 02:08:18.687","caller":"scheduling/scheduling.go:378","msg":"scheduling success in 1 times","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"e1697ef5bc877913be3673a58f8e6a91ec807039b14790171170a3a1b3078db6","peerID":"10.222.79.9-16589-47b913d2-f2c7-4e64-8403-65e4f2e5ca34"}
{"level":"info","ts":"2024-05-31 02:08:18.690","caller":"service/service_v1.go:250","msg":"receive success piece: &scheduler.PieceResult{state:impl.MessageState{NoUnkeyedLiterals:pragma.NoUnkeyedLiterals{}, DoNotCompare:pragma.DoNotCompare{}, DoNotCopy:pragma.DoNotCopy{}, atomicMessageInfo:(*impl.MessageInfo)(0xc000c0ca20)}, sizeCache:0, unknownFields:[]uint8(nil), TaskId:\"e1697ef5bc877913be3673a58f8e6a91ec807039b14790171170a3a1b3078db6\", SrcPid:\"10.222.79.9-16589-47b913d2-f2c7-4e64-8403-65e4f2e5ca34\", DstPid:\"10.222.87.184-27447-78b03fae-6fb1-4a79-8a34-d7b3fbba3574\", PieceInfo:(*common.PieceInfo)(0xc0007512d0), BeginTime:0x17d470b934a1621c, EndTime:0x17d470b934b1dbee, Success:true, Code:200, FinishedCount:0, ExtendAttribute:(*common.ExtendAttribute)(nil)} &common.PieceInfo{state:impl.MessageState{NoUnkeyedLiterals:pragma.NoUnkeyedLiterals{}, DoNotCompare:pragma.DoNotCompare{}, DoNotCopy:pragma.DoNotCopy{}, atomicMessageInfo:(*impl.MessageInfo)(nil)}, sizeCache:0, unknownFields:[]uint8(nil), PieceNum:0, RangeStart:0x0, RangeSize:0x2602, PieceMd5:\"b75e4e757f86cbf3ffe305785e7a78a9\", PieceOffset:0x0, PieceStyle:0, DownloadCost:0x2c6}","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"e1697ef5bc877913be3673a58f8e6a91ec807039b14790171170a3a1b3078db6","peerID":"10.222.79.9-16589-47b913d2-f2c7-4e64-8403-65e4f2e5ca34"}
{"level":"info","ts":"2024-05-31 02:08:18.690","caller":"service/service_v1.go:242","msg":"receive end of piece: &scheduler.PieceResult{state:impl.MessageState{NoUnkeyedLiterals:pragma.NoUnkeyedLiterals{}, DoNotCompare:pragma.DoNotCompare{}, DoNotCopy:pragma.DoNotCopy{}, atomicMessageInfo:(*impl.MessageInfo)(0xc000c0ca20)}, sizeCache:0, unknownFields:[]uint8(nil), TaskId:\"e1697ef5bc877913be3673a58f8e6a91ec807039b14790171170a3a1b3078db6\", SrcPid:\"10.222.79.9-16589-47b913d2-f2c7-4e64-8403-65e4f2e5ca34\", DstPid:\"\", PieceInfo:(*common.PieceInfo)(0xc000751420), BeginTime:0x0, EndTime:0x0, Success:false, Code:0, FinishedCount:1, ExtendAttribute:(*common.ExtendAttribute)(nil)} &common.PieceInfo{state:impl.MessageState{NoUnkeyedLiterals:pragma.NoUnkeyedLiterals{}, DoNotCompare:pragma.DoNotCompare{}, DoNotCopy:pragma.DoNotCopy{}, atomicMessageInfo:(*impl.MessageInfo)(nil)}, sizeCache:0, unknownFields:[]uint8(nil), PieceNum:1073741824, RangeStart:0x0, RangeSize:0x0, PieceMd5:\"\", PieceOffset:0x0, PieceStyle:0, DownloadCost:0x0}","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"e1697ef5bc877913be3673a58f8e6a91ec807039b14790171170a3a1b3078db6","peerID":"10.222.79.9-16589-47b913d2-f2c7-4e64-8403-65e4f2e5ca34"}
{"level":"info","ts":"2024-05-31 02:08:18.690","caller":"service/service_v1.go:296","msg":"report peer result request: &scheduler.PeerResult{state:impl.MessageState{NoUnkeyedLiterals:pragma.NoUnkeyedLiterals{}, DoNotCompare:pragma.DoNotCompare{}, DoNotCopy:pragma.DoNotCopy{}, atomicMessageInfo:(*impl.MessageInfo)(0xc000c0ccb0)}, sizeCache:0, unknownFields:[]uint8(nil), TaskId:\"e1697ef5bc877913be3673a58f8e6a91ec807039b14790171170a3a1b3078db6\", PeerId:\"10.222.79.9-16589-47b913d2-f2c7-4e64-8403-65e4f2e5ca34\", SrcIp:\"10.222.79.9\", Idc:\"\", Url:\"https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:4445ea2ce25d955765d7daeb03314106c52fe845df9bdf41c20a58fede61d7f1?ns=harbor.test.wifi.com\", ContentLength:9730, Traffic:0x0, Cost:0x5, Success:true, Code:200, TotalPieceCount:1, Errordetails:scheduler.isPeerResult_Errordetails(nil)}","taskID":"e1697ef5bc877913be3673a58f8e6a91ec807039b14790171170a3a1b3078db6","peerID":"10.222.79.9-16589-47b913d2-f2c7-4e64-8403-65e4f2e5ca34"}
{"level":"info","ts":"2024-05-31 02:08:18.691","caller":"resource/peer.go:494","msg":"application not found","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"e1697ef5bc877913be3673a58f8e6a91ec807039b14790171170a3a1b3078db6","peerID":"10.222.79.9-16589-47b913d2-f2c7-4e64-8403-65e4f2e5ca34"}
{"level":"info","ts":"2024-05-31 02:08:18.691","caller":"service/service_v1.go:333","msg":"report success peer","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"e1697ef5bc877913be3673a58f8e6a91ec807039b14790171170a3a1b3078db6","peerID":"10.222.79.9-16589-47b913d2-f2c7-4e64-8403-65e4f2e5ca34"}
{"level":"info","ts":"2024-05-31 02:08:18.691","caller":"resource/peer.go:291","msg":"peer state is Succeeded","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"e1697ef5bc877913be3673a58f8e6a91ec807039b14790171170a3a1b3078db6","peerID":"10.222.79.9-16589-47b913d2-f2c7-4e64-8403-65e4f2e5ca34"}
{"level":"info","ts":"2024-05-31 02:08:18.697","caller":"service/service_v1.go:97","msg":"register peer task request: &scheduler.PeerTaskRequest{state:impl.MessageState{NoUnkeyedLiterals:pragma.NoUnkeyedLiterals{}, DoNotCompare:pragma.DoNotCompare{}, DoNotCopy:pragma.DoNotCopy{}, atomicMessageInfo:(*impl.MessageInfo)(0xc000c0c500)}, sizeCache:0, unknownFields:[]uint8(nil), Url:\"https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:fec9938e9c9cf860b9dcb7f9cf8885d1341a70e7d89bc5305056a9b1bdf76fcf?ns=harbor.test.wifi.com\", UrlMeta:(*common.UrlMeta)(0xc0015af710), PeerId:\"10.222.79.9-16589-e9ccae92-1719-424d-abc4-099715c0c59a\", PeerHost:(*scheduler.PeerHost)(0xc001350500), Prefetch:false, IsMigrating:false, TaskId:\"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320\"}","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320","peerID":"10.222.79.9-16589-e9ccae92-1719-424d-abc4-099715c0c59a"}
{"level":"info","ts":"2024-05-31 02:08:18.697","caller":"service/service_v1.go:941","msg":"task already exists","taskID":"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320","url":"https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:fec9938e9c9cf860b9dcb7f9cf8885d1341a70e7d89bc5305056a9b1bdf76fcf?ns=harbor.test.wifi.com"}
{"level":"info","ts":"2024-05-31 02:08:18.697","caller":"service/service_v1.go:973","msg":"host already exists","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","hostname":"dragonfly-dfdaemon-w9kjj","ip":"10.222.79.9"}
{"level":"info","ts":"2024-05-31 02:08:18.697","caller":"service/service_v1.go:996","msg":"create new peer","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320","peerID":"10.222.79.9-16589-e9ccae92-1719-424d-abc4-099715c0c59a"}
{"level":"info","ts":"2024-05-31 02:08:18.697","caller":"service/service_v1.go:831","msg":"peer does not need to trigger","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320","peerID":"10.222.79.9-16589-e9ccae92-1719-424d-abc4-099715c0c59a"}
{"level":"info","ts":"2024-05-31 02:08:18.697","caller":"service/service_v1.go:137","msg":"task size scope is NORMAL","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320","peerID":"10.222.79.9-16589-e9ccae92-1719-424d-abc4-099715c0c59a"}
{"level":"info","ts":"2024-05-31 02:08:18.697","caller":"resource/peer.go:264","msg":"peer state is ReceivedNormal","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320","peerID":"10.222.79.9-16589-e9ccae92-1719-424d-abc4-099715c0c59a"}
{"level":"info","ts":"2024-05-31 02:08:18.697","caller":"service/service_v1.go:182","msg":"register as normal task","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320","peerID":"10.222.79.9-16589-e9ccae92-1719-424d-abc4-099715c0c59a"}
{"level":"info","ts":"2024-05-31 02:08:18.698","caller":"service/service_v1.go:235","msg":"receive begin of piece: &scheduler.PieceResult{state:impl.MessageState{NoUnkeyedLiterals:pragma.NoUnkeyedLiterals{}, DoNotCompare:pragma.DoNotCompare{}, DoNotCopy:pragma.DoNotCopy{}, atomicMessageInfo:(*impl.MessageInfo)(0xc000c0ca20)}, sizeCache:0, unknownFields:[]uint8(nil), TaskId:\"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320\", SrcPid:\"10.222.79.9-16589-e9ccae92-1719-424d-abc4-099715c0c59a\", DstPid:\"\", PieceInfo:(*common.PieceInfo)(0xc000751570), BeginTime:0x0, EndTime:0x0, Success:false, Code:0, FinishedCount:0, ExtendAttribute:(*common.ExtendAttribute)(nil)} &common.PieceInfo{state:impl.MessageState{NoUnkeyedLiterals:pragma.NoUnkeyedLiterals{}, DoNotCompare:pragma.DoNotCompare{}, DoNotCopy:pragma.DoNotCopy{}, atomicMessageInfo:(*impl.MessageInfo)(nil)}, sizeCache:0, unknownFields:[]uint8(nil), PieceNum:-1, RangeStart:0x0, RangeSize:0x0, PieceMd5:\"\", PieceOffset:0x0, PieceStyle:0, DownloadCost:0x0}","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320","peerID":"10.222.79.9-16589-e9ccae92-1719-424d-abc4-099715c0c59a"}
{"level":"info","ts":"2024-05-31 02:08:18.698","caller":"service/service_v1.go:1124","msg":"peer state is ReceivedNormal","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320","peerID":"10.222.79.9-16589-e9ccae92-1719-424d-abc4-099715c0c59a"}
{"level":"info","ts":"2024-05-31 02:08:18.698","caller":"resource/peer.go:268","msg":"peer state is Running","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320","peerID":"10.222.79.9-16589-e9ccae92-1719-424d-abc4-099715c0c59a"}
{"level":"debug","ts":"2024-05-31 02:08:18.698","caller":"evaluator/evaluator.go:117","msg":"peer 10.222.30.40-19280-7f4efb2f-064b-4c8f-9fc2-527c1b6cef6d mean is 13036500000.00 and it is bad node: false"}
{"level":"debug","ts":"2024-05-31 02:08:18.698","caller":"scheduling/scheduling.go:523","msg":"parent 10.222.79.9-16589-e9ccae92-1719-424d-abc4-099715c0c59a host 890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41 is the same as peer host","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320","peerID":"10.222.79.9-16589-e9ccae92-1719-424d-abc4-099715c0c59a"}
{"level":"debug","ts":"2024-05-31 02:08:18.698","caller":"evaluator/evaluator.go:117","msg":"peer 10.222.87.184-27447-7d77e4c0-f1bc-4da4-ae34-20d33fd1f6e9 mean is 13036500000.00 and it is bad node: false"}
{"level":"debug","ts":"2024-05-31 02:08:18.698","caller":"scheduling/scheduling.go:523","msg":"parent 10.222.79.9-16589-1262e113-5ec4-4c65-942d-d69a00f82d26 host 890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41 is the same as peer host","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320","peerID":"10.222.79.9-16589-e9ccae92-1719-424d-abc4-099715c0c59a"}
{"level":"debug","ts":"2024-05-31 02:08:18.698","caller":"scheduling/scheduling.go:523","msg":"parent 10.222.79.9-16589-a32d7dbb-e1d8-40d3-b485-4dfba8dc2557 host 890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41 is the same as peer host","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320","peerID":"10.222.79.9-16589-e9ccae92-1719-424d-abc4-099715c0c59a"}
{"level":"info","ts":"2024-05-31 02:08:18.698","caller":"scheduling/scheduling.go:569","msg":"filter candidate parents is []string{\"10.222.30.40-19280-7f4efb2f-064b-4c8f-9fc2-527c1b6cef6d\", \"10.222.87.184-27447-7d77e4c0-f1bc-4da4-ae34-20d33fd1f6e9\"}","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320","peerID":"10.222.79.9-16589-e9ccae92-1719-424d-abc4-099715c0c59a"}
{"level":"info","ts":"2024-05-31 02:08:18.698","caller":"scheduling/scheduling.go:421","msg":"scheduling candidate parents is []string{\"10.222.30.40-19280-7f4efb2f-064b-4c8f-9fc2-527c1b6cef6d\", \"10.222.87.184-27447-7d77e4c0-f1bc-4da4-ae34-20d33fd1f6e9\"}","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320","peerID":"10.222.79.9-16589-e9ccae92-1719-424d-abc4-099715c0c59a"}
{"level":"info","ts":"2024-05-31 02:08:18.698","caller":"scheduling/scheduling.go:357","msg":"send PeerPacket to peer","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320","peerID":"10.222.79.9-16589-e9ccae92-1719-424d-abc4-099715c0c59a"}
{"level":"info","ts":"2024-05-31 02:08:18.698","caller":"scheduling/scheduling.go:378","msg":"scheduling success in 1 times","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320","peerID":"10.222.79.9-16589-e9ccae92-1719-424d-abc4-099715c0c59a"}
{"level":"info","ts":"2024-05-31 02:08:18.710","caller":"service/service_v1.go:250","msg":"receive success piece: &scheduler.PieceResult{state:impl.MessageState{NoUnkeyedLiterals:pragma.NoUnkeyedLiterals{}, DoNotCompare:pragma.DoNotCompare{}, DoNotCopy:pragma.DoNotCopy{}, atomicMessageInfo:(*impl.MessageInfo)(0xc000c0ca20)}, sizeCache:0, unknownFields:[]uint8(nil), TaskId:\"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320\", SrcPid:\"10.222.79.9-16589-e9ccae92-1719-424d-abc4-099715c0c59a\", DstPid:\"10.222.30.40-19280-7f4efb2f-064b-4c8f-9fc2-527c1b6cef6d\", PieceInfo:(*common.PieceInfo)(0xc000751810), BeginTime:0x17d470b9354fbd7a, EndTime:0x17d470b935e72385, Success:true, Code:200, FinishedCount:0, ExtendAttribute:(*common.ExtendAttribute)(nil)} &common.PieceInfo{state:impl.MessageState{NoUnkeyedLiterals:pragma.NoUnkeyedLiterals{}, DoNotCompare:pragma.DoNotCompare{}, DoNotCopy:pragma.DoNotCopy{}, atomicMessageInfo:(*impl.MessageInfo)(nil)}, sizeCache:0, unknownFields:[]uint8(nil), PieceNum:2, RangeStart:0x800000, RangeSize:0x1b82a3, PieceMd5:\"140fe306a2f10c778988213b893af47e\", PieceOffset:0x800000, PieceStyle:0, DownloadCost:0x212c}","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320","peerID":"10.222.79.9-16589-e9ccae92-1719-424d-abc4-099715c0c59a"}
{"level":"info","ts":"2024-05-31 02:08:18.722","caller":"service/service_v1.go:250","msg":"receive success piece: &scheduler.PieceResult{state:impl.MessageState{NoUnkeyedLiterals:pragma.NoUnkeyedLiterals{}, DoNotCompare:pragma.DoNotCompare{}, DoNotCopy:pragma.DoNotCopy{}, atomicMessageInfo:(*impl.MessageInfo)(0xc000c0ca20)}, sizeCache:0, unknownFields:[]uint8(nil), TaskId:\"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320\", SrcPid:\"10.222.79.9-16589-e9ccae92-1719-424d-abc4-099715c0c59a\", DstPid:\"10.222.30.40-19280-7f4efb2f-064b-4c8f-9fc2-527c1b6cef6d\", PieceInfo:(*common.PieceInfo)(0xc000751ab0), BeginTime:0x17d470b9354f18fb, EndTime:0x17d470b9369f6687, Success:true, Code:200, FinishedCount:1, ExtendAttribute:(*common.ExtendAttribute)(nil)} &common.PieceInfo{state:impl.MessageState{NoUnkeyedLiterals:pragma.NoUnkeyedLiterals{}, DoNotCompare:pragma.DoNotCompare{}, DoNotCopy:pragma.DoNotCopy{}, atomicMessageInfo:(*impl.MessageInfo)(nil)}, sizeCache:0, unknownFields:[]uint8(nil), PieceNum:1, RangeStart:0x400000, RangeSize:0x400000, PieceMd5:\"04ca933527fc15c727682603a115bf18\", PieceOffset:0x400000, PieceStyle:0, DownloadCost:0x50aa}","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320","peerID":"10.222.79.9-16589-e9ccae92-1719-424d-abc4-099715c0c59a"}
{"level":"info","ts":"2024-05-31 02:08:18.728","caller":"service/service_v1.go:250","msg":"receive success piece: &scheduler.PieceResult{state:impl.MessageState{NoUnkeyedLiterals:pragma.NoUnkeyedLiterals{}, DoNotCompare:pragma.DoNotCompare{}, DoNotCopy:pragma.DoNotCopy{}, atomicMessageInfo:(*impl.MessageInfo)(0xc000c0ca20)}, sizeCache:0, unknownFields:[]uint8(nil), TaskId:\"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320\", SrcPid:\"10.222.79.9-16589-e9ccae92-1719-424d-abc4-099715c0c59a\", DstPid:\"10.222.30.40-19280-7f4efb2f-064b-4c8f-9fc2-527c1b6cef6d\", PieceInfo:(*common.PieceInfo)(0xc000751b90), BeginTime:0x17d470b9354de032, EndTime:0x17d470b936f8fe52, Success:true, Code:200, FinishedCount:2, ExtendAttribute:(*common.ExtendAttribute)(nil)} &common.PieceInfo{state:impl.MessageState{NoUnkeyedLiterals:pragma.NoUnkeyedLiterals{}, DoNotCompare:pragma.DoNotCompare{}, DoNotCopy:pragma.DoNotCopy{}, atomicMessageInfo:(*impl.MessageInfo)(nil)}, sizeCache:0, unknownFields:[]uint8(nil), PieceNum:0, RangeStart:0x0, RangeSize:0x400000, PieceMd5:\"a633079831c3eb5bf5afa55200dafdb8\", PieceOffset:0x0, PieceStyle:0, DownloadCost:0x4a58}","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320","peerID":"10.222.79.9-16589-e9ccae92-1719-424d-abc4-099715c0c59a"}
{"level":"info","ts":"2024-05-31 02:08:18.728","caller":"service/service_v1.go:242","msg":"receive end of piece: &scheduler.PieceResult{state:impl.MessageState{NoUnkeyedLiterals:pragma.NoUnkeyedLiterals{}, DoNotCompare:pragma.DoNotCompare{}, DoNotCopy:pragma.DoNotCopy{}, atomicMessageInfo:(*impl.MessageInfo)(0xc000c0ca20)}, sizeCache:0, unknownFields:[]uint8(nil), TaskId:\"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320\", SrcPid:\"10.222.79.9-16589-e9ccae92-1719-424d-abc4-099715c0c59a\", DstPid:\"\", PieceInfo:(*common.PieceInfo)(0xc0009a10a0), BeginTime:0x0, EndTime:0x0, Success:false, Code:0, FinishedCount:3, ExtendAttribute:(*common.ExtendAttribute)(nil)} &common.PieceInfo{state:impl.MessageState{NoUnkeyedLiterals:pragma.NoUnkeyedLiterals{}, DoNotCompare:pragma.DoNotCompare{}, DoNotCopy:pragma.DoNotCopy{}, atomicMessageInfo:(*impl.MessageInfo)(nil)}, sizeCache:0, unknownFields:[]uint8(nil), PieceNum:1073741824, RangeStart:0x0, RangeSize:0x0, PieceMd5:\"\", PieceOffset:0x0, PieceStyle:0, DownloadCost:0x0}","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320","peerID":"10.222.79.9-16589-e9ccae92-1719-424d-abc4-099715c0c59a"}
{"level":"info","ts":"2024-05-31 02:08:18.729","caller":"service/service_v1.go:296","msg":"report peer result request: &scheduler.PeerResult{state:impl.MessageState{NoUnkeyedLiterals:pragma.NoUnkeyedLiterals{}, DoNotCompare:pragma.DoNotCompare{}, DoNotCopy:pragma.DoNotCopy{}, atomicMessageInfo:(*impl.MessageInfo)(0xc000c0ccb0)}, sizeCache:0, unknownFields:[]uint8(nil), TaskId:\"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320\", PeerId:\"10.222.79.9-16589-e9ccae92-1719-424d-abc4-099715c0c59a\", SrcIp:\"10.222.79.9\", Idc:\"\", Url:\"https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:fec9938e9c9cf860b9dcb7f9cf8885d1341a70e7d89bc5305056a9b1bdf76fcf?ns=harbor.test.wifi.com\", ContentLength:10191523, Traffic:0x0, Cost:0x1f, Success:true, Code:200, TotalPieceCount:3, Errordetails:scheduler.isPeerResult_Errordetails(nil)}","taskID":"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320","peerID":"10.222.79.9-16589-e9ccae92-1719-424d-abc4-099715c0c59a"}
{"level":"info","ts":"2024-05-31 02:08:18.729","caller":"resource/peer.go:494","msg":"application not found","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320","peerID":"10.222.79.9-16589-e9ccae92-1719-424d-abc4-099715c0c59a"}
{"level":"info","ts":"2024-05-31 02:08:18.729","caller":"service/service_v1.go:333","msg":"report success peer","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320","peerID":"10.222.79.9-16589-e9ccae92-1719-424d-abc4-099715c0c59a"}
{"level":"info","ts":"2024-05-31 02:08:18.729","caller":"resource/peer.go:291","msg":"peer state is Succeeded","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320","peerID":"10.222.79.9-16589-e9ccae92-1719-424d-abc4-099715c0c59a"}
daijiezou commented 1 month ago

According to the author, when the load on the source node is not high, there is little difference between the download speed of the image back to source

Looking at the logs, only two nodes trigger piece peer download. How to enable multiple nodes? Are there any parameters that can be configured?

dragonfly-scheduler core.log info:

{"level":"info","ts":"2024-05-31 02:08:18.685","caller":"service/service_v1.go:97","msg":"register peer task request: &scheduler.PeerTaskRequest{state:impl.MessageState{NoUnkeyedLiterals:pragma.NoUnkeyedLiterals{}, DoNotCompare:pragma.DoNotCompare{}, DoNotCopy:pragma.DoNotCopy{}, atomicMessageInfo:(*impl.MessageInfo)(0xc000c0c500)}, sizeCache:0, unknownFields:[]uint8(nil), Url:\"https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:4445ea2ce25d955765d7daeb03314106c52fe845df9bdf41c20a58fede61d7f1?ns=harbor.test.wifi.com\", UrlMeta:(*common.UrlMeta)(0xc000fd0990), PeerId:\"10.222.79.9-16589-47b913d2-f2c7-4e64-8403-65e4f2e5ca34\", PeerHost:(*scheduler.PeerHost)(0xc000dbc600), Prefetch:false, IsMigrating:false, TaskId:\"e1697ef5bc877913be3673a58f8e6a91ec807039b14790171170a3a1b3078db6\"}","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"e1697ef5bc877913be3673a58f8e6a91ec807039b14790171170a3a1b3078db6","peerID":"10.222.79.9-16589-47b913d2-f2c7-4e64-8403-65e4f2e5ca34"}
{"level":"info","ts":"2024-05-31 02:08:18.685","caller":"service/service_v1.go:941","msg":"task already exists","taskID":"e1697ef5bc877913be3673a58f8e6a91ec807039b14790171170a3a1b3078db6","url":"https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:4445ea2ce25d955765d7daeb03314106c52fe845df9bdf41c20a58fede61d7f1?ns=harbor.test.wifi.com"}
{"level":"info","ts":"2024-05-31 02:08:18.685","caller":"service/service_v1.go:973","msg":"host already exists","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","hostname":"dragonfly-dfdaemon-w9kjj","ip":"10.222.79.9"}
{"level":"info","ts":"2024-05-31 02:08:18.686","caller":"service/service_v1.go:996","msg":"create new peer","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"e1697ef5bc877913be3673a58f8e6a91ec807039b14790171170a3a1b3078db6","peerID":"10.222.79.9-16589-47b913d2-f2c7-4e64-8403-65e4f2e5ca34"}
{"level":"info","ts":"2024-05-31 02:08:18.686","caller":"service/service_v1.go:831","msg":"peer does not need to trigger","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"e1697ef5bc877913be3673a58f8e6a91ec807039b14790171170a3a1b3078db6","peerID":"10.222.79.9-16589-47b913d2-f2c7-4e64-8403-65e4f2e5ca34"}
{"level":"info","ts":"2024-05-31 02:08:18.686","caller":"service/service_v1.go:137","msg":"task size scope is SMALL","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"e1697ef5bc877913be3673a58f8e6a91ec807039b14790171170a3a1b3078db6","peerID":"10.222.79.9-16589-47b913d2-f2c7-4e64-8403-65e4f2e5ca34"}
{"level":"info","ts":"2024-05-31 02:08:18.686","caller":"scheduling/scheduling.go:431","msg":"peer state is Pending, can not schedule parent","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"e1697ef5bc877913be3673a58f8e6a91ec807039b14790171170a3a1b3078db6","peerID":"10.222.79.9-16589-47b913d2-f2c7-4e64-8403-65e4f2e5ca34"}
{"level":"warn","ts":"2024-05-31 02:08:18.686","caller":"service/service_v1.go:168","msg":"candidate parent not found","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"e1697ef5bc877913be3673a58f8e6a91ec807039b14790171170a3a1b3078db6","peerID":"10.222.79.9-16589-47b913d2-f2c7-4e64-8403-65e4f2e5ca34","stacktrace":"d7y.io/dragonfly/v2/scheduler/service.(*V1).RegisterPeerTask\n\t/go/src/d7y.io/dragonfly/v2/scheduler/service/service_v1.go:168\nd7y.io/dragonfly/v2/scheduler/rpcserver.(*schedulerServerV1).RegisterPeerTask\n\t/go/src/d7y.io/dragonfly/v2/scheduler/rpcserver/scheduler_server_v1.go:70\nd7y.io/api/v2/pkg/apis/scheduler/v1._Scheduler_RegisterPeerTask_Handler.func1\n\t/go/pkg/mod/d7y.io/api/v2@v2.0.110/pkg/apis/scheduler/v1/scheduler_grpc.pb.go:259\ngithub.com/grpc-ecosystem/go-grpc-middleware/recovery.UnaryServerInterceptor.func1\n\t/go/pkg/mod/github.com/grpc-ecosystem/go-grpc-middleware@v1.4.0/recovery/interceptors.go:33\nd7y.io/dragonfly/v2/pkg/rpc/scheduler/server.New.ChainUnaryServer.func5.1\n\t/go/pkg/mod/github.com/grpc-ecosystem/go-grpc-middleware@v1.4.0/chain.go:48\nd7y.io/dragonfly/v2/pkg/rpc/scheduler/server.New.UnaryServerInterceptor.func3\n\t/go/pkg/mod/github.com/grpc-ecosystem/go-grpc-middleware@v1.4.0/validator/validator.go:47\nd7y.io/dragonfly/v2/pkg/rpc/scheduler/server.New.ChainUnaryServer.func5.1\n\t/go/pkg/mod/github.com/grpc-ecosystem/go-grpc-middleware@v1.4.0/chain.go:48\ngithub.com/grpc-ecosystem/go-grpc-middleware/logging/zap.UnaryServerInterceptor.func1\n\t/go/pkg/mod/github.com/grpc-ecosystem/go-grpc-middleware@v1.4.0/logging/zap/server_interceptors.go:31\nd7y.io/dragonfly/v2/pkg/rpc/scheduler/server.New.ChainUnaryServer.func5.1\n\t/go/pkg/mod/github.com/grpc-ecosystem/go-grpc-middleware@v1.4.0/chain.go:48\ngithub.com/grpc-ecosystem/go-grpc-prometheus.init.(*ServerMetrics).UnaryServerInterceptor.func3\n\t/go/pkg/mod/github.com/grpc-ecosystem/go-grpc-prometheus@v1.2.0/server_metrics.go:107\nd7y.io/dragonfly/v2/pkg/rpc/scheduler/server.New.ChainUnaryServer.func5.1\n\t/go/pkg/mod/github.com/grpc-ecosystem/go-grpc-middleware@v1.4.0/chain.go:48\nd7y.io/dragonfly/v2/pkg/rpc.ConvertErrorUnaryServerInterceptor\n\t/go/src/d7y.io/dragonfly/v2/pkg/rpc/interceptor.go:93\nd7y.io/dragonfly/v2/pkg/rpc/scheduler/server.New.ChainUnaryServer.func5.1\n\t/go/pkg/mod/github.com/grpc-ecosystem/go-grpc-middleware@v1.4.0/chain.go:48\nd7y.io/dragonfly/v2/pkg/rpc/scheduler/server.New.UnaryServerInterceptor.func2\n\t/go/pkg/mod/github.com/grpc-ecosystem/go-grpc-middleware@v1.4.0/ratelimit/ratelimit.go:24\nd7y.io/dragonfly/v2/pkg/rpc/scheduler/server.New.ChainUnaryServer.func5\n\t/go/pkg/mod/github.com/grpc-ecosystem/go-grpc-middleware@v1.4.0/chain.go:53\nd7y.io/api/v2/pkg/apis/scheduler/v1._Scheduler_RegisterPeerTask_Handler\n\t/go/pkg/mod/d7y.io/api/v2@v2.0.110/pkg/apis/scheduler/v1/scheduler_grpc.pb.go:261\ngoogle.golang.org/grpc.(*Server).processUnaryRPC\n\t/go/pkg/mod/google.golang.org/grpc@v1.63.2/server.go:1369\ngoogle.golang.org/grpc.(*Server).handleStream\n\t/go/pkg/mod/google.golang.org/grpc@v1.63.2/server.go:1780\ngoogle.golang.org/grpc.(*Server).serveStreams.func2.1\n\t/go/pkg/mod/google.golang.org/grpc@v1.63.2/server.go:1019"}
{"level":"info","ts":"2024-05-31 02:08:18.686","caller":"resource/peer.go:264","msg":"peer state is ReceivedNormal","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"e1697ef5bc877913be3673a58f8e6a91ec807039b14790171170a3a1b3078db6","peerID":"10.222.79.9-16589-47b913d2-f2c7-4e64-8403-65e4f2e5ca34"}
{"level":"info","ts":"2024-05-31 02:08:18.686","caller":"service/service_v1.go:182","msg":"register as normal task","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"e1697ef5bc877913be3673a58f8e6a91ec807039b14790171170a3a1b3078db6","peerID":"10.222.79.9-16589-47b913d2-f2c7-4e64-8403-65e4f2e5ca34"}
{"level":"info","ts":"2024-05-31 02:08:18.686","caller":"service/service_v1.go:235","msg":"receive begin of piece: &scheduler.PieceResult{state:impl.MessageState{NoUnkeyedLiterals:pragma.NoUnkeyedLiterals{}, DoNotCompare:pragma.DoNotCompare{}, DoNotCopy:pragma.DoNotCopy{}, atomicMessageInfo:(*impl.MessageInfo)(0xc000c0ca20)}, sizeCache:0, unknownFields:[]uint8(nil), TaskId:\"e1697ef5bc877913be3673a58f8e6a91ec807039b14790171170a3a1b3078db6\", SrcPid:\"10.222.79.9-16589-47b913d2-f2c7-4e64-8403-65e4f2e5ca34\", DstPid:\"\", PieceInfo:(*common.PieceInfo)(0xc0007510a0), BeginTime:0x0, EndTime:0x0, Success:false, Code:0, FinishedCount:0, ExtendAttribute:(*common.ExtendAttribute)(nil)} &common.PieceInfo{state:impl.MessageState{NoUnkeyedLiterals:pragma.NoUnkeyedLiterals{}, DoNotCompare:pragma.DoNotCompare{}, DoNotCopy:pragma.DoNotCopy{}, atomicMessageInfo:(*impl.MessageInfo)(nil)}, sizeCache:0, unknownFields:[]uint8(nil), PieceNum:-1, RangeStart:0x0, RangeSize:0x0, PieceMd5:\"\", PieceOffset:0x0, PieceStyle:0, DownloadCost:0x0}","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"e1697ef5bc877913be3673a58f8e6a91ec807039b14790171170a3a1b3078db6","peerID":"10.222.79.9-16589-47b913d2-f2c7-4e64-8403-65e4f2e5ca34"}
{"level":"info","ts":"2024-05-31 02:08:18.686","caller":"service/service_v1.go:1124","msg":"peer state is ReceivedNormal","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"e1697ef5bc877913be3673a58f8e6a91ec807039b14790171170a3a1b3078db6","peerID":"10.222.79.9-16589-47b913d2-f2c7-4e64-8403-65e4f2e5ca34"}
{"level":"info","ts":"2024-05-31 02:08:18.686","caller":"resource/peer.go:268","msg":"peer state is Running","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"e1697ef5bc877913be3673a58f8e6a91ec807039b14790171170a3a1b3078db6","peerID":"10.222.79.9-16589-47b913d2-f2c7-4e64-8403-65e4f2e5ca34"}
{"level":"debug","ts":"2024-05-31 02:08:18.686","caller":"evaluator/evaluator.go:106","msg":"peer 10.222.30.40-19280-883d8f9a-ab2c-4380-981a-a2ce83577c57 has not finished downloading enough piece, it can't be bad node"}
{"level":"debug","ts":"2024-05-31 02:08:18.686","caller":"evaluator/evaluator.go:106","msg":"peer 10.222.87.184-27447-78b03fae-6fb1-4a79-8a34-d7b3fbba3574 has not finished downloading enough piece, it can't be bad node"}
{"level":"debug","ts":"2024-05-31 02:08:18.686","caller":"scheduling/scheduling.go:523","msg":"parent 10.222.79.9-16589-0e2c077e-e50e-4b5c-a4e0-808926f16964 host 890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41 is the same as peer host","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"e1697ef5bc877913be3673a58f8e6a91ec807039b14790171170a3a1b3078db6","peerID":"10.222.79.9-16589-47b913d2-f2c7-4e64-8403-65e4f2e5ca34"}
{"level":"debug","ts":"2024-05-31 02:08:18.686","caller":"scheduling/scheduling.go:523","msg":"parent 10.222.79.9-16589-c7d97964-29b5-4802-abb1-550ff186f7fd host 890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41 is the same as peer host","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"e1697ef5bc877913be3673a58f8e6a91ec807039b14790171170a3a1b3078db6","peerID":"10.222.79.9-16589-47b913d2-f2c7-4e64-8403-65e4f2e5ca34"}
{"level":"debug","ts":"2024-05-31 02:08:18.686","caller":"scheduling/scheduling.go:523","msg":"parent 10.222.79.9-16589-47b913d2-f2c7-4e64-8403-65e4f2e5ca34 host 890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41 is the same as peer host","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"e1697ef5bc877913be3673a58f8e6a91ec807039b14790171170a3a1b3078db6","peerID":"10.222.79.9-16589-47b913d2-f2c7-4e64-8403-65e4f2e5ca34"}
{"level":"info","ts":"2024-05-31 02:08:18.687","caller":"scheduling/scheduling.go:569","msg":"filter candidate parents is []string{\"10.222.30.40-19280-883d8f9a-ab2c-4380-981a-a2ce83577c57\", \"10.222.87.184-27447-78b03fae-6fb1-4a79-8a34-d7b3fbba3574\"}","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"e1697ef5bc877913be3673a58f8e6a91ec807039b14790171170a3a1b3078db6","peerID":"10.222.79.9-16589-47b913d2-f2c7-4e64-8403-65e4f2e5ca34"}
{"level":"info","ts":"2024-05-31 02:08:18.687","caller":"scheduling/scheduling.go:421","msg":"scheduling candidate parents is []string{\"10.222.30.40-19280-883d8f9a-ab2c-4380-981a-a2ce83577c57\", \"10.222.87.184-27447-78b03fae-6fb1-4a79-8a34-d7b3fbba3574\"}","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"e1697ef5bc877913be3673a58f8e6a91ec807039b14790171170a3a1b3078db6","peerID":"10.222.79.9-16589-47b913d2-f2c7-4e64-8403-65e4f2e5ca34"}
{"level":"info","ts":"2024-05-31 02:08:18.687","caller":"scheduling/scheduling.go:357","msg":"send PeerPacket to peer","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"e1697ef5bc877913be3673a58f8e6a91ec807039b14790171170a3a1b3078db6","peerID":"10.222.79.9-16589-47b913d2-f2c7-4e64-8403-65e4f2e5ca34"}
{"level":"info","ts":"2024-05-31 02:08:18.687","caller":"scheduling/scheduling.go:378","msg":"scheduling success in 1 times","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"e1697ef5bc877913be3673a58f8e6a91ec807039b14790171170a3a1b3078db6","peerID":"10.222.79.9-16589-47b913d2-f2c7-4e64-8403-65e4f2e5ca34"}
{"level":"info","ts":"2024-05-31 02:08:18.690","caller":"service/service_v1.go:250","msg":"receive success piece: &scheduler.PieceResult{state:impl.MessageState{NoUnkeyedLiterals:pragma.NoUnkeyedLiterals{}, DoNotCompare:pragma.DoNotCompare{}, DoNotCopy:pragma.DoNotCopy{}, atomicMessageInfo:(*impl.MessageInfo)(0xc000c0ca20)}, sizeCache:0, unknownFields:[]uint8(nil), TaskId:\"e1697ef5bc877913be3673a58f8e6a91ec807039b14790171170a3a1b3078db6\", SrcPid:\"10.222.79.9-16589-47b913d2-f2c7-4e64-8403-65e4f2e5ca34\", DstPid:\"10.222.87.184-27447-78b03fae-6fb1-4a79-8a34-d7b3fbba3574\", PieceInfo:(*common.PieceInfo)(0xc0007512d0), BeginTime:0x17d470b934a1621c, EndTime:0x17d470b934b1dbee, Success:true, Code:200, FinishedCount:0, ExtendAttribute:(*common.ExtendAttribute)(nil)} &common.PieceInfo{state:impl.MessageState{NoUnkeyedLiterals:pragma.NoUnkeyedLiterals{}, DoNotCompare:pragma.DoNotCompare{}, DoNotCopy:pragma.DoNotCopy{}, atomicMessageInfo:(*impl.MessageInfo)(nil)}, sizeCache:0, unknownFields:[]uint8(nil), PieceNum:0, RangeStart:0x0, RangeSize:0x2602, PieceMd5:\"b75e4e757f86cbf3ffe305785e7a78a9\", PieceOffset:0x0, PieceStyle:0, DownloadCost:0x2c6}","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"e1697ef5bc877913be3673a58f8e6a91ec807039b14790171170a3a1b3078db6","peerID":"10.222.79.9-16589-47b913d2-f2c7-4e64-8403-65e4f2e5ca34"}
{"level":"info","ts":"2024-05-31 02:08:18.690","caller":"service/service_v1.go:242","msg":"receive end of piece: &scheduler.PieceResult{state:impl.MessageState{NoUnkeyedLiterals:pragma.NoUnkeyedLiterals{}, DoNotCompare:pragma.DoNotCompare{}, DoNotCopy:pragma.DoNotCopy{}, atomicMessageInfo:(*impl.MessageInfo)(0xc000c0ca20)}, sizeCache:0, unknownFields:[]uint8(nil), TaskId:\"e1697ef5bc877913be3673a58f8e6a91ec807039b14790171170a3a1b3078db6\", SrcPid:\"10.222.79.9-16589-47b913d2-f2c7-4e64-8403-65e4f2e5ca34\", DstPid:\"\", PieceInfo:(*common.PieceInfo)(0xc000751420), BeginTime:0x0, EndTime:0x0, Success:false, Code:0, FinishedCount:1, ExtendAttribute:(*common.ExtendAttribute)(nil)} &common.PieceInfo{state:impl.MessageState{NoUnkeyedLiterals:pragma.NoUnkeyedLiterals{}, DoNotCompare:pragma.DoNotCompare{}, DoNotCopy:pragma.DoNotCopy{}, atomicMessageInfo:(*impl.MessageInfo)(nil)}, sizeCache:0, unknownFields:[]uint8(nil), PieceNum:1073741824, RangeStart:0x0, RangeSize:0x0, PieceMd5:\"\", PieceOffset:0x0, PieceStyle:0, DownloadCost:0x0}","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"e1697ef5bc877913be3673a58f8e6a91ec807039b14790171170a3a1b3078db6","peerID":"10.222.79.9-16589-47b913d2-f2c7-4e64-8403-65e4f2e5ca34"}
{"level":"info","ts":"2024-05-31 02:08:18.690","caller":"service/service_v1.go:296","msg":"report peer result request: &scheduler.PeerResult{state:impl.MessageState{NoUnkeyedLiterals:pragma.NoUnkeyedLiterals{}, DoNotCompare:pragma.DoNotCompare{}, DoNotCopy:pragma.DoNotCopy{}, atomicMessageInfo:(*impl.MessageInfo)(0xc000c0ccb0)}, sizeCache:0, unknownFields:[]uint8(nil), TaskId:\"e1697ef5bc877913be3673a58f8e6a91ec807039b14790171170a3a1b3078db6\", PeerId:\"10.222.79.9-16589-47b913d2-f2c7-4e64-8403-65e4f2e5ca34\", SrcIp:\"10.222.79.9\", Idc:\"\", Url:\"https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:4445ea2ce25d955765d7daeb03314106c52fe845df9bdf41c20a58fede61d7f1?ns=harbor.test.wifi.com\", ContentLength:9730, Traffic:0x0, Cost:0x5, Success:true, Code:200, TotalPieceCount:1, Errordetails:scheduler.isPeerResult_Errordetails(nil)}","taskID":"e1697ef5bc877913be3673a58f8e6a91ec807039b14790171170a3a1b3078db6","peerID":"10.222.79.9-16589-47b913d2-f2c7-4e64-8403-65e4f2e5ca34"}
{"level":"info","ts":"2024-05-31 02:08:18.691","caller":"resource/peer.go:494","msg":"application not found","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"e1697ef5bc877913be3673a58f8e6a91ec807039b14790171170a3a1b3078db6","peerID":"10.222.79.9-16589-47b913d2-f2c7-4e64-8403-65e4f2e5ca34"}
{"level":"info","ts":"2024-05-31 02:08:18.691","caller":"service/service_v1.go:333","msg":"report success peer","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"e1697ef5bc877913be3673a58f8e6a91ec807039b14790171170a3a1b3078db6","peerID":"10.222.79.9-16589-47b913d2-f2c7-4e64-8403-65e4f2e5ca34"}
{"level":"info","ts":"2024-05-31 02:08:18.691","caller":"resource/peer.go:291","msg":"peer state is Succeeded","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"e1697ef5bc877913be3673a58f8e6a91ec807039b14790171170a3a1b3078db6","peerID":"10.222.79.9-16589-47b913d2-f2c7-4e64-8403-65e4f2e5ca34"}
{"level":"info","ts":"2024-05-31 02:08:18.697","caller":"service/service_v1.go:97","msg":"register peer task request: &scheduler.PeerTaskRequest{state:impl.MessageState{NoUnkeyedLiterals:pragma.NoUnkeyedLiterals{}, DoNotCompare:pragma.DoNotCompare{}, DoNotCopy:pragma.DoNotCopy{}, atomicMessageInfo:(*impl.MessageInfo)(0xc000c0c500)}, sizeCache:0, unknownFields:[]uint8(nil), Url:\"https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:fec9938e9c9cf860b9dcb7f9cf8885d1341a70e7d89bc5305056a9b1bdf76fcf?ns=harbor.test.wifi.com\", UrlMeta:(*common.UrlMeta)(0xc0015af710), PeerId:\"10.222.79.9-16589-e9ccae92-1719-424d-abc4-099715c0c59a\", PeerHost:(*scheduler.PeerHost)(0xc001350500), Prefetch:false, IsMigrating:false, TaskId:\"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320\"}","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320","peerID":"10.222.79.9-16589-e9ccae92-1719-424d-abc4-099715c0c59a"}
{"level":"info","ts":"2024-05-31 02:08:18.697","caller":"service/service_v1.go:941","msg":"task already exists","taskID":"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320","url":"https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:fec9938e9c9cf860b9dcb7f9cf8885d1341a70e7d89bc5305056a9b1bdf76fcf?ns=harbor.test.wifi.com"}
{"level":"info","ts":"2024-05-31 02:08:18.697","caller":"service/service_v1.go:973","msg":"host already exists","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","hostname":"dragonfly-dfdaemon-w9kjj","ip":"10.222.79.9"}
{"level":"info","ts":"2024-05-31 02:08:18.697","caller":"service/service_v1.go:996","msg":"create new peer","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320","peerID":"10.222.79.9-16589-e9ccae92-1719-424d-abc4-099715c0c59a"}
{"level":"info","ts":"2024-05-31 02:08:18.697","caller":"service/service_v1.go:831","msg":"peer does not need to trigger","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320","peerID":"10.222.79.9-16589-e9ccae92-1719-424d-abc4-099715c0c59a"}
{"level":"info","ts":"2024-05-31 02:08:18.697","caller":"service/service_v1.go:137","msg":"task size scope is NORMAL","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320","peerID":"10.222.79.9-16589-e9ccae92-1719-424d-abc4-099715c0c59a"}
{"level":"info","ts":"2024-05-31 02:08:18.697","caller":"resource/peer.go:264","msg":"peer state is ReceivedNormal","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320","peerID":"10.222.79.9-16589-e9ccae92-1719-424d-abc4-099715c0c59a"}
{"level":"info","ts":"2024-05-31 02:08:18.697","caller":"service/service_v1.go:182","msg":"register as normal task","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320","peerID":"10.222.79.9-16589-e9ccae92-1719-424d-abc4-099715c0c59a"}
{"level":"info","ts":"2024-05-31 02:08:18.698","caller":"service/service_v1.go:235","msg":"receive begin of piece: &scheduler.PieceResult{state:impl.MessageState{NoUnkeyedLiterals:pragma.NoUnkeyedLiterals{}, DoNotCompare:pragma.DoNotCompare{}, DoNotCopy:pragma.DoNotCopy{}, atomicMessageInfo:(*impl.MessageInfo)(0xc000c0ca20)}, sizeCache:0, unknownFields:[]uint8(nil), TaskId:\"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320\", SrcPid:\"10.222.79.9-16589-e9ccae92-1719-424d-abc4-099715c0c59a\", DstPid:\"\", PieceInfo:(*common.PieceInfo)(0xc000751570), BeginTime:0x0, EndTime:0x0, Success:false, Code:0, FinishedCount:0, ExtendAttribute:(*common.ExtendAttribute)(nil)} &common.PieceInfo{state:impl.MessageState{NoUnkeyedLiterals:pragma.NoUnkeyedLiterals{}, DoNotCompare:pragma.DoNotCompare{}, DoNotCopy:pragma.DoNotCopy{}, atomicMessageInfo:(*impl.MessageInfo)(nil)}, sizeCache:0, unknownFields:[]uint8(nil), PieceNum:-1, RangeStart:0x0, RangeSize:0x0, PieceMd5:\"\", PieceOffset:0x0, PieceStyle:0, DownloadCost:0x0}","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320","peerID":"10.222.79.9-16589-e9ccae92-1719-424d-abc4-099715c0c59a"}
{"level":"info","ts":"2024-05-31 02:08:18.698","caller":"service/service_v1.go:1124","msg":"peer state is ReceivedNormal","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320","peerID":"10.222.79.9-16589-e9ccae92-1719-424d-abc4-099715c0c59a"}
{"level":"info","ts":"2024-05-31 02:08:18.698","caller":"resource/peer.go:268","msg":"peer state is Running","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320","peerID":"10.222.79.9-16589-e9ccae92-1719-424d-abc4-099715c0c59a"}
{"level":"debug","ts":"2024-05-31 02:08:18.698","caller":"evaluator/evaluator.go:117","msg":"peer 10.222.30.40-19280-7f4efb2f-064b-4c8f-9fc2-527c1b6cef6d mean is 13036500000.00 and it is bad node: false"}
{"level":"debug","ts":"2024-05-31 02:08:18.698","caller":"scheduling/scheduling.go:523","msg":"parent 10.222.79.9-16589-e9ccae92-1719-424d-abc4-099715c0c59a host 890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41 is the same as peer host","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320","peerID":"10.222.79.9-16589-e9ccae92-1719-424d-abc4-099715c0c59a"}
{"level":"debug","ts":"2024-05-31 02:08:18.698","caller":"evaluator/evaluator.go:117","msg":"peer 10.222.87.184-27447-7d77e4c0-f1bc-4da4-ae34-20d33fd1f6e9 mean is 13036500000.00 and it is bad node: false"}
{"level":"debug","ts":"2024-05-31 02:08:18.698","caller":"scheduling/scheduling.go:523","msg":"parent 10.222.79.9-16589-1262e113-5ec4-4c65-942d-d69a00f82d26 host 890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41 is the same as peer host","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320","peerID":"10.222.79.9-16589-e9ccae92-1719-424d-abc4-099715c0c59a"}
{"level":"debug","ts":"2024-05-31 02:08:18.698","caller":"scheduling/scheduling.go:523","msg":"parent 10.222.79.9-16589-a32d7dbb-e1d8-40d3-b485-4dfba8dc2557 host 890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41 is the same as peer host","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320","peerID":"10.222.79.9-16589-e9ccae92-1719-424d-abc4-099715c0c59a"}
{"level":"info","ts":"2024-05-31 02:08:18.698","caller":"scheduling/scheduling.go:569","msg":"filter candidate parents is []string{\"10.222.30.40-19280-7f4efb2f-064b-4c8f-9fc2-527c1b6cef6d\", \"10.222.87.184-27447-7d77e4c0-f1bc-4da4-ae34-20d33fd1f6e9\"}","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320","peerID":"10.222.79.9-16589-e9ccae92-1719-424d-abc4-099715c0c59a"}
{"level":"info","ts":"2024-05-31 02:08:18.698","caller":"scheduling/scheduling.go:421","msg":"scheduling candidate parents is []string{\"10.222.30.40-19280-7f4efb2f-064b-4c8f-9fc2-527c1b6cef6d\", \"10.222.87.184-27447-7d77e4c0-f1bc-4da4-ae34-20d33fd1f6e9\"}","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320","peerID":"10.222.79.9-16589-e9ccae92-1719-424d-abc4-099715c0c59a"}
{"level":"info","ts":"2024-05-31 02:08:18.698","caller":"scheduling/scheduling.go:357","msg":"send PeerPacket to peer","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320","peerID":"10.222.79.9-16589-e9ccae92-1719-424d-abc4-099715c0c59a"}
{"level":"info","ts":"2024-05-31 02:08:18.698","caller":"scheduling/scheduling.go:378","msg":"scheduling success in 1 times","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320","peerID":"10.222.79.9-16589-e9ccae92-1719-424d-abc4-099715c0c59a"}
{"level":"info","ts":"2024-05-31 02:08:18.710","caller":"service/service_v1.go:250","msg":"receive success piece: &scheduler.PieceResult{state:impl.MessageState{NoUnkeyedLiterals:pragma.NoUnkeyedLiterals{}, DoNotCompare:pragma.DoNotCompare{}, DoNotCopy:pragma.DoNotCopy{}, atomicMessageInfo:(*impl.MessageInfo)(0xc000c0ca20)}, sizeCache:0, unknownFields:[]uint8(nil), TaskId:\"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320\", SrcPid:\"10.222.79.9-16589-e9ccae92-1719-424d-abc4-099715c0c59a\", DstPid:\"10.222.30.40-19280-7f4efb2f-064b-4c8f-9fc2-527c1b6cef6d\", PieceInfo:(*common.PieceInfo)(0xc000751810), BeginTime:0x17d470b9354fbd7a, EndTime:0x17d470b935e72385, Success:true, Code:200, FinishedCount:0, ExtendAttribute:(*common.ExtendAttribute)(nil)} &common.PieceInfo{state:impl.MessageState{NoUnkeyedLiterals:pragma.NoUnkeyedLiterals{}, DoNotCompare:pragma.DoNotCompare{}, DoNotCopy:pragma.DoNotCopy{}, atomicMessageInfo:(*impl.MessageInfo)(nil)}, sizeCache:0, unknownFields:[]uint8(nil), PieceNum:2, RangeStart:0x800000, RangeSize:0x1b82a3, PieceMd5:\"140fe306a2f10c778988213b893af47e\", PieceOffset:0x800000, PieceStyle:0, DownloadCost:0x212c}","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320","peerID":"10.222.79.9-16589-e9ccae92-1719-424d-abc4-099715c0c59a"}
{"level":"info","ts":"2024-05-31 02:08:18.722","caller":"service/service_v1.go:250","msg":"receive success piece: &scheduler.PieceResult{state:impl.MessageState{NoUnkeyedLiterals:pragma.NoUnkeyedLiterals{}, DoNotCompare:pragma.DoNotCompare{}, DoNotCopy:pragma.DoNotCopy{}, atomicMessageInfo:(*impl.MessageInfo)(0xc000c0ca20)}, sizeCache:0, unknownFields:[]uint8(nil), TaskId:\"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320\", SrcPid:\"10.222.79.9-16589-e9ccae92-1719-424d-abc4-099715c0c59a\", DstPid:\"10.222.30.40-19280-7f4efb2f-064b-4c8f-9fc2-527c1b6cef6d\", PieceInfo:(*common.PieceInfo)(0xc000751ab0), BeginTime:0x17d470b9354f18fb, EndTime:0x17d470b9369f6687, Success:true, Code:200, FinishedCount:1, ExtendAttribute:(*common.ExtendAttribute)(nil)} &common.PieceInfo{state:impl.MessageState{NoUnkeyedLiterals:pragma.NoUnkeyedLiterals{}, DoNotCompare:pragma.DoNotCompare{}, DoNotCopy:pragma.DoNotCopy{}, atomicMessageInfo:(*impl.MessageInfo)(nil)}, sizeCache:0, unknownFields:[]uint8(nil), PieceNum:1, RangeStart:0x400000, RangeSize:0x400000, PieceMd5:\"04ca933527fc15c727682603a115bf18\", PieceOffset:0x400000, PieceStyle:0, DownloadCost:0x50aa}","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320","peerID":"10.222.79.9-16589-e9ccae92-1719-424d-abc4-099715c0c59a"}
{"level":"info","ts":"2024-05-31 02:08:18.728","caller":"service/service_v1.go:250","msg":"receive success piece: &scheduler.PieceResult{state:impl.MessageState{NoUnkeyedLiterals:pragma.NoUnkeyedLiterals{}, DoNotCompare:pragma.DoNotCompare{}, DoNotCopy:pragma.DoNotCopy{}, atomicMessageInfo:(*impl.MessageInfo)(0xc000c0ca20)}, sizeCache:0, unknownFields:[]uint8(nil), TaskId:\"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320\", SrcPid:\"10.222.79.9-16589-e9ccae92-1719-424d-abc4-099715c0c59a\", DstPid:\"10.222.30.40-19280-7f4efb2f-064b-4c8f-9fc2-527c1b6cef6d\", PieceInfo:(*common.PieceInfo)(0xc000751b90), BeginTime:0x17d470b9354de032, EndTime:0x17d470b936f8fe52, Success:true, Code:200, FinishedCount:2, ExtendAttribute:(*common.ExtendAttribute)(nil)} &common.PieceInfo{state:impl.MessageState{NoUnkeyedLiterals:pragma.NoUnkeyedLiterals{}, DoNotCompare:pragma.DoNotCompare{}, DoNotCopy:pragma.DoNotCopy{}, atomicMessageInfo:(*impl.MessageInfo)(nil)}, sizeCache:0, unknownFields:[]uint8(nil), PieceNum:0, RangeStart:0x0, RangeSize:0x400000, PieceMd5:\"a633079831c3eb5bf5afa55200dafdb8\", PieceOffset:0x0, PieceStyle:0, DownloadCost:0x4a58}","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320","peerID":"10.222.79.9-16589-e9ccae92-1719-424d-abc4-099715c0c59a"}
{"level":"info","ts":"2024-05-31 02:08:18.728","caller":"service/service_v1.go:242","msg":"receive end of piece: &scheduler.PieceResult{state:impl.MessageState{NoUnkeyedLiterals:pragma.NoUnkeyedLiterals{}, DoNotCompare:pragma.DoNotCompare{}, DoNotCopy:pragma.DoNotCopy{}, atomicMessageInfo:(*impl.MessageInfo)(0xc000c0ca20)}, sizeCache:0, unknownFields:[]uint8(nil), TaskId:\"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320\", SrcPid:\"10.222.79.9-16589-e9ccae92-1719-424d-abc4-099715c0c59a\", DstPid:\"\", PieceInfo:(*common.PieceInfo)(0xc0009a10a0), BeginTime:0x0, EndTime:0x0, Success:false, Code:0, FinishedCount:3, ExtendAttribute:(*common.ExtendAttribute)(nil)} &common.PieceInfo{state:impl.MessageState{NoUnkeyedLiterals:pragma.NoUnkeyedLiterals{}, DoNotCompare:pragma.DoNotCompare{}, DoNotCopy:pragma.DoNotCopy{}, atomicMessageInfo:(*impl.MessageInfo)(nil)}, sizeCache:0, unknownFields:[]uint8(nil), PieceNum:1073741824, RangeStart:0x0, RangeSize:0x0, PieceMd5:\"\", PieceOffset:0x0, PieceStyle:0, DownloadCost:0x0}","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320","peerID":"10.222.79.9-16589-e9ccae92-1719-424d-abc4-099715c0c59a"}
{"level":"info","ts":"2024-05-31 02:08:18.729","caller":"service/service_v1.go:296","msg":"report peer result request: &scheduler.PeerResult{state:impl.MessageState{NoUnkeyedLiterals:pragma.NoUnkeyedLiterals{}, DoNotCompare:pragma.DoNotCompare{}, DoNotCopy:pragma.DoNotCopy{}, atomicMessageInfo:(*impl.MessageInfo)(0xc000c0ccb0)}, sizeCache:0, unknownFields:[]uint8(nil), TaskId:\"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320\", PeerId:\"10.222.79.9-16589-e9ccae92-1719-424d-abc4-099715c0c59a\", SrcIp:\"10.222.79.9\", Idc:\"\", Url:\"https://harbor.test.wifi.com/v2/init-images/bigdata-10/blobs/sha256:fec9938e9c9cf860b9dcb7f9cf8885d1341a70e7d89bc5305056a9b1bdf76fcf?ns=harbor.test.wifi.com\", ContentLength:10191523, Traffic:0x0, Cost:0x1f, Success:true, Code:200, TotalPieceCount:3, Errordetails:scheduler.isPeerResult_Errordetails(nil)}","taskID":"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320","peerID":"10.222.79.9-16589-e9ccae92-1719-424d-abc4-099715c0c59a"}
{"level":"info","ts":"2024-05-31 02:08:18.729","caller":"resource/peer.go:494","msg":"application not found","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320","peerID":"10.222.79.9-16589-e9ccae92-1719-424d-abc4-099715c0c59a"}
{"level":"info","ts":"2024-05-31 02:08:18.729","caller":"service/service_v1.go:333","msg":"report success peer","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320","peerID":"10.222.79.9-16589-e9ccae92-1719-424d-abc4-099715c0c59a"}
{"level":"info","ts":"2024-05-31 02:08:18.729","caller":"resource/peer.go:291","msg":"peer state is Succeeded","hostID":"890e03447134f7e13b3dc548ed0af47ccb05e033c0309fa02a59cda5fb094b41","taskID":"911e8ac7b222b42f979766cb912d10bb29a49a1425073733e7b9dee610f04320","peerID":"10.222.79.9-16589-e9ccae92-1719-424d-abc4-099715c0c59a"}

When your image is cached on more nodes, the scheduler can schedule more peers for this task to download

mansoncui commented 1 month ago

@daijiezou Is there any task that can synchronize the cache to other nodes? Or there are parameter configurations that are synchronized to other nodes or automatically cached