NascentCore / 3k

3-k platform is for training LLMs
GNU Affero General Public License v3.0
13 stars 3 forks source link

【功能需求】CPODJob 挂载路径适配 HF缓存路径 #1009

Open sxwl-donggang opened 2 weeks ago

sxwl-donggang commented 2 weeks ago

背景

描述系统现有的状况和相关的具体信息

这个功能需求是解决什么问题?

描述问题的具体场景,以及想要达到的效果

解决方案

列举目前考虑的可选解决方案

sxwl-donggang commented 1 week ago
.
├── models--google--gemma-2-9b-it
│   ├── blobs
│   │   ├── 3349b4960bbc0bf7e47a624e5c520881adb06e2da4bda6ed14b51c7f647fe26c.incomplete
│   │   ├── 5a9f84eb9846840802200c6502ccaaebf0a146ee89dcb8822fab795c392dd667.incomplete
│   │   ├── 61a7b147390c64585d6c3543dd6fc636906c9af3865a5548f27f31aee1d4c8e2.incomplete
│   │   ├── 712a589c333f49f7b6f3870838a9e0ab4b3c0260abd5130e8c54316e6c99640b.incomplete
│   │   ├── 7da53ca29fb16f6b2489482fc0bc6a394162cdab14d12764a1755ebc583fea79.incomplete
│   │   ├── a0d4eb4fcbddfe01b0dc7a58386a3980826ededaf0ecd67d1ef38995b89615ba.incomplete
│   │   └── dbdec549ad82a5c45d4fbd5384e9d12f4f2899ca94dccdf0544cdd06101fad25.incomplete
│   ├── refs
│   │   └── main
│   └── snapshots
│       └── 32e4f3ede2e468e868e20cb3fdae8761f2594544
│           └── transformers
└── models--mistralai--Mixtral-8x7B-Instruct-v0.1
    ├── blobs
    │   ├── 048fa5347877b6d04eccf69765d23e5561cc9820dd4d0e5ba2df0100204dfb04.incomplete
    │   ├── 29e15364d8ab1d6ee229233381f295e9ff96237efed04750591f7da52ab6cc0e.incomplete
    │   ├── 2f8ef99d180dbd99e973c03ed3b3796c90331d87b49dc5c758ddeb1b8d369513.incomplete
    │   ├── 3c32657605f8d43d78241daad46119fcc0a92f0b12f88863718819f8609c1584.incomplete
    │   ├── 3f5db0853c875881527c71ba55d19282b636747296ccbcc681f083ac3bdc70f4.incomplete
    │   ├── 4ce8e4743f9574913d02a184a3f4ed0485421e0abe3cbf7ef2811b92cfbbc2e0.incomplete
    │   ├── 54669c5aec29fe5e4edd8098f7b564a137ba36be22ad25a194cd93f2bb54c940.incomplete
    │   ├── 67e0596920fe543415c0191e867a9a7de942a2924d6277cd98c8c5b34e11e436.incomplete
    │   ├── 757a103bedcfb779c02efab04cd3cd1e274865bd474ddf41eef16de36a9f45a7.incomplete
    │   ├── 7709757b9184bb1cd4aee1d012af474f57b1d438e9fc7767f5062c5cac3d67ac.incomplete
    │   ├── 7e13985d85bff5b69208fd8fe8d64b00f55a944809da4a0a067670b195e8940d.incomplete
    │   ├── 83bfed6169c1f5b0ae854fb3311b576d06209ee5af45d7d46bcbc25098a4d02b.incomplete
    │   ├── 8c518cf8e5402f5762a1b979d130a71a1af6b87cbd03c296f3edfa6b16425fed.incomplete
    │   ├── d0b63fca793cc29421cc5a46851992975cbe083aaded1b2f31113a45a0c90954.incomplete
    │   └── e330eabd70b467ddcbd8d3d6b2b9c3eba66655b0ed9f84e19f270da3623dc455.incomplete
    ├── refs
    │   └── main
    └── snapshots
        └── bbae113847402a22031211225b5ee45c005de7dd

缓存的目录不是完整的模型