search

foundation-model-stack / fms-acceleration

🚀 Collection of libraries used with fms-hf-tuning to accelerate fine-tuning and training of large models.
Apache License 2.0
0 stars 4 forks source link

Enable packaging CUDA wheels #43

Open fabianlim opened 5 days ago

fabianlim commented 5 days ago

We are missing releases. To this end we need to package wheels

  1. Activate a packaging GH action. We can take reference from how FMS does it
  2. Check if we need CUDA deps for packaging. I believe so because our deps have CUDA deps, but check first
  3. If so, then package using a GH cuda toolkit action.
  4. Follow the RH flow to upload the deps for build and inspect, or upload to pypi test first https://github.com/instructlab/GPTDolomite/blob/main/.github/workflows/pypi.yaml#L36-L51
  5. once ok, create a pypi project and upload

There will be one pypi project for each plugin

fabianlim commented 2 days ago

Once we have the packaging we should revert this https://github.com/foundation-model-stack/fms-hf-tuning/pull/219