search

hltcoe / sandle

Run a large language modeling SANDbox in your Local Environment
Other
7 stars 1 forks source link

Comparison to Petals #93

Open danyaljj opened 1 year ago

danyaljj commented 1 year ago

Wondering what you think about the overlap/differences between this project with Petals (https://github.com/bigscience-workshop/petals).

To my limited understanding, one can use their model to

  1. run large models such as BLOOM distributed across various nodes (could be locally limited to any nodes that we specify)
  2. and then use the client to make calls (prompting, fine-tuning) to the model being served.