issues
search
bigscience-workshop
/
petals
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
https://petals.dev
MIT License
9.26k
stars
524
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
WIP GCP TPU XLA Build
#567
jmikedupont2
closed
7 months ago
0
compile to webassembly
#566
Donovoi
opened
8 months ago
3
Latest bump "Bump transformers and accelerate versions (#554)" looks to destroy Falcon support.
#565
STEMBytes
opened
8 months ago
5
Grok | Mixture-of-Experts | Model Support
#564
tibrezus
opened
8 months ago
3
Fix p2p pushing in rpc_inference, support transformers 4.38.2
#563
justheuristic
closed
8 months ago
0
Reachability issue while connecting to private swarm
#562
CherukupalleNaveen
closed
8 months ago
1
content of 'labels' when doing prompt tuning of llama-2 on QA
#561
caochuxueeee
opened
8 months ago
0
Direct server-to-server communication during finetuning
#560
dvmazur
opened
8 months ago
0
Forward backward
#559
dvmazur
closed
8 months ago
0
Clean disk space in push-docker-image.yaml
#558
justheuristic
closed
9 months ago
0
Update peft dependency, fix initialization and inference with new peft
#557
artek0chumak
closed
4 months ago
0
Feature Request: Distributed inference API where the "miners" are paid.
#556
NewtonTrendy
opened
9 months ago
2
Fix push-docker-image's "No space left on device"
#555
dvmazur
opened
9 months ago
0
Bump transformers and accelerate versions
#554
dvmazur
closed
9 months ago
1
Add Mixtral models
#553
artek0chumak
closed
8 months ago
0
Bump transformers
#552
dvmazur
closed
10 months ago
0
Reachability Issue for private swarm
#551
VarunJoshi10
closed
9 months ago
1
Can not use direct server-to-server communication
#550
miaoqijun
closed
8 months ago
6
Error when trying to launch private swarm using locally stored model
#549
sdryluth
opened
11 months ago
1
Is there any plan to support MoE models like Mixtral8×7B?
#548
arronKler
closed
7 months ago
5
Example of agents usage with Petals
#547
RomaA2000
opened
11 months ago
0
Add "Podman" usage to the documentation
#546
metal3d
opened
11 months ago
0
replaced call to `_prepare_decoder_attention_mask()` with `_prepare_4d_causal_attention_mask()`
#545
poedator
opened
1 year ago
1
install script to help the project deployment or for easy use
#544
elsolo5000-2
opened
1 year ago
0
Bump version for inference diagnostics
#543
justheuristic
closed
1 year ago
0
ImportError: cannot import name 'AutoDistributedModelForCausalLM' from partially initialized module 'petals' (most likely due to a circular import)
#542
lacksfish
closed
1 year ago
3
Prepull model data on private swarm
#541
wolfganghuse
closed
1 year ago
5
M1 macOS installation error ("failed to build wheel for hivemind") with mac-native petals
#540
MinaAlmasi
closed
1 year ago
2
Hotfix: require peft version 0.5.0
#539
justheuristic
closed
1 year ago
0
Fix transformers version temporarily
#538
justheuristic
closed
1 year ago
0
[WIP] test server issues in CI
#537
justheuristic
closed
1 year ago
0
Upstream Changes makes the demo not work
#536
hrQAQ
opened
1 year ago
2
Add OpenAI compatible API
#535
RomaA2000
closed
12 months ago
0
I confirm Petals not working in Google Colab
#534
AIAnytime
opened
1 year ago
2
Error while hosting as provider
#533
filopedraz
opened
1 year ago
0
IndexError: tuple index out of range
#532
jaskirat8
opened
1 year ago
7
Fix beam search in GPU clients
#531
borzunov
closed
1 year ago
0
Improve default arguments for clients and servers
#530
borzunov
closed
1 year ago
0
text to video generation models ?
#529
scenaristeur
opened
1 year ago
2
Pyinstaller packaged Petals binary fails to load/download on`AutoDistributedModelForCausalLM.from_pretrained`
#528
biswaroop1547
opened
1 year ago
0
Add mistral to chat.petals
#527
AmgadHasan
closed
1 year ago
1
whether past_key_values can be obtained
#526
sa1utyeggs
opened
1 year ago
1
Add position_ids argument to DistributedFalconModel
#525
mryab
closed
1 year ago
0
support quivr or privateGPT?
#524
lbgws2
opened
1 year ago
2
Fix retries during inference
#523
borzunov
opened
1 year ago
0
Add pre-commit hook
#522
mahimairaja
closed
1 year ago
0
Available Models?
#521
jontstaz
closed
1 year ago
1
Update README.md
#520
borzunov
closed
1 year ago
0
Support stable diffusion model
#519
lbgws2
closed
1 year ago
2
AttributeError: module 'numpy' has no attribute 'ndarray'
#518
Ilya-666
closed
1 year ago
5
Previous
Next