issues
search
ray-project
/
ray-llm
RayLLM - LLMs on Ray
https://aviary.anyscale.com
Apache License 2.0
1.22k
stars
87
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
TheBloke--Llama-2-70B-chat-GPTQ model: weight model.layers.0.self_attn.q_proj.weight does not exist
#52
YQ-Wang
closed
11 months ago
1
Placement group is not released when user code exists, resulting in a resource leak
#51
xieus
closed
11 months ago
2
anyscale/aviary docker image has cuda 11.8 which is incompatibility with GKE nvidia daemonset
#50
NikitaSemenovAiforia
opened
12 months ago
0
Missing Llama2 policy
#49
NikitaSemenovAiforia
closed
10 months ago
1
GKE How-To is out-of-date
#48
NikitaSemenovAiforia
opened
12 months ago
1
Error loading model from local filesystem
#47
jcushman
opened
1 year ago
2
Merge from master
#46
akshay-anyscale
closed
1 year ago
0
Merge master into template branch
#45
akshay-anyscale
closed
1 year ago
0
Unable to run aviary on V100 GPU.
#44
AmoghM
opened
1 year ago
1
Unexpected id when stream=True
#43
mahaddad
opened
1 year ago
1
fix: version string should be 0.2.0
#42
csivanich
closed
1 year ago
0
Cleanup models
#41
akshay-anyscale
closed
1 year ago
0
Add anyscale template instructions
#40
akshay-anyscale
opened
1 year ago
0
Add anyscale template instructions
#39
akshay-anyscale
closed
1 year ago
0
Aviary v0.2.0 (#37)
#38
akshay-anyscale
closed
1 year ago
0
Aviary v0.2.0
#37
Yard1
closed
1 year ago
0
Fix max_total_tokens calculation
#35
akshay-anyscale
closed
1 year ago
0
Update TGI version
#34
akshay-anyscale
closed
1 year ago
0
T5 model support
#33
ravindra-ut
opened
1 year ago
4
Error running TheBloke--Llama-2-70B-chat-GPTQ
#32
mahaddad
closed
1 year ago
3
Merge from master
#31
akshay-anyscale
closed
1 year ago
0
Deploy 2 models via `aviary run` - `aviary model list` only displays 1
#30
brent-anyscale
closed
1 year ago
4
[feature request] aviary model remove
#29
brent-anyscale
closed
1 year ago
4
Add some sanity checks
#28
akshay-anyscale
closed
1 year ago
0
Aviary template
#27
akshay-anyscale
closed
1 year ago
0
aviary run --model failing to deploy
#26
mahaddad
opened
1 year ago
4
Merge from master
#25
akshay-anyscale
closed
1 year ago
0
how to configure if we have low spec?
#24
okyx
opened
1 year ago
5
Ray dashboard doesn't connect with image: "anyscale/aviary:latest"
#23
mahaddad
closed
1 year ago
13
How can we use hosted version by making an api call?
#22
sanjay-nit
closed
1 year ago
3
How could I run aviary in the remote ray cluster
#21
vincent-pli
opened
1 year ago
0
Adding confidence level to the output of requests
#20
kouroshHakha
opened
1 year ago
0
Update SDK
#19
Yard1
closed
1 year ago
0
Possible to run on a single 8x A100 machine on-premise?
#18
wired-mind
opened
1 year ago
4
How were the numbers in the performance leaderboard benchmarked?
#17
jaywonchung
closed
1 year ago
2
Feature request: GCS support
#16
lpfhs
opened
1 year ago
0
how to deploy on kubernetes ?
#14
msinha251
closed
1 year ago
2
Update `MOCK=True` to `AVIARY_MOCK=True`
#12
kevin85421
closed
1 year ago
1
Update `list_models` command to `models`
#11
kevin85421
closed
1 year ago
1
Fix typo in README.md
#10
eltociear
closed
1 year ago
1
Error downloading and running model on clean deploy
#9
PicoCreator
closed
1 year ago
1
[2023-08-28] Sunsetting non-Llama model examples.
#8
Yard1
opened
1 year ago
0
Missing RWKV/rwkv-raven-14b from the model list?
#7
PicoCreator
opened
1 year ago
5
Leaderboard can be manipulated
#6
HT224
closed
1 year ago
2
Repeated Failure and Restarting of Worker Deployment
#5
njgerner
closed
1 year ago
5
Request for Comment: Aviary <-> LangChain Integration
#4
waleedkadous
closed
1 year ago
5
model README update
#3
kylehh
closed
1 year ago
0
What cluster configuration do I need to deploy Aviary?
#2
amogkam
closed
1 year ago
4
Add lint CI
#1
Yard1
closed
1 year ago
0
Previous