issues
search
google
/
jetstream-pytorch
PyTorch/XLA integration with JetStream (https://github.com/google/JetStream) for LLM inference"
Apache License 2.0
33
stars
14
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Enable pyink check
#33
FanhaiLu1
closed
4 months ago
0
Cleanup and format main dir code
#32
FanhaiLu1
closed
4 months ago
0
Cleanup and format benchmark code
#31
FanhaiLu1
closed
4 months ago
0
Cleanup and format test code
#30
FanhaiLu1
closed
4 months ago
0
Cleanup and format engine code
#29
FanhaiLu1
closed
4 months ago
0
Cleanup and format third party code
#28
FanhaiLu1
closed
4 months ago
0
Ray multiple host support
#27
FanhaiLu1
closed
3 months ago
1
llama3
#26
qihqi
closed
4 months ago
0
Add original llama prefill and decode
#25
FanhaiLu1
closed
4 months ago
0
update create TPU VM link
#24
FanhaiLu1
closed
4 months ago
0
Add jetstream links
#23
FanhaiLu1
closed
5 months ago
0
Unstall existing jax before install jax
#22
FanhaiLu1
closed
5 months ago
0
Remove unused import
#21
FanhaiLu1
closed
5 months ago
0
Pass all unit tests
#20
FanhaiLu1
closed
5 months ago
0
Initial implementation
#19
liurupeng
closed
4 months ago
0
Fix KVCacheGenerate
#18
FanhaiLu1
closed
5 months ago
0
Add Jax torch test
#17
FanhaiLu1
closed
5 months ago
1
Add float32 support
#16
FanhaiLu1
closed
5 months ago
1
Add copyright
#15
FanhaiLu1
closed
5 months ago
0
Fix the 70B quantized model with correct kv head dimension for cache.
#14
wang2yn84
closed
5 months ago
0
Fix unit tests CICD
#13
JoeZijunZhou
closed
5 months ago
0
Add CICD for jetstream_pt unit tests
#12
JoeZijunZhou
closed
5 months ago
0
Add llama end to end test with jetstream engine
#11
FanhaiLu1
closed
5 months ago
0
Updates the toml script to the release tag version; Removes the poetry related config from the toml script; Updates the engine to take checkpoint paths without .safetensors suffix for better user experience.
#10
wang2yn84
closed
5 months ago
4
Update readme
#9
FanhaiLu1
closed
5 months ago
0
Add colorama
#8
qihqi
closed
5 months ago
0
Move create_pytorch_engine to init.
#7
qihqi
closed
5 months ago
0
Refactor interactive
#6
FanhaiLu1
closed
5 months ago
0
Fix install_everything
#5
FanhaiLu1
closed
5 months ago
0
Remove personal information
#4
FanhaiLu1
closed
5 months ago
0
Remove personal information
#3
FanhaiLu1
closed
5 months ago
0
Update readme
#2
FanhaiLu1
closed
5 months ago
0
mv run_interactive out of benchmarks
#1
FanhaiLu1
closed
5 months ago
1
Previous