issues
search
google
/
jetstream-pytorch
PyTorch/XLA integration with JetStream (https://github.com/google/JetStream) for LLM inference"
Apache License 2.0
32
stars
14
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Fix attention kernel of GQA use case
#78
lsy323
closed
3 months ago
0
Enable quantization for Gemma 7b
#77
qihqi
closed
3 months ago
0
Add benchmark results
#76
qihqi
closed
3 months ago
0
Enable Gemma 2B
#75
qihqi
closed
3 months ago
0
Add gemma and update recent changes to multiple host
#74
FanhaiLu1
closed
3 months ago
0
Fix sharding config for quant
#73
lsy323
closed
3 months ago
0
Use GemmaAttention for Gemma
#72
qihqi
closed
3 months ago
0
Support converting hf gemma weights
#71
lsy323
closed
3 months ago
6
Gemma sharding and test
#70
FanhaiLu1
closed
3 months ago
0
Add gemma support
#69
qihqi
closed
4 months ago
0
Add prefill only benchmark for different token length
#68
FanhaiLu1
closed
4 months ago
0
Pick a slot from 0 to batch_size-1 during run_interactive.py
#67
bhavya01
closed
4 months ago
1
Add vscode to gitignore
#66
FanhaiLu1
closed
4 months ago
0
Refactor so that environment and engine
#65
qihqi
closed
4 months ago
1
Support llama3
#64
bhavya01
closed
4 months ago
6
Add ray multiple host support
#63
FanhaiLu1
closed
4 months ago
4
Ignore duplicated lines check now
#62
FanhaiLu1
closed
4 months ago
0
Output all token text
#61
FanhaiLu1
closed
4 months ago
0
Comment broken function to unblock interactive run after JetStream api change
#60
FanhaiLu1
closed
4 months ago
0
Use property instead of function
#59
FanhaiLu1
closed
4 months ago
0
Enable pylint check
#58
FanhaiLu1
closed
4 months ago
0
Fix run_server lint check
#57
FanhaiLu1
closed
4 months ago
0
Fix run_interactive lint check
#56
FanhaiLu1
closed
4 months ago
0
Fix convert checkpoint lint check
#55
FanhaiLu1
closed
4 months ago
0
Add pylintrc and init in root dir
#54
FanhaiLu1
closed
4 months ago
0
Fix quantizaiton, jax lint and llama e2e
#53
FanhaiLu1
closed
4 months ago
0
Fix quantizaiton and jax lint check
#52
FanhaiLu1
closed
4 months ago
0
Fix test quantization lint check
#51
FanhaiLu1
closed
4 months ago
0
Fix test_model_impl lint
#50
FanhaiLu1
closed
4 months ago
0
Clean up llama_e2e test
#49
FanhaiLu1
closed
4 months ago
0
Cleanup test_jax_torch
#48
FanhaiLu1
closed
4 months ago
0
Disable test_engine check for now
#47
FanhaiLu1
closed
4 months ago
0
Add pylintrc to tests
#46
FanhaiLu1
closed
4 months ago
0
Clean up config.py
#45
FanhaiLu1
closed
4 months ago
0
Cleanup quantize
#44
FanhaiLu1
closed
4 months ago
0
Cleanup environment
#43
FanhaiLu1
closed
4 months ago
0
Clean up engine
#42
FanhaiLu1
closed
4 months ago
0
Cleanup cache_manager
#41
FanhaiLu1
closed
4 months ago
0
Add .pylintrc
#40
FanhaiLu1
closed
4 months ago
0
Clean up benchmarks files
#39
FanhaiLu1
closed
4 months ago
0
Cleanup run_offline
#38
FanhaiLu1
closed
4 months ago
0
Remove duplicated test
#37
FanhaiLu1
closed
4 months ago
0
Fix pylint for micro benchmark
#36
FanhaiLu1
closed
4 months ago
0
Use 2 space as indentation
#35
FanhaiLu1
closed
4 months ago
0
Enable pylint check
#34
FanhaiLu1
closed
4 months ago
0
Enable pyink check
#33
FanhaiLu1
closed
4 months ago
0
Cleanup and format main dir code
#32
FanhaiLu1
closed
4 months ago
0
Cleanup and format benchmark code
#31
FanhaiLu1
closed
4 months ago
0
Cleanup and format test code
#30
FanhaiLu1
closed
4 months ago
0
Cleanup and format engine code
#29
FanhaiLu1
closed
4 months ago
0
Previous
Next